Rob,
I thought I would be able to help with checking out bugs, but it is way
more complicated than my skill level. Would you please remove me from
the list of volunteers?
Thank you,
Karen Furber
On 2/25/2013 5:16 AM, Rob Weir wrote:
On Sun, Feb 24, 2013 at 11:42 PM, Yi Xuan Liu <[email protected]> wrote:
Hi, all:
AOO 4.0 will release. Performance plays an important role in software
quality. Is there any volunteer who want to run performance test?
I've run AOO performance test on my own machines. I've tried on 3
platforms: Windows XP, Ubuntu 10.04, Mac Mac OS 10.7.3. The test configures
are as follows:
(1) W500; CPU:2.53 GHz; Mem: 3GB; OS: XP SP3
(2) Ubuntu; CPU: Interl® Core™ 2 Duo 2 GHz; Mem: 3GB; OS: Ubuntu 10.04
(3) Mac; CPU: Interl® Core™ 2 Duo 2 GHz; Mem: 3GB; OS: Mac OS 10.7.3
I assume the volunteer does not need to have exactly the same machine
type as you had. But they need some stability in the configuration.
A performance test might be run first on the AOO 3.4.1 release to
establish a baseline. Then re-test on a current 4.0 snapshot build.
And then re-run on new dev snapshot builds, maybe once a week.
The goal is to detect performance regressions early, so developers can fix it.
The technical challenge here is to preserve a stable machine
configuration. If the machine changes, because of an OS upgrade, or a
changed hard drive, or a different network environment, or because of
a new anti-virus product, then that confuses things. We need to
"control all the variables".
One approach to controlling all of the variables is to have a machine
that is used for nothing but performance testing. That way we know
the machine's base performance does not change.
Another approach is re-run the baseline AOO 3.4.1 performance tests
each week. This is more tolerant of changes in machine configuration,
etc.
-Rob
The test scenario include: AOO startup, file open, and save.
Volunteers could run performance test on other platforms.
All the automation scripts could be downloaded in AOO project. And it is
not difficult to set the automation environment. You could follow the guide:
http://wiki.openoffice.org/wiki/QA/test_automation_guide
For any questions, be free to contact with me :)
