Hi all,
Steve and I have update the test matrix for the coming weeks. Due to US
holidays, this matrix will stay in place until next year. For the
desktop team, we aimed to have two people cover each part of ensemble on
various platforms, for embedded (since we have fewer people), one person
testing each part of ensemble. For both teams we had toys-subset and
toys-controls (the two main groups of tests) tested by 2 people each.
Vacations are not taken into account, so it's possible some test
coverage will be missed each week but the overall coverage should be
reasonable, especially given the slower rate of change that's likely due
to the holidays.
Thanks,
Lisa and Steve
On 12/18/2013 2:32 PM, Stephen F Northover wrote:
Hi all,
So the sanity testing was a success. I would not say that the
universe has been fundamentally altered because of it but the idea
that there is a weekly formal time when we kick the tires of FX is a
good one. There were some problems getting the correct bits to test
but that will be resolved for next week. We will be doing this next
week and for the foreseeable future as it was a good forcing function
for people to get their environments up to date and make sure that
things were generally working.
The big winner as a test case was HelloSanity. Although Ensemble
exercises much of FX, some committers found the UI to be somewhat
cumbersome for testing. There is so much functionality in Ensemble,
that a comprehensive test just takes too long. Ensemble is still very
important, but perhaps not the best sanity vehicle. I'm thinking that
in future, we will look towards testing the FX toys that have recently
been open sourced instead of having so many committers poking
Ensemble. Further, we need to add some more 3D testing to the list of
apps we run (3DViewer).
In order to avoid entering duplicates, on the day of the testing, we
won't process outstanding issues so that testers can quickly scan the
"One True Dashboard".
https://javafx-jira.kenai.com/secure/Dashboard.jspa?selectPageId=11893
So we will be sanity testing next Monday the 23rd and after that
refining the process as we go. As we approach our first 8u20
milestone, the testing effort will ramp up but we can discuss
specifics closer to the date.
https://wiki.openjdk.java.net/display/OpenJFX/8u20
Steve
