Hi Antonio,
On 05.03.22 17:54, antonio wrote:
Hi all,
So it seems our Travis builds fail randomly on (at least) the
following tasks:
- 11538.13 Test Java modules with nb-javac on Java 8
- 11538.14 Test java.hints batch 1 with nb-javac on Java 8
yes those are known to fail, esp job 13. I had to brute force this one 5
times yesterday until it passed - i almost reverted a PR since I thought
i broke master. (PR was green but master kept failing after merge)
Questions are:
a) do we need these now that JDK >= 11 is required to run NetBeans?
we should move most tests to 11+, but i got the feeling this won't
stabilize them (that would be too easy :)).
nb-javac is on by default now and we can't really test on 17 due to
technical dept, so we do need them.
b) if not, can we get rid of them?
lets disable the worst offenders until someone has time to take a look
what the issue is. CI stability improved after new year but it got worse
recently again (subjectively).
If something fails. scroll to the end of the log and you should see a
junit report which lists all failing tests. Svatopluk and I added this
recently, in case you haven't seen it yet.
https://github.com/apache/netbeans/pull/3403
https://github.com/apache/netbeans/pull/3450
The objectives being:
- Making Travis builds consistent and reliable.
- Reducing the amount of trees we burn to run Travis builds.
i agree 100%, you don't want to second guess tests - its a huge waste of
time and resources for everyone involved.
We really do have to get this stuff under control, we don't even have
stats. If we would have them, we could simply disable the most often
failing test or try to fix the first - but we don't even know.
I considered downloading and parsing the last N travis logs to generate
some stats, but didn't have time to look into it.
-mbien
Thanks,
Antonio
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists
