mbien commented on a change in pull request #3781:
URL: https://github.com/apache/netbeans/pull/3781#discussion_r827006238



##########
File path: .travis.yml
##########
@@ -723,6 +721,18 @@ matrix:
             - export JAVA_HOME=$TEST_JDK
             - hide-logs.sh ant $OPTS commit-validation
 
+#   exile: for tests which don't behave. Job should be kept short to be easily 
restartable
+        - name: Test unreliable tests on Java 8
+          jdk: openjdk8
+          env:
+            - 
OPTS="-Dmetabuild.jsonurl=https://raw.githubusercontent.com/apache/netbeans-jenkins-lib/master/meta/netbeansrelease.json
 -quiet -Dcluster.config=java -Djavac.compilerargs=-nowarn 
-Dbuild.compiler.deprecation=false 
-Dtest-unit-sys-prop.ignore.random.failures=true"
+          before_script:
+            - nbbuild/travis/ant.sh $OPTS clean
+            - nbbuild/travis/ant.sh $OPTS build
+          script:
+            - travis_retry ant $OPTS -f java/java.lsp.server test
+            - travis_retry hide-logs.sh ant $OPTS -f java/gradle.java test

Review comment:
       I don't know actually. `hide-logs.sh` was there before, i just moved the 
line to a different job. I assumed it being a streaming filter which removes 
some spammy log lines to make CI not error - but I haven't actually looked at 
the script.
   
   Part of this test is me figuring out how practical `travis_retry` is. If you 
think this is a problem i can remove it. Main intention was to isolate bad 
behaving tests so that they would be in a short(er) restartable job, separated 
from reliable tests.
   
   This is also somewhat of a contingency plan in case the tests can't be 
stabilized despite all efforts. I didn't plan to merge this if it turns out 
that the pending reliability PRs fix the problem.
   
   But if you want I can merge it anyway (after your PRs are integrated).




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists

Reply via email to