Code0x58 opened a new issue #2925: Flaky Java integration test
URL: https://github.com/apache/incubator-heron/issues/2925
 
 
   This has failed a few times at least recently, and is why the current commit 
on master is red.
   
   File: 
[/integration_test/src/java/org/apache/heron/integration_test/topology/non_grouping/NonGrouping.java](https://github.com/apache/incubator-heron/blob/0138b8d451c988f53e431f951f9a6fb9f2f4c116/integration_test/src/java/org/apache/heron/integration_test/topology/non_grouping/NonGrouping.java)
   Example failure: 
[build](https://travis-ci.org/apache/incubator-heron/builds/393993192?utm_source=github_status&utm_medium=notification)
   ```
   [2018-06-19 09:44:54 +0000] [INFO]: Fetching results for topology 
20180619094300_IntegrationTest_NonGrouping_93bd575e-d7f0-4fb1-96d2-4b8bb7e4cd1f,
 retry count: 5
   [2018-06-19 09:44:54 +0000] [INFO]: 200 GET 
/results/20180619094300_IntegrationTest_NonGrouping_93bd575e-d7f0-4fb1-96d2-4b8bb7e4cd1f
 (127.0.0.1) 0.99ms
   [2018-06-19 09:44:54 +0000] [ERROR]: Actual result did not match expected 
result
   [2018-06-19 09:44:54 +0000] [INFO]: Actual result ---------- 
   ['A', 'A', 'A', 'A', 'A', 'A', 'A', 'B', 'B', 'B', 'B', 'B', 'B', 'B']
   [2018-06-19 09:44:54 +0000] [INFO]: Expected result ---------- 
   ['A', 'A', 'A', 'A', 'A', 'B', 'B', 'B', 'B', 'B']
   [2018-06-19 09:44:54 +0000] [ERROR]: Checking result failed for 
20180619094300_IntegrationTest_NonGrouping_93bd575e-d7f0-4fb1-96d2-4b8bb7e4cd1f 
topology :: Traceback (most recent call last):
     File "integration_test/src/python/test_runner/main.py", line 184, in 
run_test
       return results_checker.check_results()
     File "integration_test/src/python/test_runner/main.py", line 103, in 
check_results
       return self._compare(expected_results, actual_results)
     File "integration_test/src/python/test_runner/main.py", line 116, in 
_compare
       raise failure
   TestFailure: ('Actual result did not match expected result', None)
   ```
   In a version of Bazel newer than that which I have seen documented, or used 
by Travis (which was the newer of the two), there is the 
[flaky](https://docs.bazel.build/versions/master/be/common-definitions.html#test.flaky)
 flag which can be used to retry a test up to 3 times. That said, I don't know 
how dependable this tested component should be at the moment, so this might 
just be a bug in the software or test setup.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to