erenavsarogullari opened a new issue #2865: [Integration Test Pipeline] Add 
Quarantine List Support
URL: https://github.com/apache/incubator-heron/issues/2865
 
 
   Integration Test Pipeline looks having a couple of flaky tests recently. For 
the long-term, in the light of incoming features and their new 
integration-tests, Integration Test Pipeline' s stabilization will be more 
important.
   
   - `quarantine-list` feature can be useful to manage/disable flaky 
integration-tests without touching source-code 
(`~/integration_test/src/python/test_runner/resources/test.json`). Test can be 
quarantined until proper-fix by getting agreement in channel so will not block 
build pipeline and related build (`~2h`) due to unstable behavior.
   - On the other hand, after it is quarantined, it can still continue to run 
without breaking the build (even if it fails) so related flaky test patch can 
be monitored and verified.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to