Renkai opened a new pull request #9380:
URL: https://github.com/apache/pulsar/pull/9380


   Our current tests will auto-retry failed tests, which could lead to some 
problems:
   
   * If one method in one test class failed, all methods in the test class will 
be retriggered, which will make the test easier to timeout and generate more 
noise logs to make us harder to locate the error log.
   * The failed method may have changed the test environment, and then the 
second try may report different error info, which will mislead us to solve the 
problem, too.
   * Auto retry is useful to pass flaky tests, but have a low return on 
investment for the same reason shown above.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to