szha commented on issue #19207: URL: https://github.com/apache/incubator-mxnet/issues/19207#issuecomment-696943612
Thanks for the proposal on addressing the flaky test problem. I've been also thinking the same and here are a couple of suggestions that may help: - if we introduce a new mxnet-bot command that can trigger requested tests using MXNET_TEST_COUNT=1000 that contributors/committers/reviewers can use, this can help reduce the cost of verifying flaky tests and thus prevent new flaky tests from being merged. - we can adopt [hypothesis](https://hypothesis.readthedocs.io/en/latest/numpy.html) package for more clever and reproducible fuzzy testing. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
