marcoabreu edited a comment on issue #17889: Re-enable coverage on CI for GCC CPU builds URL: https://github.com/apache/incubator-mxnet/pull/17889#issuecomment-615851885 You have to take into account that additionally to randomness in our tests, a stable coverage report requires that the base commit (in the master branch) actually had a successful run. Otherwise, the report is based on partial data. So I'd say there are two or three action items: 1. Introduce tests for flaky lines 2. Add a retry mechanism for failed CI runs on the master branch 3. Stabilize CI runs to "never". This goal is reached when the master branch CI run rate is close to 100% successful. Wrt to 3), I think we're quite far away unfortunately - so 2) is certainly the first thing that should be done: ![image](https://user-images.githubusercontent.com/18629099/79637079-82e20600-817c-11ea-9464-b65cf3dd81ad.png) I'd recommend to spend time on stabilizing CI as highest priority over all the other optimizations.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services