marcoabreu edited a comment on issue #17889: Re-enable coverage on CI for GCC 
CPU builds
URL: https://github.com/apache/incubator-mxnet/pull/17889#issuecomment-615851885
 
 
   You have to take into account that additionally to randomness in our tests, 
a stable coverage report requires that the base commit (in the master branch) 
actually had a successful run. Otherwise, the report is based on partial data.
   
   So I'd say there are two or three action items:
   
   1. Introduce tests for flaky lines
   2. Add a retry mechanism for failed CI runs on the master branch
   3. Stabilize CI runs to "never". This goal is reached when the master branch 
CI run rate is close to 100% successful. 
   
   Wrt to 3), I think we're quite far away unfortunately - so 2) is certainly 
the first thing that should be done:
   
![image](https://user-images.githubusercontent.com/18629099/79637079-82e20600-817c-11ea-9464-b65cf3dd81ad.png)
   
   I'd recommend to spend time on stabilizing CI as highest priority over all 
the other optimizations.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to