Re: Random data in tests produces unstable test coverage

2019-01-20 Thread Marco de Abreu
That's a great question! Since we record branch-coverage as well, we would now reliably notice these test-gaps and could make targeted tests. Additionally, we could define test-coverage thresholds for certain files to enforce this - e.g. 100% for all operators. While the stochastic approach certai

Re: Random data in tests produces unstable test coverage

2019-01-20 Thread Chris Olivier
wouldn’t abandoning stochastic testing mean that execution paths would no longer be tested and therefore increase issues found in production? On Sun, Jan 20, 2019 at 5:13 AM Marco de Abreu wrote: > Hello everyone, > > a few months ago, I have enabled test coverage recording for the MXNet > repos