The test data for mpl is available as a sperate conda package, matplotlib-tests. The reason for splitting it is 40Mb of tests images.
Tom On Thu, Feb 4, 2016, 09:09 Pauli Virtanen <p...@iki.fi> wrote: > 04.02.2016, 07:56, Nathaniel Smith kirjoitti: > [clip] > > Whoops, got distracted talking about the results and forgot to say -- > > I guess we should think about how to combine these? I like the > > information on warnings, because it helps gauge the impact of > > deprecations, which is a thing that takes a lot of our attention. But > > your approach is clearly fancier in terms of how it parses the test > > results. (Do you think the fanciness is worth it? I can see an > > argument for crude and simple if the fanciness ends up being fragile, > > but I haven't read the code -- mostly I was just being crude and > > simple because I'm lazy :-).) > > The fanciness is essentially a question of implementation language and > ease of writing the reporting code. At 640 SLOC it's probably not so bad. > > I guess it's reasonably robust --- the test report formats are unlikely > to change, and pip/virtualenv will probably continue to work esp. with > pinned pip version. > > It should be simple to extract also the warnings from the test stdout. > > I'm not sure if the order of test results is deterministic in > nose/py.test, so I don't know if just diffing the outputs always works. > > Building downstream from source avoids future binary compatibility issues. > > [clip] > > Maybe it should be uploading the reports somewhere? So there'd be a > > readable "what's currently broken by 1.x" page, plus with persistent > > storage we could get travis to flag if new additions to the release > > branch causes any new failures to appear? (That way we only have to > > remember to look at the report manually once per release, instead of > > constantly throughout the process.) > > This is probably possible to implement. Although, I'm not sure how much > added value this is compared to travis matrix, eg. > https://travis-ci.org/pv/testrig/ > > Of course, if the suggestion is that the results are generated on > somewhere else than on travis, then that's a different matter. > > -- > Pauli Virtanen > > _______________________________________________ > NumPy-Discussion mailing list > NumPy-Discussion@scipy.org > https://mail.scipy.org/mailman/listinfo/numpy-discussion >
_______________________________________________ NumPy-Discussion mailing list NumPy-Discussion@scipy.org https://mail.scipy.org/mailman/listinfo/numpy-discussion