Yes this could be interesting and I'd consider asking my company to donate if it has clear benefits over what's already out there.
As Florian mentioned, pytest-cache lets you rerun failed tests. And pytest-sugar gives you nice progress and instant failures as they happen. pytest-xdist helps parallelize and speed up slow tests. I wonder if pytest-cache should be in pytest core? Personally I always forget to install and use it. (Which maybe says more about me than about pytest or pytest-cache) But _maybe_ if it was in core, it would be more likely to be discovered and used? Sorry, kind of a tangent. Perhaps a demo would make it clearer what you're envisioning? -Marc http://marc-abramowitz.com Sent from my iPhone 4S On Dec 12, 2014, at 7:17 AM, "Florian Schulze" <[email protected]> wrote: >> We are putting together a small Indiegogo campaign for a pytest plugin >> which should significantly improve the experience of executing a long >> test suite. We'd be glad to hear any feedback before launching it. The >> draft is here: https://www.indiegogo.com/project/preview/4fe07d66 > > This certainly looks interesting. > > The "last failures" part is implemented in pytest-cache, are you aware of > that? > > The reordering by speed sounds nice. Be aware, that fixture setup/teardown > may be influenced by reordering and thus change the overall test execution > time. I discovered this while extending pytest-random. > > I also thought about using something like coverage to only run affected > tests. How much testing did you do in your prototype? Do you keep track of > (pip/setuptools) installed packages (versions)? Did you try changes at > various levels like new files, modules, classes, metaclasses, mocks etc? > Python is very dynamic as you most likely know :) > > Regards, > Florian Schulze > _______________________________________________ > pytest-dev mailing list > [email protected] > https://mail.python.org/mailman/listinfo/pytest-dev _______________________________________________ pytest-dev mailing list [email protected] https://mail.python.org/mailman/listinfo/pytest-dev
