Isn't Jérémie's project at https://github.com/jeremiedbb/scikit-learn_benchmarks meant to be doing this? What's its status? How does it relate to Tom's work?
(Can we please take http://scikit-learn.org/ml-benchmarks/ offline?) On Tue, 23 Jul 2019 at 00:17, Nicolas Hug <nio...@gmail.com> wrote: > I agree having benchmarks for non regression would be very helpful. A > seemingly simple change in Cython code can lead to drastic performance drop. > > I can't find it back but I think Jérémie has submitted an issue about this? > > On 7/22/19 9:59 AM, Tom Augspurger wrote: > > Thanks Adrin, > > A month or so ago I started running scikit-learn benchmarks, but I had to > disable them since they were taking too long (longer than a day). > I haven't had time to investigate why, but I assume it was an issue with > how I set them up. > > Just FYI, I'm planning to include "maintain and improve the benchmark > running tools" as part of the pandas' application for the CZI grant. > All that is in https://github.com/asv-runner (a mix of Ansible, Airflow, > and GitHub bots). If anyone is interested in (possibly) having funding > to work on this, feel free to reach out to me off list and we can discuss > things. > > Tom > > On Mon, Jul 22, 2019 at 8:53 AM Adrin <adrin.jal...@gmail.com> wrote: > >> Hi, >> >> There is this [page](https://pandas.pydata.org/speed/scikit-learn/) >> maintained by some of the pandas maintainers (@TomAugspurger in >> particular), and it seems like a really good idea to have an eye on the >> performance of different benchmarks through time just in case a PR >> introduces some major drawbacks. >> >> However, he doesn't have the bandwidth to maintain it much more, and not >> really the hardware. I think it'd be a good idea for us to have that, >> wanted to bring it up and see what you think! >> >> Cheers, >> Adrin. >> _______________________________________________ >> scikit-learn mailing list >> scikit-learn@python.org >> https://mail.python.org/mailman/listinfo/scikit-learn >> > > _______________________________________________ > scikit-learn mailing > listscikit-learn@python.orghttps://mail.python.org/mailman/listinfo/scikit-learn > > _______________________________________________ > scikit-learn mailing list > scikit-learn@python.org > https://mail.python.org/mailman/listinfo/scikit-learn >
_______________________________________________ scikit-learn mailing list scikit-learn@python.org https://mail.python.org/mailman/listinfo/scikit-learn
