Re: [scikit-learn] Continues monitoring of benchmark performances

2019-07-23 Thread Jeremie du Boisberranger
> Isn't Jérémie's project at https://github.com/jeremiedbb/scikit-learn_benchmarks meant to be doing this? What's its status? How does it relate to Tom's work? Yes it's the same project. Tom kindly accepted to run it alongside other projects from the pydata ecosystem. > I can't find it back

Re: [scikit-learn] Continues monitoring of benchmark performances

2019-07-22 Thread Alexandre Gramfort
it's the same projects. Alex ___ scikit-learn mailing list scikit-learn@python.org https://mail.python.org/mailman/listinfo/scikit-learn

Re: [scikit-learn] Continues monitoring of benchmark performances

2019-07-22 Thread Joel Nothman
Isn't Jérémie's project at https://github.com/jeremiedbb/scikit-learn_benchmarks meant to be doing this? What's its status? How does it relate to Tom's work? (Can we please take http://scikit-learn.org/ml-benchmarks/ offline?) On Tue, 23 Jul 2019 at 00:17, Nicolas Hug wrote: > I agree having be

Re: [scikit-learn] Continues monitoring of benchmark performances

2019-07-22 Thread Nicolas Hug
I agree having benchmarks for non regression would be very helpful. A seemingly simple change in Cython code can lead to drastic performance drop. I can't find it back but I think Jérémie has submitted an issue about this? On 7/22/19 9:59 AM, Tom Augspurger wrote: Thanks Adrin, A month or so

Re: [scikit-learn] Continues monitoring of benchmark performances

2019-07-22 Thread Tom Augspurger
Thanks Adrin, A month or so ago I started running scikit-learn benchmarks, but I had to disable them since they were taking too long (longer than a day). I haven't had time to investigate why, but I assume it was an issue with how I set them up. Just FYI, I'm planning to include "maintain and imp

[scikit-learn] Continues monitoring of benchmark performances

2019-07-22 Thread Adrin
Hi, There is this [page](https://pandas.pydata.org/speed/scikit-learn/) maintained by some of the pandas maintainers (@TomAugspurger in particular), and it seems like a really good idea to have an eye on the performance of different benchmarks through time just in case a PR introduces some major d