I agree having benchmarks for non regression would be very helpful. A
seemingly simple change in Cython code can lead to drastic performance drop.
I can't find it back but I think Jérémie has submitted an issue about this?
On 7/22/19 9:59 AM, Tom Augspurger wrote:
Thanks Adrin,
A month or so ago I started running scikit-learn benchmarks, but I had
to disable them since they were taking too long (longer than a day).
I haven't had time to investigate why, but I assume it was an issue
with how I set them up.
Just FYI, I'm planning to include "maintain and improve the benchmark
running tools" as part of the pandas' application for the CZI grant.
All that is in https://github.com/asv-runner (a mix of Ansible,
Airflow, and GitHub bots). If anyone is interested in (possibly)
having funding
to work on this, feel free to reach out to me off list and we can
discuss things.
Tom
On Mon, Jul 22, 2019 at 8:53 AM Adrin <adrin.jal...@gmail.com
<mailto:adrin.jal...@gmail.com>> wrote:
Hi,
There is this
[page](https://pandas.pydata.org/speed/scikit-learn/) maintained
by some of the pandas maintainers (@TomAugspurger in particular),
and it seems like a really good idea to have an eye on the
performance of different benchmarks through time just in case a PR
introduces some major drawbacks.
However, he doesn't have the bandwidth to maintain it much more,
and not really the hardware. I think it'd be a good idea for us to
have that, wanted to bring it up and see what you think!
Cheers,
Adrin.
_______________________________________________
scikit-learn mailing list
scikit-learn@python.org <mailto:scikit-learn@python.org>
https://mail.python.org/mailman/listinfo/scikit-learn
_______________________________________________
scikit-learn mailing list
scikit-learn@python.org
https://mail.python.org/mailman/listinfo/scikit-learn
_______________________________________________
scikit-learn mailing list
scikit-learn@python.org
https://mail.python.org/mailman/listinfo/scikit-learn
