On Wed, 17 Aug 2016 at 17:37 Victor Stinner <[email protected]>
wrote:

> Hi,
>
> After a few months of work, I created a "new" benchmark suite for Python:
>
>    https://github.com/python/benchmarks
> [SNIP]
>

Yay!


>
> Known regressions:
>
> * Memory tracking is broken
> * run_compare command is currently broken: use run (store result into
> a file) + compare manually
> * Some benchmarks have been removed: rietveld, spitfire (not on PyPI),
> pystone, gcbench, tuple_gc_hell
> * I only tested Linux, I expect issues on Windows. (I didn't try my
> perf module on Windows yet.)
>
> I already allowed all Python core developers to push to the GitHub
> project. We can create a new "benchmarks" (or "Performance" maybe?)
> team if we want to allow more contributors who are not core
> developers.
>
> PyPy, Pyston, Pyjion, Numba, etc. : Hey! it's now time to start to
> take a look at my project and test it ;-) Tell me what is broken, what
> is missing, and I will try to help you to move your project to this
> new benchmark suite!
>
> As requested (suggested?) by Brett Cannon, the Git repository has no
> history, it only contains 1 commit! I'm really sorry of losing all
> the history and all authors, but it allows to start with a much
> smaller repository: around 2 MB. The current benchmark repository is
> more around 200 MB!
>

If people care then they can look at hg.python.org/benchmarks


>
> TODO:
>
> * continue to upgrade libraries in requirements.txt. I failed to
> upgrade Django to 1.10, it complains about a missing template engine
> config setting.
> * convert more code to the perf module, like "startup" tests
> * run benchmarks and analyze results ;-)
> * write more documentation explaining how to run reliable benchmarks
> * ...
>

I'll try to get around and run the benchmarks on Windows to see if any
issues come up.
_______________________________________________
Speed mailing list
[email protected]
https://mail.python.org/mailman/listinfo/speed

Reply via email to