|
I tried again to revive this idea on the new discourse python
forum here
https://discuss.python.org/t/add-a-benchmark-run-to-the-buildbot-infrastructure/521?u=mattip
Matti
On 28/6/18 8:05 pm, Matti Picus wrote:
I would be interested in getting this going as well
The runner machine is managed through the python chef repo https://github.com/python/psf-chef
repo under the role "python-speed".
I can think of two ways to have this run, one as a cron job added
to a recipe and then run via psf-chef/roles/python-speed.rb
The other would be to hook the runner machine into the buildbot
infrastructure as a nightly "build" task, this is the way PyPy
runs its benchmarks. The advantage to this method is that it would
be trivial to link in other benchmarking hardware, they would
simply appear as buildbot slaves.
A third, temporary way (until chef reconfigures the runner
machine) would simply be to set up a cron job on the runner
machine and call it a day, check back every couple of weeks that
it is still running.
I could do this over the next few days just to get the data
flowing
Matti
On 28/06/18 07:38, Victor Stinner wrote:
I'm not aware of any existing doc... Let me see:
* There are two servers: the runner and the web servers. Here I only
care about the runner who I run benchmarks.
* I automated all steps to run a benchmark in the "performance"
project. At the end, the command is just "python3 -m performance
compile_all ~/bench.conf". But for pratical reasons, I chose to clone
"perf" and "performance" repositories manually, and I updated them
manually as well.
To run benchmark, I open a SSH connection, open a screen, run
"./run_benchmarks.sh" and that's it.
My request would be to automate this in a cron tab.
I'm not aware of any automation for these servers: check many in
psf-salt and psf-chef projects. My notes about the Python infra:
http://pythondev.readthedocs.io/cpython.html#python-infrastructure
I might share additional details with you in private. I'm not sure if
some parts of the infra should be kept secret or not :-)
Victor
2018-06-28 15:20 GMT+02:00 Andrii Soldatenko <andrii.soldate...@gmail.com>:
Hi Viktor,
If you can point me to repo and docs, I can automate it.
On Jun 28, 2018, at 2:13 AM, Victor Stinner <vstin...@redhat.com> wrote:
Hi,
FYI I'm still running *manually* "./run_benchmark.sh" in a screen on
the benchmark runner to sometimes upload new results to
speed.python.org.
Since Python 3.7.0 is going to be released, I ran benchmarks.
Results: https://speed.python.org/
Is there anyone interested to write a cron task to automate running
run_benchmark.sh?
Victor
_______________________________________________
Speed mailing list
Speed@python.org
https://mail.python.org/mailman/listinfo/speed
_______________________________________________
Speed mailing list
Speed@python.org
https://mail.python.org/mailman/listinfo/speed
|
_______________________________________________
Speed mailing list -- speed@python.org
To unsubscribe send an email to speed-le...@python.org
