FYI I still run sometimes the benchmarks manually :-) Le ven. 7 déc. 2018 à 12:04, Matti Picus <[email protected]> a écrit : > > I tried again to revive this idea on the new discourse python forum here > > https://discuss.python.org/t/add-a-benchmark-run-to-the-buildbot-infrastructure/521?u=mattip > > Matti > > > > On 28/6/18 8:05 pm, Matti Picus wrote: > > I would be interested in getting this going as well > > The runner machine is managed through the python chef repo > https://github.com/python/psf-chef repo under the role "python-speed". > > I can think of two ways to have this run, one as a cron job added to a > recipe and then run via psf-chef/roles/python-speed.rb > > The other would be to hook the runner machine into the buildbot > infrastructure as a nightly "build" task, this is the way PyPy runs its > benchmarks. The advantage to this method is that it would be trivial to link > in other benchmarking hardware, they would simply appear as buildbot slaves. > > A third, temporary way (until chef reconfigures the runner machine) would > simply be to set up a cron job on the runner machine and call it a day, check > back every couple of weeks that it is still running. > I could do this over the next few days just to get the data flowing > Matti > > On 28/06/18 07:38, Victor Stinner wrote: > > I'm not aware of any existing doc... Let me see: > > * There are two servers: the runner and the web servers. Here I only > care about the runner who I run benchmarks. > * I automated all steps to run a benchmark in the "performance" > project. At the end, the command is just "python3 -m performance > compile_all ~/bench.conf". But for pratical reasons, I chose to clone > "perf" and "performance" repositories manually, and I updated them > manually as well. > > To run benchmark, I open a SSH connection, open a screen, run > "./run_benchmarks.sh" and that's it. > > My request would be to automate this in a cron tab. > > I'm not aware of any automation for these servers: check many in > psf-salt and psf-chef projects. My notes about the Python infra: > http://pythondev.readthedocs.io/cpython.html#python-infrastructure > > I might share additional details with you in private. I'm not sure if > some parts of the infra should be kept secret or not :-) > > Victor > > 2018-06-28 15:20 GMT+02:00 Andrii Soldatenko <[email protected]>: > > Hi Viktor, > > If you can point me to repo and docs, I can automate it. > > > On Jun 28, 2018, at 2:13 AM, Victor Stinner <[email protected]> wrote: > > Hi, > > FYI I'm still running *manually* "./run_benchmark.sh" in a screen on > the benchmark runner to sometimes upload new results to > speed.python.org. > > Since Python 3.7.0 is going to be released, I ran benchmarks. > > Results: https://speed.python.org/ > > Is there anyone interested to write a cron task to automate running > run_benchmark.sh? > > Victor > _______________________________________________ > Speed mailing list > [email protected] > https://mail.python.org/mailman/listinfo/speed > > _______________________________________________ > Speed mailing list > [email protected] > https://mail.python.org/mailman/listinfo/speed > > > _______________________________________________ > Speed mailing list -- [email protected] > To unsubscribe send an email to [email protected]
-- Night gathers, and now my watch begins. It shall not end until my death. _______________________________________________ Speed mailing list -- [email protected] To unsubscribe send an email to [email protected]
