[Python-Dev] Re: [python-committers] Performance benchmarks for 3.9

2020-10-14 Thread Oscar Benjamin
On Wed, 14 Oct 2020 at 19:12, Ivan Pozdeev via Python-Dev wrote: > > > On 14.10.2020 17:04, M.-A. Lemburg wrote: > > On 14.10.2020 16:00, Pablo Galindo Salgado wrote: > >>> Would it be possible to get the data for older runs back, so that > >> it's easier to find the changes which caused the

[Python-Dev] Re: [python-committers] Performance benchmarks for 3.9

2020-10-14 Thread Ivan Pozdeev via Python-Dev
On 14.10.2020 17:04, M.-A. Lemburg wrote: On 14.10.2020 16:00, Pablo Galindo Salgado wrote:  Would it be possible to get the data for older runs back, so that it's easier to find the changes which caused the slowdown ? Unfortunately no. The reasons are that that data was misleading because

[Python-Dev] Re: [python-committers] Performance benchmarks for 3.9

2020-10-14 Thread Pablo Galindo Salgado
> Would it be possible rerun the tests with the current setup for say the last 1000 revisions or perhaps a subset of these (e.g. every 10th revision) to try to binary search for the revision which introduced the change ? Every run takes 1-2 h so doing 1000 would be certainly time-consuming :)

[Python-Dev] Re: [python-committers] Performance benchmarks for 3.9

2020-10-14 Thread Antoine Pitrou
Le 14/10/2020 à 15:16, Pablo Galindo Salgado a écrit : > Hi! > > I have updated the branch benchmarks in the pyperformance server and now > they include 3.9. There are > some benchmarks that are faster but on the other hand some benchmarks > are substantially slower, pointing > at a possible

[Python-Dev] Re: [python-committers] Performance benchmarks for 3.9

2020-10-14 Thread M.-A. Lemburg
On 14.10.2020 16:00, Pablo Galindo Salgado wrote: >> Would it be possible to get the data for older runs back, so that > it's easier to find the changes which caused the slowdown ? > > Unfortunately no. The reasons are that that data was misleading because > different points were computed with a

[Python-Dev] Re: [python-committers] Performance benchmarks for 3.9

2020-10-14 Thread M.-A. Lemburg
Hi Pablo, thanks for pointing this out. Would it be possible to get the data for older runs back, so that it's easier to find the changes which caused the slowdown ? Going to the timeline, it seems that the system only has data for Oct 14 (today):

[Python-Dev] Re: [python-committers] Performance benchmarks for 3.9

2020-10-14 Thread Pablo Galindo Salgado
> Would it be possible to get the data for older runs back, so that it's easier to find the changes which caused the slowdown ? Unfortunately no. The reasons are that that data was misleading because different points were computed with a different version of pyperformance and therefore with

[Python-Dev] Re: [python-committers] Performance benchmarks for 3.9

2020-10-14 Thread Pablo Galindo Salgado
> The performance figures in the Python 3.9 "What's New" Those are also micro-benchmarks, which can have no effect at all on macro-benchmarks. The ones I am linking are almost all macro-benchmarks, so, unfortunately, the ones in Python 3.9 "What's New" are not lying and they seem to be correlated

[Python-Dev] Re: [python-committers] Performance benchmarks for 3.9

2020-10-14 Thread Paul Moore
The performance figures in the Python 3.9 "What's New" (here - https://docs.python.org/3/whatsnew/3.9.html#optimizations) did look oddly like a lot of things went slower, to me. I assumed I'd misread the figures, and moved on, but maybe I was wrong to do so... Paul On Wed, 14 Oct 2020 at 14:17,