Re: [Speed] performance 0.5.5 and perf 1.3 released

2017-05-29 Thread Brett Cannon
I thought Piston had been shuttered by Dropbox, so I wouldn't worry about convincing them to change speed.pyston.org. On Mon, May 29, 2017, 13:57 Victor Stinner, wrote: > 2017-05-29 22:45 GMT+02:00 Antoine Pitrou : > > I don't know. It means that

Re: [Speed] performance 0.5.5 and perf 1.3 released

2017-05-29 Thread Victor Stinner
2017-05-29 22:57 GMT+02:00 Victor Stinner : > When I started to work on benchmarks last year, I noticed that we used > a Mercurial version which was 5 years old, and a Django version which > was something like 3 years old. I would like to benchmark the > Mercurial and

Re: [Speed] performance 0.5.5 and perf 1.3 released

2017-05-29 Thread Victor Stinner
2017-05-29 22:45 GMT+02:00 Antoine Pitrou : > I don't know. It means that benchmark results published on the Web > are generally not comparable with each other unless they happen to be > generated with the exact same version. It reduces the usefulness of > the benchmarks

Re: [Speed] performance 0.5.5 and perf 1.3 released

2017-05-29 Thread Victor Stinner
2017-05-29 19:10 GMT+02:00 Antoine Pitrou : > Also, to expand a bit on what I'm trying to say: like you, I have my own > idea of which benchmarks are pointless and unrepresentative, but when > maintaining the former benchmarks suite I usually refrained from > removing those