I thought Piston had been shuttered by Dropbox, so I wouldn't worry about
convincing them to change speed.pyston.org.
On Mon, May 29, 2017, 13:57 Victor Stinner,
wrote:
> 2017-05-29 22:45 GMT+02:00 Antoine Pitrou :
> > I don't know. It means that
2017-05-29 22:57 GMT+02:00 Victor Stinner :
> When I started to work on benchmarks last year, I noticed that we used
> a Mercurial version which was 5 years old, and a Django version which
> was something like 3 years old. I would like to benchmark the
> Mercurial and
2017-05-29 22:45 GMT+02:00 Antoine Pitrou :
> I don't know. It means that benchmark results published on the Web
> are generally not comparable with each other unless they happen to be
> generated with the exact same version. It reduces the usefulness of
> the benchmarks
2017-05-29 19:10 GMT+02:00 Antoine Pitrou :
> Also, to expand a bit on what I'm trying to say: like you, I have my own
> idea of which benchmarks are pointless and unrepresentative, but when
> maintaining the former benchmarks suite I usually refrained from
> removing those