On Wed, Apr 24, 2019 at 11:22 AM Antoine Pitrou <anto...@python.org> wrote:
> > Hi Areg, > > Le 23/04/2019 à 23:43, Melik-Adamyan, Areg a écrit : > > Because we are using Google Benchmark, which has specific format there > is a tool called becnhcmp which compares two runs: > > > > $ benchcmp old.txt new.txt > > benchmark old ns/op new ns/op delta > > BenchmarkConcat 523 68.6 -86.88% > > > > So the comparison part is done and there is no need to create infra for > that. > "surprisingly" Go is already using that benchmark format :) and (on top of a Go-based benchcmp command) there is also a benchstat command that, given a set of multiple before/after data points adds some amount of statistical analysis: https://godoc.org/golang.org/x/perf/cmd/benchstat using the "benchmark" file format of benchcmp and benchstat would allow better cross-language interop. cheers, -s
