Sebastien - yes, Go has very advanced, but simple performance benchmarking tooling. My intention is to reuse as much as we can.
-----Original Message----- From: Sebastien Binet [mailto:bi...@cern.ch] Sent: Wednesday, April 24, 2019 11:09 AM To: dev@arrow.apache.org Subject: Re: Benchmarking mailing list thread [was Fwd: [Discuss] Benchmarking infrastructure] On Wed, Apr 24, 2019 at 11:22 AM Antoine Pitrou <anto...@python.org> wrote: > > Hi Areg, > > Le 23/04/2019 à 23:43, Melik-Adamyan, Areg a écrit : > > Because we are using Google Benchmark, which has specific format > > there > is a tool called becnhcmp which compares two runs: > > > > $ benchcmp old.txt new.txt > > benchmark old ns/op new ns/op delta > > BenchmarkConcat 523 68.6 -86.88% > > > > So the comparison part is done and there is no need to create infra > > for > that. > "surprisingly" Go is already using that benchmark format :) and (on top of a Go-based benchcmp command) there is also a benchstat command that, given a set of multiple before/after data points adds some amount of statistical analysis: https://godoc.org/golang.org/x/perf/cmd/benchstat using the "benchmark" file format of benchcmp and benchstat would allow better cross-language interop. cheers, -s
