Re: [rng] Usefulness of benchmarks

2016-09-04 Thread Gilles
Hi. On Sun, 4 Sep 2016 15:20:39 +0300, Artem Barger wrote: On Sun, Sep 4, 2016 at 3:01 PM, Gilles wrote: "RandomStressTester" is in Commons _Rng_ "src/userguide" example code, while I've just committed "RandomNumberGeneratorBenchmark" in Commons _Math_

Re: [rng] Usefulness of benchmarks

2016-09-04 Thread Artem Barger
On Sun, Sep 4, 2016 at 3:01 PM, Gilles wrote: > "RandomStressTester" is in Commons _Rng_ "src/userguide" example > code, while I've just committed "RandomNumberGeneratorBenchmark" > in Commons _Math_ userguide examples (branch "develop"). > > There is a README in

Re: [rng] Usefulness of benchmarks

2016-09-04 Thread Gilles
On Sun, 4 Sep 2016 14:22:04 +0300, Artem Barger wrote: On Sun, Sep 4, 2016 at 2:06 PM, Gilles wrote: A few quick runs seems to produce numbers that are now much closer to what JMH produces.[1] What do you think? ​How I can produce results with PerfTestUtils?

Re: [rng] Usefulness of benchmarks

2016-09-04 Thread Artem Barger
On Sun, Sep 4, 2016 at 2:06 PM, Gilles wrote: > A few quick runs seems to produce numbers that are now much > closer to what JMH produces.[1] > > What do you think? > ​How I can produce results with PerfTestUtils? Is there any script to run RandomStressTester? It

Re: [rng] Usefulness of benchmarks

2016-09-04 Thread Gilles
Hi Artem. I've just updated the usage examples of Commons Math: commit ae8f5f04574be75727f5e948e04bc649cbdbbb3b A few quick runs seems to produce numbers that are now much closer to what JMH produces.[1] What do you think? I'm now fairly comfortable dropping the "PerfTestUtils" column from

Re: [rng] Usefulness of benchmarks

2016-09-03 Thread Gilles
On Sun, 4 Sep 2016 00:33:32 +0300, Artem Barger wrote: On Sat, Sep 3, 2016 at 1:36 AM, Gilles wrote: The discrepancy between "PerfTestUtils" and JMH could be a bug (in "PerfTestUtils" of course!) or ... measuring different use-cases: Use of several RNGs at the

Re: [rng] Usefulness of benchmarks

2016-09-03 Thread Artem Barger
On Sat, Sep 3, 2016 at 1:36 AM, Gilles wrote: > The discrepancy between "PerfTestUtils" and JMH could be a bug (in > "PerfTestUtils" of course!) or ... measuring different use-cases: > Use of several RNGs at the same time vs using a single one; the > latter could