[jira] [Created] (GEODE-7616) ReplicatedPutAllBenchmark average latency is 5% worse than baseline

[Bill Burcham (Jira)]

Bill Burcham created GEODE-7616:
-----------------------------------

             Summary: ReplicatedPutAllBenchmark average latency is 5% worse 
than baseline
                 Key: GEODE-7616
                 URL: https://issues.apache.org/jira/browse/GEODE-7616
             Project: Geode
          Issue Type: Bug
          Components: benchmarks
            Reporter: Bill Burcham


Three runs in a row have failed with {{ReplicatedPutAllBenchmark average 
latency is 5% worse than baseline}} starting with:

https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/23

e.g.

{code}
org.apache.geode.benchmark.tests.ReplicatedPutAllBenchmark

              average ops/second  Baseline:       900.64  Test:       828.40  
Difference:   -8.0%

       ops/second standard error  Baseline:         2.71  Test:         2.47  
Difference:   -8.9%

   ops/second standard deviation  Baseline:        46.91  Test:        42.76  
Difference:   -8.9%

      YS 99th percentile latency  Baseline:     20099.00  Test:     20099.00  
Difference:   +0.0%

                  median latency  Baseline: 158728191.00  Test: 172359679.00  
Difference:   +8.6%

         90th percentile latency  Baseline: 228458495.00  Test: 244449279.00  
Difference:   +7.0%

         99th percentile latency  Baseline: 299368447.00  Test: 319815679.00  
Difference:   +6.8%

       99.9th percentile latency  Baseline: 354156543.00  Test: 387710975.00  
Difference:   +9.5%

                 average latency  Baseline: 160197744.39  Test: 174083983.05  
Difference:   +8.7%

      latency standard deviation  Baseline:  53484962.25  Test:  55775317.05  
Difference:   +4.3%

          latency standard error  Baseline:    103053.88  Test:    111997.05  
Difference:   +8.7%
{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)