Eric Shu created GEODE-7420:
-------------------------------
Summary: PartitionedIndexedQueryBenchmark failed
Key: GEODE-7420
URL: https://issues.apache.org/jira/browse/GEODE-7420
Project: Geode
Issue Type: Bug
Components: benchmarks
Reporter: Eric Shu
Benchmarks failed in
https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark/builds/670
{noformat}
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further
details.
org.apache.geode.benchmark.tests.PartitionedFunctionExecutionWithArgumentsBenchmark
average ops/second Baseline: 268375.49 Test: 272615.85
Difference: +1.6%
ops/second standard error Baseline: 685.23 Test: 776.55
Difference: +13.3%
ops/second standard deviation Baseline: 11848.76 Test: 13427.87
Difference: +13.3%
YS 99th percentile latency Baseline: 1905.00 Test: 1904.00
Difference: -0.1%
median latency Baseline: 731135.00 Test: 740351.00
Difference: +1.3%
90th percentile latency Baseline: 1391615.00 Test: 1360895.00
Difference: -2.2%
99th percentile latency Baseline: 8888319.00 Test: 8429567.00
Difference: -5.2%
99.9th percentile latency Baseline: 25477119.00 Test: 25165823.00
Difference: -1.2%
average latency Baseline: 1071449.63 Test: 1054730.69
Difference: -1.6%
latency standard deviation Baseline: 1745180.39 Test: 1699559.12
Difference: -2.6%
latency standard error Baseline: 194.54 Test: 187.97
Difference: -3.4%
org.apache.geode.benchmark.tests.PartitionedFunctionExecutionWithFiltersBenchmark
average ops/second Baseline: 328925.71 Test: 342909.21
Difference: +4.3%
ops/second standard error Baseline: 417.23 Test: 435.36
Difference: +4.3%
ops/second standard deviation Baseline: 7214.58 Test: 7528.04
Difference: +4.3%
YS 99th percentile latency Baseline: 20003.00 Test: 20004.00
Difference: +0.0%
median latency Baseline: 1239039.00 Test: 1175551.00
Difference: -5.1%
90th percentile latency Baseline: 2799615.00 Test: 2682879.00
Difference: -4.2%
99th percentile latency Baseline: 12869631.00 Test: 12607487.00
Difference: -2.0%
99.9th percentile latency Baseline: 44466175.00 Test: 42565631.00
Difference: -4.3%
average latency Baseline: 1749256.81 Test: 1677443.51
Difference: -4.1%
latency standard deviation Baseline: 3061797.44 Test: 3044573.18
Difference: -0.6%
latency standard error Baseline: 308.32 Test: 300.25
Difference: -2.6%
org.apache.geode.benchmark.tests.PartitionedGetBenchmark
average ops/second Baseline: 987349.37 Test: 985697.58
Difference: -0.2%
ops/second standard error Baseline: 1239.47 Test: 1186.89
Difference: -4.2%
ops/second standard deviation Baseline: 21432.43 Test: 20523.24
Difference: -4.2%
YS 99th percentile latency Baseline: 1201.00 Test: 1202.00
Difference: +0.1%
median latency Baseline: 589823.00 Test: 585215.00
Difference: -0.8%
90th percentile latency Baseline: 889855.00 Test: 903167.00
Difference: +1.5%
99th percentile latency Baseline: 1374207.00 Test: 1445887.00
Difference: +5.2%
99.9th percentile latency Baseline: 25460735.00 Test: 25100287.00
Difference: -1.4%
average latency Baseline: 727486.35 Test: 728837.38
Difference: +0.2%
latency standard deviation Baseline: 1544152.30 Test: 1543259.87
Difference: -0.1%
latency standard error Baseline: 89.74 Test: 89.77
Difference: +0.0%
org.apache.geode.benchmark.tests.PartitionedIndexedQueryBenchmark
average ops/second Baseline: 32309.71 Test: 30390.65
Difference: -5.9%
ops/second standard error Baseline: 50.85 Test: 37.40
Difference: -26.4%
ops/second standard deviation Baseline: 879.21 Test: 646.71
Difference: -26.4%
YS 99th percentile latency Baseline: 20096.43 Test: 20096.09
Difference: -0.0%
median latency Baseline: 8962047.00 Test: 8634367.00
Difference: -3.7%
90th percentile latency Baseline: 35323903.00 Test: 49414143.00
Difference: +39.9%
99th percentile latency Baseline: 216399871.00 Test: 114360319.00
Difference: -47.2%
99.9th percentile latency Baseline: 258473983.00 Test: 230948863.00
Difference: -10.6%
average latency Baseline: 17829254.97 Test: 18979417.96
Difference: +6.5%
latency standard deviation Baseline: 29915296.71 Test: 26736072.76
Difference: -10.6%
latency standard error Baseline: 9616.70 Test: 8868.23
Difference: -7.8%
org.apache.geode.benchmark.tests.PartitionedPutBenchmark
average ops/second Baseline: 511201.43 Test: 508568.81
Difference: -0.5%
ops/second standard error Baseline: 2270.47 Test: 2198.54
Difference: -3.2%
ops/second standard deviation Baseline: 39260.12 Test: 38016.24
Difference: -3.2%
YS 99th percentile latency Baseline: 1507.00 Test: 1504.00
Difference: -0.2%
median latency Baseline: 846335.00 Test: 862719.00
Difference: +1.9%
90th percentile latency Baseline: 1158143.00 Test: 1168383.00
Difference: +0.9%
99th percentile latency Baseline: 10084351.00 Test: 9887743.00
Difference: -1.9%
99.9th percentile latency Baseline: 94502911.00 Test: 90111999.00
Difference: -4.6%
average latency Baseline: 1405779.71 Test: 1413269.79
Difference: +0.5%
latency standard deviation Baseline: 5738014.95 Test: 5674995.32
Difference: -1.1%
latency standard error Baseline: 463.36 Test: 459.47
Difference: -0.8%
BENCHMARK FAILED:
org.apache.geode.benchmark.tests.PartitionedIndexedQueryBenchmark average
latency is 5% worse than baseline.
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
