[ https://issues.apache.org/jira/browse/GEODE-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jacob Barrett updated GEODE-7420: --------------------------------- Description: Benchmarks failed in [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark/builds/670] {noformat} SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. org.apache.geode.benchmark.tests.PartitionedIndexedQueryBenchmark average ops/second Baseline: 32309.71 Test: 30390.65 Difference: -5.9% ops/second standard error Baseline: 50.85 Test: 37.40 Difference: -26.4% ops/second standard deviation Baseline: 879.21 Test: 646.71 Difference: -26.4% YS 99th percentile latency Baseline: 20096.43 Test: 20096.09 Difference: -0.0% median latency Baseline: 8962047.00 Test: 8634367.00 Difference: -3.7% 90th percentile latency Baseline: 35323903.00 Test: 49414143.00 Difference: +39.9% 99th percentile latency Baseline: 216399871.00 Test: 114360319.00 Difference: -47.2% 99.9th percentile latency Baseline: 258473983.00 Test: 230948863.00 Difference: -10.6% average latency Baseline: 17829254.97 Test: 18979417.96 Difference: +6.5% latency standard deviation Baseline: 29915296.71 Test: 26736072.76 Difference: -10.6% latency standard error Baseline: 9616.70 Test: 8868.23 Difference: -7.8% BENCHMARK FAILED: org.apache.geode.benchmark.tests.PartitionedIndexedQueryBenchmark average latency is 5% worse than baseline. {noformat} was: Benchmarks failed in https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark/builds/670 {noformat} SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. org.apache.geode.benchmark.tests.PartitionedFunctionExecutionWithArgumentsBenchmark average ops/second Baseline: 268375.49 Test: 272615.85 Difference: +1.6% ops/second standard error Baseline: 685.23 Test: 776.55 Difference: +13.3% ops/second standard deviation Baseline: 11848.76 Test: 13427.87 Difference: +13.3% YS 99th percentile latency Baseline: 1905.00 Test: 1904.00 Difference: -0.1% median latency Baseline: 731135.00 Test: 740351.00 Difference: +1.3% 90th percentile latency Baseline: 1391615.00 Test: 1360895.00 Difference: -2.2% 99th percentile latency Baseline: 8888319.00 Test: 8429567.00 Difference: -5.2% 99.9th percentile latency Baseline: 25477119.00 Test: 25165823.00 Difference: -1.2% average latency Baseline: 1071449.63 Test: 1054730.69 Difference: -1.6% latency standard deviation Baseline: 1745180.39 Test: 1699559.12 Difference: -2.6% latency standard error Baseline: 194.54 Test: 187.97 Difference: -3.4% org.apache.geode.benchmark.tests.PartitionedFunctionExecutionWithFiltersBenchmark average ops/second Baseline: 328925.71 Test: 342909.21 Difference: +4.3% ops/second standard error Baseline: 417.23 Test: 435.36 Difference: +4.3% ops/second standard deviation Baseline: 7214.58 Test: 7528.04 Difference: +4.3% YS 99th percentile latency Baseline: 20003.00 Test: 20004.00 Difference: +0.0% median latency Baseline: 1239039.00 Test: 1175551.00 Difference: -5.1% 90th percentile latency Baseline: 2799615.00 Test: 2682879.00 Difference: -4.2% 99th percentile latency Baseline: 12869631.00 Test: 12607487.00 Difference: -2.0% 99.9th percentile latency Baseline: 44466175.00 Test: 42565631.00 Difference: -4.3% average latency Baseline: 1749256.81 Test: 1677443.51 Difference: -4.1% latency standard deviation Baseline: 3061797.44 Test: 3044573.18 Difference: -0.6% latency standard error Baseline: 308.32 Test: 300.25 Difference: -2.6% org.apache.geode.benchmark.tests.PartitionedGetBenchmark average ops/second Baseline: 987349.37 Test: 985697.58 Difference: -0.2% ops/second standard error Baseline: 1239.47 Test: 1186.89 Difference: -4.2% ops/second standard deviation Baseline: 21432.43 Test: 20523.24 Difference: -4.2% YS 99th percentile latency Baseline: 1201.00 Test: 1202.00 Difference: +0.1% median latency Baseline: 589823.00 Test: 585215.00 Difference: -0.8% 90th percentile latency Baseline: 889855.00 Test: 903167.00 Difference: +1.5% 99th percentile latency Baseline: 1374207.00 Test: 1445887.00 Difference: +5.2% 99.9th percentile latency Baseline: 25460735.00 Test: 25100287.00 Difference: -1.4% average latency Baseline: 727486.35 Test: 728837.38 Difference: +0.2% latency standard deviation Baseline: 1544152.30 Test: 1543259.87 Difference: -0.1% latency standard error Baseline: 89.74 Test: 89.77 Difference: +0.0% org.apache.geode.benchmark.tests.PartitionedIndexedQueryBenchmark average ops/second Baseline: 32309.71 Test: 30390.65 Difference: -5.9% ops/second standard error Baseline: 50.85 Test: 37.40 Difference: -26.4% ops/second standard deviation Baseline: 879.21 Test: 646.71 Difference: -26.4% YS 99th percentile latency Baseline: 20096.43 Test: 20096.09 Difference: -0.0% median latency Baseline: 8962047.00 Test: 8634367.00 Difference: -3.7% 90th percentile latency Baseline: 35323903.00 Test: 49414143.00 Difference: +39.9% 99th percentile latency Baseline: 216399871.00 Test: 114360319.00 Difference: -47.2% 99.9th percentile latency Baseline: 258473983.00 Test: 230948863.00 Difference: -10.6% average latency Baseline: 17829254.97 Test: 18979417.96 Difference: +6.5% latency standard deviation Baseline: 29915296.71 Test: 26736072.76 Difference: -10.6% latency standard error Baseline: 9616.70 Test: 8868.23 Difference: -7.8% org.apache.geode.benchmark.tests.PartitionedPutBenchmark average ops/second Baseline: 511201.43 Test: 508568.81 Difference: -0.5% ops/second standard error Baseline: 2270.47 Test: 2198.54 Difference: -3.2% ops/second standard deviation Baseline: 39260.12 Test: 38016.24 Difference: -3.2% YS 99th percentile latency Baseline: 1507.00 Test: 1504.00 Difference: -0.2% median latency Baseline: 846335.00 Test: 862719.00 Difference: +1.9% 90th percentile latency Baseline: 1158143.00 Test: 1168383.00 Difference: +0.9% 99th percentile latency Baseline: 10084351.00 Test: 9887743.00 Difference: -1.9% 99.9th percentile latency Baseline: 94502911.00 Test: 90111999.00 Difference: -4.6% average latency Baseline: 1405779.71 Test: 1413269.79 Difference: +0.5% latency standard deviation Baseline: 5738014.95 Test: 5674995.32 Difference: -1.1% latency standard error Baseline: 463.36 Test: 459.47 Difference: -0.8% BENCHMARK FAILED: org.apache.geode.benchmark.tests.PartitionedIndexedQueryBenchmark average latency is 5% worse than baseline. {noformat} > PartitionedIndexedQueryBenchmark failed > --------------------------------------- > > Key: GEODE-7420 > URL: https://issues.apache.org/jira/browse/GEODE-7420 > Project: Geode > Issue Type: Bug > Components: benchmarks > Reporter: Eric Shu > Priority: Major > > Benchmarks failed in > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark/builds/670] > {noformat} > SLF4J: Defaulting to no-operation (NOP) logger implementation > SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further > details. > org.apache.geode.benchmark.tests.PartitionedIndexedQueryBenchmark > average ops/second Baseline: 32309.71 Test: 30390.65 > Difference: -5.9% > ops/second standard error Baseline: 50.85 Test: 37.40 > Difference: -26.4% > ops/second standard deviation Baseline: 879.21 Test: 646.71 > Difference: -26.4% > YS 99th percentile latency Baseline: 20096.43 Test: 20096.09 > Difference: -0.0% > median latency Baseline: 8962047.00 Test: 8634367.00 > Difference: -3.7% > 90th percentile latency Baseline: 35323903.00 Test: 49414143.00 > Difference: +39.9% > 99th percentile latency Baseline: 216399871.00 Test: 114360319.00 > Difference: -47.2% > 99.9th percentile latency Baseline: 258473983.00 Test: 230948863.00 > Difference: -10.6% > average latency Baseline: 17829254.97 Test: 18979417.96 > Difference: +6.5% > latency standard deviation Baseline: 29915296.71 Test: 26736072.76 > Difference: -10.6% > latency standard error Baseline: 9616.70 Test: 8868.23 > Difference: -7.8% > BENCHMARK FAILED: > org.apache.geode.benchmark.tests.PartitionedIndexedQueryBenchmark average > latency is 5% worse than baseline. > {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005)