[jira] [Updated] (GEODE-9340) Benchmark instability in PartitionedPutLongBenchmark

2021-11-23 Thread Donal Evans (Jira) 

 [ 
https://issues.apache.org/jira/browse/GEODE-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Donal Evans updated GEODE-9340:
---
Labels: pull-request-available  (was: blocks-1.15.0​ pull-request-available)

> Benchmark instability in PartitionedPutLongBenchmark
> 
>
> Key: GEODE-9340
> URL: https://issues.apache.org/jira/browse/GEODE-9340
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Sarah Abbey
>Priority: Major
>  Labels: pull-request-available
>
> PartitionedPutLongBenchmark failed in CI 
> (https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/6):
> {code:java}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:825011.38  Test:835847.67  Difference:   +1.3%
>  avg latency  
> Baseline:871392.31  Test:859444.66  Difference:   -1.4%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:123838.43  Test:122686.30  Difference:   -0.9%
>  avg latency  
> Baseline:   6015719.73  Test:   6119472.19  Difference:   +1.7%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:174887.77  Test:171040.93  Difference:   -2.2%
>  avg latency  
> Baseline:   4145337.60  Test:   4236159.60  Difference:   +2.2%
>    PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:248635.36  Test:261498.94  Difference:   +5.2%
>  avg latency  
> Baseline:867122.63  Test:824550.34  Difference:   -4.9%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:280071.19  Test:275305.31  Difference:   -1.7%
>  avg latency  
> Baseline:   1026643.12  Test:   1044307.43  Difference:   +1.7%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:301416.23  Test:304317.30  Difference:   +1.0%
>  avg latency  
> Baseline:   1908390.88  Test:   1890040.46  Difference:   -1.0%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:790800.52  Test:784514.74  Difference:   -0.8%
>  avg latency  
> Baseline:908357.58  Test:915790.96  Difference:   +0.8%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1020821.32  Test:996529.93  Difference:   -2.4%
>  avg latency  
> Baseline:703761.09  Test:720744.36  Difference:   +2.4%
>    PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1028992.93  Test:   1010447.47  Difference:   -1.8%
>  avg latency  
> Baseline:698009.55  Test:710765.29  Difference:   +1.8%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 30868.78  Test: 31478.90  Difference:   +2.0%
>  avg latency  
> Baseline:  18670093.21  Test:  18278083.16  Difference:   -2.1%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:99.45  Test:   101.97  Difference:   +2.5%
>  avg latency  
> Baseline: 723415530.75  Test: 705653061.86  Difference:   -2.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  7921.61  Test:  7816.66  Difference:   -1.3%
>  avg latency  
> Baseline:  18172638.37  Test:  18416169.28  Difference:   +1.3%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1379.53  Test:  1169.16  Difference:  -15.2%
>  avg latency  
> Baseline: 105140260.44  Test: 123722914.94  Difference:  +17.7%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:474986.11  Test:467924.19  Difference:   -1.5%
>  avg latency  
> Baseline:   1514276.31  Test:   1536263.99  Difference:   +1.5%
>

[jira] [Updated] (GEODE-9340) Benchmark instability in PartitionedPutLongBenchmark

2021-10-07 Thread Robert Houghton (Jira) 

 [ 
https://issues.apache.org/jira/browse/GEODE-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Houghton updated GEODE-9340:
---
Labels: blocks-1.15.0​ pull-request-available  (was: pull-request-available)

> Benchmark instability in PartitionedPutLongBenchmark
> 
>
> Key: GEODE-9340
> URL: https://issues.apache.org/jira/browse/GEODE-9340
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Sarah Abbey
>Assignee: Hale Bales
>Priority: Major
>  Labels: blocks-1.15.0​, pull-request-available
>
> PartitionedPutLongBenchmark failed in CI 
> (https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/6):
> {code:java}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:825011.38  Test:835847.67  Difference:   +1.3%
>  avg latency  
> Baseline:871392.31  Test:859444.66  Difference:   -1.4%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:123838.43  Test:122686.30  Difference:   -0.9%
>  avg latency  
> Baseline:   6015719.73  Test:   6119472.19  Difference:   +1.7%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:174887.77  Test:171040.93  Difference:   -2.2%
>  avg latency  
> Baseline:   4145337.60  Test:   4236159.60  Difference:   +2.2%
>    PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:248635.36  Test:261498.94  Difference:   +5.2%
>  avg latency  
> Baseline:867122.63  Test:824550.34  Difference:   -4.9%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:280071.19  Test:275305.31  Difference:   -1.7%
>  avg latency  
> Baseline:   1026643.12  Test:   1044307.43  Difference:   +1.7%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:301416.23  Test:304317.30  Difference:   +1.0%
>  avg latency  
> Baseline:   1908390.88  Test:   1890040.46  Difference:   -1.0%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:790800.52  Test:784514.74  Difference:   -0.8%
>  avg latency  
> Baseline:908357.58  Test:915790.96  Difference:   +0.8%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1020821.32  Test:996529.93  Difference:   -2.4%
>  avg latency  
> Baseline:703761.09  Test:720744.36  Difference:   +2.4%
>    PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1028992.93  Test:   1010447.47  Difference:   -1.8%
>  avg latency  
> Baseline:698009.55  Test:710765.29  Difference:   +1.8%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 30868.78  Test: 31478.90  Difference:   +2.0%
>  avg latency  
> Baseline:  18670093.21  Test:  18278083.16  Difference:   -2.1%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:99.45  Test:   101.97  Difference:   +2.5%
>  avg latency  
> Baseline: 723415530.75  Test: 705653061.86  Difference:   -2.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  7921.61  Test:  7816.66  Difference:   -1.3%
>  avg latency  
> Baseline:  18172638.37  Test:  18416169.28  Difference:   +1.3%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1379.53  Test:  1169.16  Difference:  -15.2%
>  avg latency  
> Baseline: 105140260.44  Test: 123722914.94  Difference:  +17.7%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:474986.11  Test:467924.19  Difference:   -1.5%
>  avg latency  
> Baseline:   1514276.31  Test:   1536263.99  

[jira] [Updated] (GEODE-9340) Benchmark instability in PartitionedPutLongBenchmark

2021-09-02 Thread Nabarun Nag (Jira) 

 [ 
https://issues.apache.org/jira/browse/GEODE-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nabarun Nag updated GEODE-9340:
---
Fix Version/s: (was: 1.13.4)
   (was: 1.13.3)
   (was: 1.15.0)
   (was: 1.14.0)

> Benchmark instability in PartitionedPutLongBenchmark
> 
>
> Key: GEODE-9340
> URL: https://issues.apache.org/jira/browse/GEODE-9340
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Sarah Abbey
>Assignee: Hale Bales
>Priority: Major
>  Labels: pull-request-available
>
> PartitionedPutLongBenchmark failed in CI 
> (https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/6):
> {code:java}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:825011.38  Test:835847.67  Difference:   +1.3%
>  avg latency  
> Baseline:871392.31  Test:859444.66  Difference:   -1.4%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:123838.43  Test:122686.30  Difference:   -0.9%
>  avg latency  
> Baseline:   6015719.73  Test:   6119472.19  Difference:   +1.7%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:174887.77  Test:171040.93  Difference:   -2.2%
>  avg latency  
> Baseline:   4145337.60  Test:   4236159.60  Difference:   +2.2%
>    PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:248635.36  Test:261498.94  Difference:   +5.2%
>  avg latency  
> Baseline:867122.63  Test:824550.34  Difference:   -4.9%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:280071.19  Test:275305.31  Difference:   -1.7%
>  avg latency  
> Baseline:   1026643.12  Test:   1044307.43  Difference:   +1.7%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:301416.23  Test:304317.30  Difference:   +1.0%
>  avg latency  
> Baseline:   1908390.88  Test:   1890040.46  Difference:   -1.0%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:790800.52  Test:784514.74  Difference:   -0.8%
>  avg latency  
> Baseline:908357.58  Test:915790.96  Difference:   +0.8%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1020821.32  Test:996529.93  Difference:   -2.4%
>  avg latency  
> Baseline:703761.09  Test:720744.36  Difference:   +2.4%
>    PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1028992.93  Test:   1010447.47  Difference:   -1.8%
>  avg latency  
> Baseline:698009.55  Test:710765.29  Difference:   +1.8%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 30868.78  Test: 31478.90  Difference:   +2.0%
>  avg latency  
> Baseline:  18670093.21  Test:  18278083.16  Difference:   -2.1%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:99.45  Test:   101.97  Difference:   +2.5%
>  avg latency  
> Baseline: 723415530.75  Test: 705653061.86  Difference:   -2.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  7921.61  Test:  7816.66  Difference:   -1.3%
>  avg latency  
> Baseline:  18172638.37  Test:  18416169.28  Difference:   +1.3%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1379.53  Test:  1169.16  Difference:  -15.2%
>  avg latency  
> Baseline: 105140260.44  Test: 123722914.94  Difference:  +17.7%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:474986.11  Test:467924.19  Difference:   -1.5%
>  avg latency  
>

[jira] [Updated] (GEODE-9340) Benchmark instability in PartitionedPutLongBenchmark

2021-06-18 Thread ASF GitHub Bot (Jira) 

 [ 
https://issues.apache.org/jira/browse/GEODE-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated GEODE-9340:
--
Labels: pull-request-available  (was: )

> Benchmark instability in PartitionedPutLongBenchmark
> 
>
> Key: GEODE-9340
> URL: https://issues.apache.org/jira/browse/GEODE-9340
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Sarah Abbey
>Assignee: Hale Bales
>Priority: Major
>  Labels: pull-request-available
>
> PartitionedPutLongBenchmark failed in CI 
> (https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/6):
> {code:java}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:825011.38  Test:835847.67  Difference:   +1.3%
>  avg latency  
> Baseline:871392.31  Test:859444.66  Difference:   -1.4%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:123838.43  Test:122686.30  Difference:   -0.9%
>  avg latency  
> Baseline:   6015719.73  Test:   6119472.19  Difference:   +1.7%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:174887.77  Test:171040.93  Difference:   -2.2%
>  avg latency  
> Baseline:   4145337.60  Test:   4236159.60  Difference:   +2.2%
>    PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:248635.36  Test:261498.94  Difference:   +5.2%
>  avg latency  
> Baseline:867122.63  Test:824550.34  Difference:   -4.9%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:280071.19  Test:275305.31  Difference:   -1.7%
>  avg latency  
> Baseline:   1026643.12  Test:   1044307.43  Difference:   +1.7%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:301416.23  Test:304317.30  Difference:   +1.0%
>  avg latency  
> Baseline:   1908390.88  Test:   1890040.46  Difference:   -1.0%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:790800.52  Test:784514.74  Difference:   -0.8%
>  avg latency  
> Baseline:908357.58  Test:915790.96  Difference:   +0.8%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1020821.32  Test:996529.93  Difference:   -2.4%
>  avg latency  
> Baseline:703761.09  Test:720744.36  Difference:   +2.4%
>    PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1028992.93  Test:   1010447.47  Difference:   -1.8%
>  avg latency  
> Baseline:698009.55  Test:710765.29  Difference:   +1.8%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 30868.78  Test: 31478.90  Difference:   +2.0%
>  avg latency  
> Baseline:  18670093.21  Test:  18278083.16  Difference:   -2.1%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:99.45  Test:   101.97  Difference:   +2.5%
>  avg latency  
> Baseline: 723415530.75  Test: 705653061.86  Difference:   -2.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  7921.61  Test:  7816.66  Difference:   -1.3%
>  avg latency  
> Baseline:  18172638.37  Test:  18416169.28  Difference:   +1.3%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1379.53  Test:  1169.16  Difference:  -15.2%
>  avg latency  
> Baseline: 105140260.44  Test: 123722914.94  Difference:  +17.7%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:474986.11  Test:467924.19  Difference:   -1.5%
>  avg latency  
> Baseline:   1514276.31  Test:   1536263.99  Difference:   +1.5%
>

[jira] [Updated] (GEODE-9340) Benchmark instability in PartitionedPutLongBenchmark

2021-06-02 Thread Sarah Abbey (Jira) 

 [ 
https://issues.apache.org/jira/browse/GEODE-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarah Abbey updated GEODE-9340:
---
Affects Version/s: 1.15.0

> Benchmark instability in PartitionedPutLongBenchmark
> 
>
> Key: GEODE-9340
> URL: https://issues.apache.org/jira/browse/GEODE-9340
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Sarah Abbey
>Priority: Major
>
> PartitionedPutLongBenchmark failed in CI 
> (https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/6):
> {code:java}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:825011.38  Test:835847.67  Difference:   +1.3%
>  avg latency  
> Baseline:871392.31  Test:859444.66  Difference:   -1.4%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:123838.43  Test:122686.30  Difference:   -0.9%
>  avg latency  
> Baseline:   6015719.73  Test:   6119472.19  Difference:   +1.7%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:174887.77  Test:171040.93  Difference:   -2.2%
>  avg latency  
> Baseline:   4145337.60  Test:   4236159.60  Difference:   +2.2%
>    PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:248635.36  Test:261498.94  Difference:   +5.2%
>  avg latency  
> Baseline:867122.63  Test:824550.34  Difference:   -4.9%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:280071.19  Test:275305.31  Difference:   -1.7%
>  avg latency  
> Baseline:   1026643.12  Test:   1044307.43  Difference:   +1.7%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:301416.23  Test:304317.30  Difference:   +1.0%
>  avg latency  
> Baseline:   1908390.88  Test:   1890040.46  Difference:   -1.0%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:790800.52  Test:784514.74  Difference:   -0.8%
>  avg latency  
> Baseline:908357.58  Test:915790.96  Difference:   +0.8%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1020821.32  Test:996529.93  Difference:   -2.4%
>  avg latency  
> Baseline:703761.09  Test:720744.36  Difference:   +2.4%
>    PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1028992.93  Test:   1010447.47  Difference:   -1.8%
>  avg latency  
> Baseline:698009.55  Test:710765.29  Difference:   +1.8%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 30868.78  Test: 31478.90  Difference:   +2.0%
>  avg latency  
> Baseline:  18670093.21  Test:  18278083.16  Difference:   -2.1%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:99.45  Test:   101.97  Difference:   +2.5%
>  avg latency  
> Baseline: 723415530.75  Test: 705653061.86  Difference:   -2.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  7921.61  Test:  7816.66  Difference:   -1.3%
>  avg latency  
> Baseline:  18172638.37  Test:  18416169.28  Difference:   +1.3%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1379.53  Test:  1169.16  Difference:  -15.2%
>  avg latency  
> Baseline: 105140260.44  Test: 123722914.94  Difference:  +17.7%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:474986.11  Test:467924.19  Difference:   -1.5%
>  avg latency  
> Baseline:   1514276.31  Test:   1536263.99  Difference:   +1.5%
> PartitionedPutBytesBenchmark avg ops/sec  
> Baseline:457550.69  Test:456011.33  Difference:   

[jira] [Updated] (GEODE-9340) Benchmark instability in PartitionedPutLongBenchmark

2021-06-02 Thread Sarah Abbey (Jira) 

 [ 
https://issues.apache.org/jira/browse/GEODE-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarah Abbey updated GEODE-9340:
---
Description: 
PartitionedPutLongBenchmark failed in CI 
(https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/6):
{code:java}
This is ITERATION 1 of benchmarking against baseline.
  P2pPartitionedGetBenchmark avg ops/sec  
Baseline:825011.38  Test:835847.67  Difference:   +1.3%
 avg latency  
Baseline:871392.31  Test:859444.66  Difference:   -1.4%
  P2pPartitionedPutBenchmark avg ops/sec  
Baseline:123838.43  Test:122686.30  Difference:   -0.9%
 avg latency  
Baseline:   6015719.73  Test:   6119472.19  Difference:   +1.7%
 P2pPartitionedPutBytesBenchmark avg ops/sec  
Baseline:174887.77  Test:171040.93  Difference:   -2.2%
 avg latency  
Baseline:   4145337.60  Test:   4236159.60  Difference:   +2.2%
   PartitionedFunctionExecutionBenchmark avg ops/sec  
Baseline:248635.36  Test:261498.94  Difference:   +5.2%
 avg latency  
Baseline:867122.63  Test:824550.34  Difference:   -4.9%
  PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
Baseline:280071.19  Test:275305.31  Difference:   -1.7%
 avg latency  
Baseline:   1026643.12  Test:   1044307.43  Difference:   +1.7%
PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
Baseline:301416.23  Test:304317.30  Difference:   +1.0%
 avg latency  
Baseline:   1908390.88  Test:   1890040.46  Difference:   -1.0%
 PartitionedGetBenchmark avg ops/sec  
Baseline:790800.52  Test:784514.74  Difference:   -0.8%
 avg latency  
Baseline:908357.58  Test:915790.96  Difference:   +0.8%
 PartitionedGetLongBenchmark avg ops/sec  
Baseline:   1020821.32  Test:996529.93  Difference:   -2.4%
 avg latency  
Baseline:703761.09  Test:720744.36  Difference:   +2.4%
   PartitionedGetStringBenchmark avg ops/sec  
Baseline:   1028992.93  Test:   1010447.47  Difference:   -1.8%
 avg latency  
Baseline:698009.55  Test:710765.29  Difference:   +1.8%
PartitionedIndexedQueryBenchmark avg ops/sec  
Baseline: 30868.78  Test: 31478.90  Difference:   +2.0%
 avg latency  
Baseline:  18670093.21  Test:  18278083.16  Difference:   -2.1%
 PartitionedNonIndexedQueryBenchmark avg ops/sec  
Baseline:99.45  Test:   101.97  Difference:   +2.5%
 avg latency  
Baseline: 723415530.75  Test: 705653061.86  Difference:   -2.5%
  PartitionedPutAllBenchmark avg ops/sec  
Baseline:  7921.61  Test:  7816.66  Difference:   -1.3%
 avg latency  
Baseline:  18172638.37  Test:  18416169.28  Difference:   +1.3%
  PartitionedPutAllLongBenchmark avg ops/sec  
Baseline:  1379.53  Test:  1169.16  Difference:  -15.2%
 avg latency  
Baseline: 105140260.44  Test: 123722914.94  Difference:  +17.7%
 PartitionedPutBenchmark avg ops/sec  
Baseline:474986.11  Test:467924.19  Difference:   -1.5%
 avg latency  
Baseline:   1514276.31  Test:   1536263.99  Difference:   +1.5%
PartitionedPutBytesBenchmark avg ops/sec  
Baseline:457550.69  Test:456011.33  Difference:   -0.3%
 avg latency  
Baseline:   1570713.84  Test:   1575841.02  Difference:   +0.3%
 PartitionedPutLongBenchmark avg ops/sec  
Baseline:418221.79  Test:389221.70  Difference:   -6.9%
 avg latency  
Baseline:   1717869.66  Test:   1849602.96  Difference:   +7.7%
   PartitionedPutStringBenchmark avg ops/sec  
Baseline:410007.93  Test:390442.31  

[jira] [Updated] (GEODE-9340) Benchmark instability in PartitionedPutLongBenchmark

2021-06-02 Thread Sarah Abbey (Jira) 

 [ 
https://issues.apache.org/jira/browse/GEODE-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarah Abbey updated GEODE-9340:
---
Description: 
PartitionedPutLongBenchmark failed in CI:
{code:java}
This is ITERATION 1 of benchmarking against baseline.
  P2pPartitionedGetBenchmark avg ops/sec  
Baseline:825011.38  Test:835847.67  Difference:   +1.3%
 avg latency  
Baseline:871392.31  Test:859444.66  Difference:   -1.4%
  P2pPartitionedPutBenchmark avg ops/sec  
Baseline:123838.43  Test:122686.30  Difference:   -0.9%
 avg latency  
Baseline:   6015719.73  Test:   6119472.19  Difference:   +1.7%
 P2pPartitionedPutBytesBenchmark avg ops/sec  
Baseline:174887.77  Test:171040.93  Difference:   -2.2%
 avg latency  
Baseline:   4145337.60  Test:   4236159.60  Difference:   +2.2%
   PartitionedFunctionExecutionBenchmark avg ops/sec  
Baseline:248635.36  Test:261498.94  Difference:   +5.2%
 avg latency  
Baseline:867122.63  Test:824550.34  Difference:   -4.9%
  PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
Baseline:280071.19  Test:275305.31  Difference:   -1.7%
 avg latency  
Baseline:   1026643.12  Test:   1044307.43  Difference:   +1.7%
PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
Baseline:301416.23  Test:304317.30  Difference:   +1.0%
 avg latency  
Baseline:   1908390.88  Test:   1890040.46  Difference:   -1.0%
 PartitionedGetBenchmark avg ops/sec  
Baseline:790800.52  Test:784514.74  Difference:   -0.8%
 avg latency  
Baseline:908357.58  Test:915790.96  Difference:   +0.8%
 PartitionedGetLongBenchmark avg ops/sec  
Baseline:   1020821.32  Test:996529.93  Difference:   -2.4%
 avg latency  
Baseline:703761.09  Test:720744.36  Difference:   +2.4%
   PartitionedGetStringBenchmark avg ops/sec  
Baseline:   1028992.93  Test:   1010447.47  Difference:   -1.8%
 avg latency  
Baseline:698009.55  Test:710765.29  Difference:   +1.8%
PartitionedIndexedQueryBenchmark avg ops/sec  
Baseline: 30868.78  Test: 31478.90  Difference:   +2.0%
 avg latency  
Baseline:  18670093.21  Test:  18278083.16  Difference:   -2.1%
 PartitionedNonIndexedQueryBenchmark avg ops/sec  
Baseline:99.45  Test:   101.97  Difference:   +2.5%
 avg latency  
Baseline: 723415530.75  Test: 705653061.86  Difference:   -2.5%
  PartitionedPutAllBenchmark avg ops/sec  
Baseline:  7921.61  Test:  7816.66  Difference:   -1.3%
 avg latency  
Baseline:  18172638.37  Test:  18416169.28  Difference:   +1.3%
  PartitionedPutAllLongBenchmark avg ops/sec  
Baseline:  1379.53  Test:  1169.16  Difference:  -15.2%
 avg latency  
Baseline: 105140260.44  Test: 123722914.94  Difference:  +17.7%
 PartitionedPutBenchmark avg ops/sec  
Baseline:474986.11  Test:467924.19  Difference:   -1.5%
 avg latency  
Baseline:   1514276.31  Test:   1536263.99  Difference:   +1.5%
PartitionedPutBytesBenchmark avg ops/sec  
Baseline:457550.69  Test:456011.33  Difference:   -0.3%
 avg latency  
Baseline:   1570713.84  Test:   1575841.02  Difference:   +0.3%
 PartitionedPutLongBenchmark avg ops/sec  
Baseline:418221.79  Test:389221.70  Difference:   -6.9%
 avg latency  
Baseline:   1717869.66  Test:   1849602.96  Difference:   +7.7%
   PartitionedPutStringBenchmark avg ops/sec  
Baseline:410007.93  Test:390442.31  Difference:   -4.8%
 avg latency  
Baseline: