[
https://issues.apache.org/jira/browse/FLINK-23428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roman Khachatryan closed FLINK-23428.
-------------------------------------
Resolution: Not A Bug
[Benchmarking|http://codespeed.dak8s.net:8080/job/flink-statebackend-benchmark-request/51/]
the latest "good" commit bad18ed9aea361836a1c49adefb4a306590419e8
gives the same result as the current master:
{code}
"Benchmark","Mode","Threads","Samples","Score","Score Error
(99.9%)","Unit","Param: backendType"
"org.apache.flink.state.benchmark.ListStateBenchmark.listAdd","thrpt",1,30,6964.030030,117.124385,"ops/ms",HEAP
"org.apache.flink.state.benchmark.ListStateBenchmark.listAdd","thrpt",1,30,658.252410,5.388955,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.ListStateBenchmark.listAddAll","thrpt",1,30,947.905064,5.543347,"ops/ms",HEAP
"org.apache.flink.state.benchmark.ListStateBenchmark.listAddAll","thrpt",1,30,441.912623,3.712315,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.ListStateBenchmark.listAppend","thrpt",1,30,3522.742816,38.769728,"ops/ms",HEAP
"org.apache.flink.state.benchmark.ListStateBenchmark.listAppend","thrpt",1,30,647.365744,5.085497,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.ListStateBenchmark.listGet","thrpt",1,30,3579.336690,19.315333,"ops/ms",HEAP
"org.apache.flink.state.benchmark.ListStateBenchmark.listGet","thrpt",1,30,190.686385,1.462738,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.ListStateBenchmark.listGetAndIterate","thrpt",1,30,3431.614861,23.760587,"ops/ms",HEAP
"org.apache.flink.state.benchmark.ListStateBenchmark.listGetAndIterate","thrpt",1,30,189.370196,1.556263,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.ListStateBenchmark.listUpdate","thrpt",1,30,3306.651674,28.231829,"ops/ms",HEAP
"org.apache.flink.state.benchmark.ListStateBenchmark.listUpdate","thrpt",1,30,653.751144,5.467340,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.MapStateBenchmark.mapAdd","thrpt",1,30,3549.314361,72.055197,"ops/ms",HEAP
"org.apache.flink.state.benchmark.MapStateBenchmark.mapAdd","thrpt",1,30,562.856446,29.629752,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.MapStateBenchmark.mapContains","thrpt",1,30,2998.291433,58.853018,"ops/ms",HEAP
"org.apache.flink.state.benchmark.MapStateBenchmark.mapContains","thrpt",1,30,69.672636,0.271761,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.MapStateBenchmark.mapEntries","thrpt",1,30,17927.298906,66.274723,"ops/ms",HEAP
"org.apache.flink.state.benchmark.MapStateBenchmark.mapEntries","thrpt",1,30,485.004460,14.414233,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.MapStateBenchmark.mapGet","thrpt",1,30,2854.307475,63.595857,"ops/ms",HEAP
"org.apache.flink.state.benchmark.MapStateBenchmark.mapGet","thrpt",1,30,69.490446,0.313689,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.MapStateBenchmark.mapIsEmpty","thrpt",1,30,3943.875053,119.398588,"ops/ms",HEAP
"org.apache.flink.state.benchmark.MapStateBenchmark.mapIsEmpty","thrpt",1,30,63.475911,0.411677,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.MapStateBenchmark.mapIterator","thrpt",1,30,17232.916234,217.982696,"ops/ms",HEAP
"org.apache.flink.state.benchmark.MapStateBenchmark.mapIterator","thrpt",1,30,479.907643,15.612502,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.MapStateBenchmark.mapKeys","thrpt",1,30,20079.457163,52.463242,"ops/ms",HEAP
"org.apache.flink.state.benchmark.MapStateBenchmark.mapKeys","thrpt",1,30,489.251294,9.793270,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.MapStateBenchmark.mapPutAll","thrpt",1,30,1986.975953,19.920468,"ops/ms",HEAP
"org.apache.flink.state.benchmark.MapStateBenchmark.mapPutAll","thrpt",1,30,166.185012,9.019210,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.MapStateBenchmark.mapRemove","thrpt",1,30,3782.839078,104.762540,"ops/ms",HEAP
"org.apache.flink.state.benchmark.MapStateBenchmark.mapRemove","thrpt",1,30,574.981227,30.712361,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.MapStateBenchmark.mapUpdate","thrpt",1,30,2873.939460,64.126872,"ops/ms",HEAP
"org.apache.flink.state.benchmark.MapStateBenchmark.mapUpdate","thrpt",1,30,563.643957,25.825030,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.MapStateBenchmark.mapValues","thrpt",1,30,20039.335379,88.374364,"ops/ms",HEAP
"org.apache.flink.state.benchmark.MapStateBenchmark.mapValues","thrpt",1,30,483.642585,16.365587,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.ValueStateBenchmark.valueAdd","thrpt",1,30,4056.658447,113.790809,"ops/ms",HEAP
"org.apache.flink.state.benchmark.ValueStateBenchmark.valueAdd","thrpt",1,30,555.615207,28.796434,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.ValueStateBenchmark.valueGet","thrpt",1,30,4019.567696,84.978964,"ops/ms",HEAP
"org.apache.flink.state.benchmark.ValueStateBenchmark.valueGet","thrpt",1,30,896.604774,6.592365,"ops/ms",ROCKSDB
"org.apache.flink.state.benchmark.ValueStateBenchmark.valueUpdate","thrpt",1,30,4172.241709,114.812183,"ops/ms",HEAP
"org.apache.flink.state.benchmark.ValueStateBenchmark.valueUpdate","thrpt",1,30,562.257767,30.253202,"ops/ms",ROCKSDB
{code}
That confirms that the problem is most likely HW-related, closing the ticket.
> Performance regression in state benchmarks on Jul 16 2021
> ---------------------------------------------------------
>
> Key: FLINK-23428
> URL: https://issues.apache.org/jira/browse/FLINK-23428
> Project: Flink
> Issue Type: Bug
> Components: Benchmarks, Runtime / State Backends
> Affects Versions: 1.14.0
> Reporter: Roman Khachatryan
> Assignee: Roman Khachatryan
> Priority: Major
> Attachments: Screenshot_2021-07-19_14-36-28.png
>
>
> E.g.:
> [http://codespeed.dak8s.net:8000/timeline/#/?exe=1,3&ben=listAdd.HEAP&env=2&revs=200&equid=off&quarts=on&extr=on]
> [http://codespeed.dak8s.net:8000/timeline/#/?exe=1,3&ben=listAddAll.HEAP&env=2&revs=200&equid=off&quarts=on&extr=on]
> [http://codespeed.dak8s.net:8000/timeline/#/?exe=1,3&ben=listGet.ROCKSDB&env=2&revs=200&equid=off&quarts=on&extr=on]
> !Screenshot_2021-07-19_14-36-28.png|width=650!
> All affected:
> listAdd.HEAP
> listAddAll.HEAP
> listAppend.HEAP
> listGet.HEAP
> listGet.ROCKSDB
> listGetAndIterate.HEAP
> listGetAndIterate.ROCKSDB
> Probably HW-related after recent outage.
> See also: FLINK-23382 FLINK-23308
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
