[
https://issues.apache.org/jira/browse/FLINK-25912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489676#comment-17489676
]
Roman Khachatryan commented on FLINK-25912:
-------------------------------------------
There is no regression in production code in commit range from the timeline
(cd8ea8d5b207569f68acc5a3c8db95cd2ca47ba6..d874b2693c75f6c0d680221314edc04f61b2e457).
Rather, the regression was caused by a change in the pipeline.
In particular,
{quote}Anton Kalashnikov
The old launch line(better performance):
{code:java}
sh "${mvnHome}/bin/mvn -Dflink.version=`cat ../flink-version` clean install
exec:exec -Dexec.args=\"-jar target/benchmarks.jar -rf csv
org.apache.flink.state.benchmark.*\" -Dexec.exec=java"
{code}
The new one(degradation):
{code:java}
sh "${mvnHome}/bin/mvn -Dflink.version=`cat ../flink-version` clean install
exec:exec -Dbenchmarks=\"${jmh_benchmarks}\"
-DbenchmarkExcludes=\"${jmh_benchmarks_excludes}\"
-DexecutableJava=${JAVA_HOME}/bin/java"
{code}
{quote}
After a discussion with [~akalashnikov] and [~pnowojski] we decided to keep the
current configuration (and treat regression as a new baseline).
> HashMapStateBackend performance regression on 31.01.2022
> --------------------------------------------------------
>
> Key: FLINK-25912
> URL: https://issues.apache.org/jira/browse/FLINK-25912
> Project: Flink
> Issue Type: Bug
> Components: Benchmarks, Runtime / State Backends
> Reporter: Piotr Nowojski
> Priority: Critical
> Fix For: 1.15.0
>
>
> http://codespeed.dak8s.net:8000/timeline/#/?exe=1,3&ben=mapEntries.HEAP&env=2&revs=200&equid=off&quarts=on&extr=on
> http://codespeed.dak8s.net:8000/timeline/#/?exe=1,3&ben=mapIterator.HEAP&env=2&revs=200&equid=off&quarts=on&extr=on
> http://codespeed.dak8s.net:8000/timeline/#/?exe=1,3&ben=mapKeys.HEAP&env=2&revs=200&equid=off&quarts=on&extr=on
> http://codespeed.dak8s.net:8000/timeline/#/?exe=1,3&ben=mapValues.HEAP&env=2&revs=200&equid=off&quarts=on&extr=on
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
