[
https://issues.apache.org/jira/browse/FLINK-23392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Piotr Nowojski closed FLINK-23392.
----------------------------------
Fix Version/s: 1.14.0
Resolution: Fixed
merged commit 70d9b7b into flink-benchmarks master
> Benchmarks should exclude startup/shutdown time
> -----------------------------------------------
>
> Key: FLINK-23392
> URL: https://issues.apache.org/jira/browse/FLINK-23392
> Project: Flink
> Issue Type: Improvement
> Components: Benchmarks
> Reporter: Chesnay Schepler
> Assignee: Chesnay Schepler
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.14.0
>
>
> The benchmarks currently simply run against a local environment, which means
> that the benchmark time includes how long it takes for Flink to start and
> shut down.
> This creates noise in the benchmark results, and can result in serious
> performance regressions being reported that are not not actually performance
> related.
> Instead, the benchmarks should setup separate setup a MiniCluster and run the
> job against that.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
