1996fanrui commented on PR #22921: URL: https://github.com/apache/flink/pull/22921#issuecomment-1614986008
Hi @pnowojski @RocMarshal , I have finished the first version of watermark aggregation benchmark. Would you mind help take a look in your free time? thanks~ [Here](https://github.com/apache/flink-benchmarks/pull/77) is the PR of `flink-benchmark` repo. I run it on my local, and following is the benchmark result, the overall performance has been improved by more than 100 times(Some results are not stable, let's follow the official change from http://codespeed.dak8s.net:8000/ in the future). ``` The result of master branch: Benchmark (numSubtasks) (timestampType) Mode Cnt Score Error Units WatermarkAggregationBenchmark.aggregateWatermark 5000 MONOTONE_INCREASING avgt 10 460.511 ± 31.441 ms/op WatermarkAggregationBenchmark.aggregateWatermark 5000 RANDOMIZE_MILLISECONDS avgt 10 373.986 ± 25.024 ms/op WatermarkAggregationBenchmark.aggregateWatermark 10000 MONOTONE_INCREASING avgt 10 856.788 ± 58.144 ms/op WatermarkAggregationBenchmark.aggregateWatermark 10000 RANDOMIZE_MILLISECONDS avgt 10 1235.172 ± 114.965 ms/op WatermarkAggregationBenchmark.aggregateWatermark 20000 MONOTONE_INCREASING avgt 10 5906.807 ± 91.858 ms/op WatermarkAggregationBenchmark.aggregateWatermark 20000 RANDOMIZE_MILLISECONDS avgt 10 3318.771 ± 272.305 ms/op The result of master branch with https://github.com/apache/flink/pull/22852: Benchmark (numSubtasks) (timestampType) Mode Cnt Score Error Units WatermarkAggregationBenchmark.aggregateWatermark 5000 MONOTONE_INCREASING avgt 10 3.329 ± 0.070 ms/op WatermarkAggregationBenchmark.aggregateWatermark 5000 RANDOMIZE_MILLISECONDS avgt 10 3.541 ± 0.048 ms/op WatermarkAggregationBenchmark.aggregateWatermark 10000 MONOTONE_INCREASING avgt 10 7.345 ± 0.228 ms/op WatermarkAggregationBenchmark.aggregateWatermark 10000 RANDOMIZE_MILLISECONDS avgt 10 7.620 ± 0.385 ms/op WatermarkAggregationBenchmark.aggregateWatermark 20000 MONOTONE_INCREASING avgt 10 16.059 ± 0.307 ms/op WatermarkAggregationBenchmark.aggregateWatermark 20000 RANDOMIZE_MILLISECONDS avgt 10 20.797 ± 0.818 ms/op ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
