dawidwys commented on pull request #34: URL: https://github.com/apache/flink-benchmarks/pull/34#issuecomment-939759529
I don't know what could be a good measure of stability. The results from a couple of local runs of the `UNALIGNED` test: ``` Benchmark (mode) Mode Cnt Score Error Units CheckpointingTimeBenchmark.checkpointSingleInput UNALIGNED thrpt 30 328.864 ± 20.784 ops/s Benchmark (mode) Mode Cnt Score Error Units CheckpointingTimeBenchmark.checkpointSingleInput UNALIGNED thrpt 30 336.844 ± 20.871 ops/s Benchmark (mode) Mode Cnt Score Error Units CheckpointingTimeBenchmark.checkpointSingleInput UNALIGNED thrpt 30 325.180 ± 17.333 ops/s Benchmark (mode) Mode Cnt Score Error Units CheckpointingTimeBenchmark.checkpointSingleInput UNALIGNED thrpt 30 341.993 ± 14.929 ops/s Benchmark (mode) Mode Cnt Score Error Units CheckpointingTimeBenchmark.checkpointSingleInput UNALIGNED thrpt 30 338.299 ± 17.544 ops/s ``` The std dev decreased to ~5-6% -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
