mosche commented on PR #23388: URL: https://github.com/apache/beam/pull/23388#issuecomment-1263114298
@apilloud Thanks a lot! The "problem" with JMH benchmarks is that they take a massive amount of time. They are running a large number of iterations including various forks and warmups to produce a more stable and accurate number. With the current (default) JMH settings these would run for ~ 14 hours: ``` ~100 benchmarks * 5 forks * (5 warmup iterations + 5 measurement iterations) * 10 seconds ``` If using just 3 forks it's running for ~ 8.5 hours, which seems more reasonable. Later, once we have some numbers, we might be able to reduce the number of iterations slightly and see how that impacts (stability of) results. cc @lukecwik -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
