Re: [I] perf-regression: evaluate the possibility to use async-profiler during runs [camel-quarkus]
aldettinger commented on issue #5461: URL: https://github.com/apache/camel-quarkus/issues/5461#issuecomment-1824583873 Not to forget, it would also be good if the chosen implementation could cover native mode too. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] perf-regression: evaluate the possibility to use async-profiler during runs [camel-quarkus]
franz1981 commented on issue #5461: URL: https://github.com/apache/camel-quarkus/issues/5461#issuecomment-1781500848 The problem with short duration is that you need to increase the overhead of the profiler to gather enough sample to be representative enough (eg 1K Hz) but they means increasing the overhead, on likely low powered machines. If we can assume that we care about macro effects on short running programs on CI (which means few cycles to spare) you can decide to stop at tiered 1 and just avoid the noisy attempts od C2 to compile the "hot" code, which won't likely be hot anyway, but still...if is an A/B test meant to run few times for short time, it's just important that the 2 runs run on similar conditions, and makes sense to reduce the noise due to a constrained environment, but requires some JFK eng to validate it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] perf-regression: evaluate the possibility to use async-profiler during runs [camel-quarkus]
aldettinger commented on issue #5461: URL: https://github.com/apache/camel-quarkus/issues/5461#issuecomment-1781447927 Thanks @franz1981, `--jfrsync` good to know. And well done Peter for the test setup @ppalaga. Yes, the warmup is an open question. As of now, we have caught 1 regression in Quarkus and 2 in Camels without warmup. So it does not feel that bad, probably because warmups are almost same when comparing multiple versions. There are multiple paths that can be taken, improving perf regression investigation, lowering duration, running on prs... Need a bit more thought. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] perf-regression: evaluate the possibility to use async-profiler during runs [camel-quarkus]
ppalaga commented on issue #5461: URL: https://github.com/apache/camel-quarkus/issues/5461#issuecomment-1781047059 I worked on something similar in recent days. I took @franz1981 's fabulous [quarkus-profiling-workshop](https://github.com/franz1981/quarkus-profiling-workshop) as a base. The biggest challenge for me was to overcome the unability of wrk/wrk2 to send post requests with a payload. I ended up with using hyperfoil cli and a regular hyperfoil yaml. With those two in place, I was able to attach the profiler only after the warmup was over. I unfortunately cannot share it here, because it contains some customer data. @aldettinger I see that our cq-perf-regression-scenario.hf.yaml does not have a warmup phase yet. I wonder how useful would the profiling data be without warmup? I wonder whether/how the warmup-profiling coordination could be made through Maven? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] perf-regression: evaluate the possibility to use async-profiler during runs [camel-quarkus]
franz1981 commented on issue #5461: URL: https://github.com/apache/camel-quarkus/issues/5461#issuecomment-1780813015 I suggest using jfrSync too -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org