alamb commented on issue #18115: URL: https://github.com/apache/datafusion/issues/18115#issuecomment-3703729598
> For `cargo bench` with criterion https://codspeed.io/ is very convenient: it instruments the benchmarks in Github CI using Valgrind and tracks changes in a nice UI. Happy to do a setup MR if useful. I have also heard good things about codspeed and would love to try it possible. Some potential issues: 1. We don't have direct access to github admin capabilities (ASF infra does) so if we need to authorize apps etc that can be a non trivial process 2. There are many benchmarks for DataFusion and effectively analyzing them is the hardest part If you want to try something out, I recommend starting with one benchmark, for example sql_planner ```shell cargo bench --bench sql_planner ``` And seeing how that goes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
