andygrove commented on issue #18115: URL: https://github.com/apache/datafusion/issues/18115#issuecomment-3705840574
I have been working on implementing automated benchmarks for Comet. The approach I am using does not use any ASF infrastructure or GitHub runners. It is a simple approach (IMO) of running k8s jobs that clone a particular branch, run benchmarks, then post the results in a comment on the PR. Example: https://github.com/apache/datafusion-comet/pull/2999#issuecomment-3705752192 I currently run this on a k8s cluster at my home, but this could run in the cloud if someone wanted to pay for that. I plan on restricting access to committers only. I am considering using AI to check that the PRs are not malicious. I would be happy to share the code, perhaps in the `datafusion-benchmarks` repo, if this is of interest (it was all written by Claude Code). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
