alamb commented on PR #11267: URL: https://github.com/apache/arrow-rs/pull/11267#issuecomment-6088019819
All right, let's merge this one in and then we can deal with the pain / sharding thing as we try to gather benchmark numbers for other PRs. > My :2c: is that the missing piece is some configuration in this repo declaring that, for example, the arrow_writer suite needs at least 4 shards to finish within the 2h deadline. As of right now you must specify it on each and every invocation. In my mind the problem isn't just parallel execution of the benchmarks, it is also being able to sift through the data that comes back. Maybe with LLMs now it isn't as hard to review and verify the benchmark data -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
