Dandandan commented on issue #5230: URL: https://github.com/apache/arrow-datafusion/issues/5230#issuecomment-1434543277
> Having trouble getting actionable benchmark results on my laptop. Running the benchmark twice in a row on the exact same build will often have differences of 50% between the same case on each run.... Making it hard to tell if changes are actually improving anything or not 🙃. Any tips for that? I'm still kindof new to rust, never used the benchmarking stuff before... > > Other than everything is done (atleast I think so! 😅) Yeah larger inputs/longer runs help as @alamb suggests, as well as keeping your laptop connected to the charger. And make sure you run as little as possible in the background (close your IDE, browser, etc.) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
