alamb commented on issue #16643: URL: https://github.com/apache/datafusion/issues/16643#issuecomment-3151917340
> [@Omega359](https://github.com/Omega359) [@alamb](https://github.com/alamb) is this a known issue? It is not a known issue that I know of > The published results for `c6a.xlarge` and `c6a.2xlarge` have `null` values in some of the tests which is a sign that OOM happened during the tests. So it seems like `c6a.4xlarge` is the minimum instance type to get valid results. > > I can think of a couple of options - either datafusion will not report results for `c6a.xlarge` and `c6a.2xlarge` or we figure out a way to run successfully on the lower memory systems. Maybe there's some configuration we can try. I personally think we should run DataFusion 49 as is and generate results on all platforms (even if some of the queries OOM) and then we can file issues / fix any problems we encounter running on those platforms In other words, I think we should decouple the tasks * "figure out why DataFusion seems to be OOMing" * "run the benchmarks with DataFusion 49.0.0" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
