mbutrovich commented on PR #3243: URL: https://github.com/apache/datafusion-comet/pull/3243#issuecomment-3786629293
Upon thinking about this more, I don't think this is a huge win for executor memory pressure, maybe driver side. I suspect we'll need to do more work to figure out how to not serialize every partitions' FileScanTasks in the Comet native plan. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
