Dandandan commented on PR #19761: URL: https://github.com/apache/datafusion/pull/19761#issuecomment-3742557698
Thanks for the explanations! * It might make sense to not have a buffer limit per partition, but on a `BufferExec` level? E.g. a 16MB limit instead of 16 * 1MB * I am also wondering in the presence of limits / early exits, more "eager" evaluation might do some high amount of work loading probe sides not needed in the end, perhaps we can detect this and not apply `BufferExec` in those cases? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
