alamb commented on issue #16206: URL: https://github.com/apache/datafusion/issues/16206#issuecomment-2922383864
I have noticed something similar -- that the pattern of "take / concat" results in potentially non trival overhead. I have been recently working on some related code (the same basic pattern happens for `filter`) Related: - https://github.com/apache/arrow-rs/issues/6692 - https://github.com/apache/arrow-rs/pull/7513 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
