alamb commented on PR #7454: URL: https://github.com/apache/arrow-rs/pull/7454#issuecomment-2873667602
> > As an aside, another thing that keeps coming up in these designs is this primitive: > > > > * [Optimize take/filter from multiple input arrays to a single large output array #6692](https://github.com/apache/arrow-rs/issues/6692) > > > > It will potentially show up here again too: when we need to build up a final array after applying filters at the moment the code will be forced to do `filter` followed by `concat` > > May be we can do this also in the arrow low level. So the datafusion can benefit from? 100% I am evaluating if I should try and work on this or not. I already feel spread quite thin However, if you are going to take the lead of parquet perdicate evaluation it might be a good option for me to work on while waiting to review your pRs -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
