thisisnic commented on issue #46681:
URL: https://github.com/apache/arrow/issues/46681#issuecomment-3027003040
> the filter(col %in% c("x", "y") does not leverage partitions
What makes you say this? Is it performance speed specifically?
Would you mind trying to see if you get any differences with Arrow 17.0.0?
There's a bug (#46777) in versions 18.0.0 onwards that we're fixing at the
moment which affects filtering with `%in%` and so if you're finding slower
performance, it might be that. Let me know how you get on and if it's not
that, we can try other options.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
