mapleFU commented on issue #33683:
URL: https://github.com/apache/arrow/issues/33683#issuecomment-1603908169
I've two problem about this:
First, I found it a bit hard to implement it using current framework. Our
input is an expression tree, bloom filter can transform:
* `("eq", field_ref, exact_value)`
* `("is_in", field_ref, exact_values...)`
To an "false" in row-group expressions. So I need to:
1. match these expressions
2. If I found we can turn them to false, transform it.
Can you help me what expression handling method can I use?
Second, `ParquetFileFragment::Subset` should ensure metadata already in, so
maybe I should add an options, and load all bloomfilter in memory. I guess I
would be time-consuming. Should I load them all at first, or loading them by
requirement?
@westonpace .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
