mzabaluev opened a new issue, #11983:
URL: https://github.com/apache/arrow-rs/issues/11983

   ### Is your feature request related to a problem or challenge?
   
   As illustrated by [some 
code](https://github.com/mzabaluev/arrow-rs/blob/e8ea58f49eda9dc8f31fa566dd5a76ece77cd7e4/arrow-select/src/filter.rs#L1316)
 in #11872, filter kernels for different data types consume different data 
fields of the `FilterPredicate`, meaning that both the mask and the iteration 
slices/indices have to be computed.
   
   ### Describe the solution you'd like
   
   As one idea, the filter mask should be pre-calculated optionally dependent 
on the chosen iteration strategy. If the strategy has pre-computed slices or 
indices, or it is `All` | `None`, but the filtering kernel requires the mask, 
it can be synthesized, perhaps as an iterator of indexed bit chunks to avoid 
full materialization.
   
   ### Describe alternatives you've considered
   
   _No response_
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to