Rich-T-kid opened a new issue, #11060:
URL: https://github.com/apache/arrow-rs/issues/11060
When filtering arrays with a null bitmap, the current implementation walks
the bitmap one bit at a time, one byte load and branch per row. For
mid-selectivity filters (~50% kept) this loop dominates `filter_bits`. we
should replace it with a word-level approach that reduces the null bitmap pass
from `O(selected_count)` byte loads to `O(filter_len/64)` u64 loads.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]