devanbenz opened a new pull request, #10136: URL: https://github.com/apache/arrow-rs/pull/10136
DRAFT This commit adds the ability for bit filtering to be done using the [`_pext_u64`](https://www.intel.com/content/www/us/en/docs/intrinsics-guide/index.html#text=_pext_u64) BMI. Right now this PR is directly copying the `bit_util.rs` code from: https://github.com/apache/arrow-rs/pull/9848/changes#diff-f2fe5b601534125d0ba033762b62db93ae2f81c71a543b6694df33773ebfa308R939-R976 -- I've just moved the `compress` function in to `arrow-buffer`. This draft PR is mostly meant to allow for me to benchmark on my ARM machine and x86_64 machine. I noticed while bench-marking on ARM that using the fall back leads to a regression when we have a very dense buffer or when we have a very sparse filter mask. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
