ozgrakkurt commented on issue #4213: URL: https://github.com/apache/arrow-rs/issues/4213#issuecomment-1599377512
@tustvold added benchmark against `parquet2` implementation [on the repo](https://github.com/ozgrakkurt/sbbf-rs) can you run it if you have time? I ran it on an aarch64 cpu and these are the results I get: ``` INSERT parquet2 -> 76 ns sbbf-rs -> 3.5ns CONTAINS (this seems to be dominated by hashing time and dynamic dispatch in sbbf-rs, also seems like the compiler optimizes the code in parquet2 pretty well) parquet2 -> 3.4 ns sbbf-rs -> 2.8 ns CONTAINS (without hashing and dynamic-dispatch in sbbf-rs, requires modifying library a little specifically for aarch64 since all aarch64 cpus support `neon` SIMD instructions, don't want to release with this optimization since not sure if it is worth complicating the code) parquet2 -> 1.9 ns sbbf-rs -> 500 ps ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
