alamb commented on PR #9372: URL: https://github.com/apache/arrow-rs/pull/9372#issuecomment-5218439598
> Before we proceed to the benchmarks for the blog, should we work on some follow up Perf 🚀🚀🚀 PRs? > > I have a related PR for improving bit packing speed. I started working on it to bring it to ALP later. > > * [[Parquet] Vectorise Pack Bits within BitWriter #10432](https://github.com/apache/arrow-rs/pull/10432) Well, clearly having better performnce for the blog would be good :) But at the moment I have no idea where we stand compared to ZSTD in the rust implementation so I would probably build the benchmark scripts first and then decide if we needed to optimize more before publishing It would also be interesting to show the effect of hardware (aka can this implementaton take advantage of SIMD instructions) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
