jhorstmann commented on issue #7739: URL: https://github.com/apache/arrow-rs/issues/7739#issuecomment-3005971721
Slight addition to that calculation, if there is already a bitpacked run that can be continued, then adding 8 bits consumes only a single byte as bitpacked, but 2 bytes as rle. Adding 16 bits would consume 2 bytes independent of encoding. So for a bit width of 1, I think increasing the minimum rle length to 16 could be beneficial. Unfortunately I was not yet able to put that logic into code without breaking any tests 😅 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
