jhorstmann commented on issue #1799: URL: https://github.com/apache/arrow-rs/issues/1799#issuecomment-1148353286
I like it! One additional idea would be to change the layout of Boolean to use a Bitmap instead of Buffer: ``` pub enum ArrayDataLayout { Boolean { values: Bitmap }, ... ``` If the Bitmap itself then stores a bit offset, we could remove the offset from ArrayData. Slicing of Bitmap would then always be zero-copy and slicing an array would push down the slicing into the validity buffer and layout. This could in theory lead to a situation where you have different bit offsets for validity and data in a BooleanArray. Probably not a problem for any compute kernels, but could require copying in the FFI layer. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org