alamb commented on PR #1499: URL: https://github.com/apache/arrow-rs/pull/1499#issuecomment-1096945799
> Longer term I'd like to experiment with removing the offset from ArrayData and see if slicing could be implemented in general with a method like this.For the validity, an offset could be introduced in Bitmap so it can be sliced without copying. The open problem is then the BooleanArray, which would ideally need to contain a Bitmap instead of a Buffer for it's data which could be sliced zero-copy. But there is no way to store this data bitmap in ArrayData. I think removing the explicit `offset` in the ArrayData would make a significant improvement. As you mention, however, BooleanArray / Bitmaps would end up being copied without more thought -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
