tustvold commented on issue #1528: URL: https://github.com/apache/arrow-rs/issues/1528#issuecomment-1179567360
As stated above this isn't a bug per se, but rather that the IPC format faithfully sends the representation of the arrays over the wire - even if some portion of the values have been logically sliced away. I think some feature that truncates buffers, rewriting offsets, etc... is definitely possible as described in #208. I personally have very limited time to spend on this, but perhaps @nevi-me or @viirya might have some spare cycles? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
