tustvold commented on PR #5610: URL: https://github.com/apache/arrow-rs/pull/5610#issuecomment-2044682118
I believe the intention of this code is to avoid writing out data buffers that aren't referenced by any views, perhaps as a result of slicing. I think this is probably better handled as a more general "compact" operation, that also handles pruning the data buffers themselves. I believe this is tracked by https://github.com/apache/arrow-rs/issues/5513 I'm not sure whether the IPC writer should be doing anything smart here? Perhaps @alamb has thoughts on this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
