anjakefala opened a new pull request, #37683: URL: https://github.com/apache/arrow/pull/37683
### Rationale for this change Existing pickling serialises the whole buffer, even if the Array is sliced. ### What changes are included in this PR? Changes use Arrow's buffer truncation implemented for IPC serialization for pickling and restoring. Relies on a RecordBatch wrapper, adding ~230 bytes to the pickled payload per Array chunk. Chunks are not automatically combined pre-pickling. ### Are these changes tested? Yes ### Are there any user-facing changes? No -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
