tustvold commented on PR #6472: URL: https://github.com/apache/arrow-rs/pull/6472#issuecomment-2379304160
Tonic, our gRPC implementation, provides a zero-copy decode mechanism using Bytes, this internally works by taking refcounted slices of the underlying message payload. This is then fed into the IPC decoder which then constructs buffers from this, copying when necessary. This does mean that potentially some data is copied twice, once from the network socket and once into the destination buffer, but in practice some copying is unavoidable with a networked protocol and practically the network throughput will be the major bottleneck regardless. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
