dlg99 commented on issue #347: Provide a zero-copy write protocol
URL: https://github.com/apache/bookkeeper/issues/347#issuecomment-372865287
 
 
   UnsafeByteOperations helps with memory allocations (I prototyped this at 
Salesforce's internal fork and it did help).
   It does not help with zero copy. Netty added splice support 
https://github.com/netty/netty/pull/3665 and Java's NIO has 
transferTo/transferFrom that allow to bypass data copying to user space. As I 
remember, Kafka uses these.
   IIRC zero copy is impossible with protobuf as it needs to bring data to user 
space for parsing. https://github.com/google/protobuf/issues/1896
   
   Cap'n'proto or flatbuffers might work for this: 
https://capnproto.org/news/2014-06-17-capnproto-flatbuffers-sbe.html
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to