hasnain-db opened a new pull request, #43244:
URL: https://github.com/apache/spark/pull/43244

   ### What changes were proposed in this pull request?
   
   This PR adds helper classes for SSL RPC communication that are needed to 
work around the fact that `netty` does not support zero-copy transfers.
   
   These mirror the existing `MessageWithHeader` and `MessageEncoder` classes 
with very minor differences. But the differences were just enough that it 
didn't seem easy to refactor/consolidate, and since we don't expect these 
classes to change much I hope it's ok.
   
   ### Why are the changes needed?
   
   These are needed to support transferring `ManagedBuffer`s into a form that 
can be transferred by `netty` over the network, since netty's encryption 
support does not support zero-copy transfers.
   
   ### Does this PR introduce _any_ user-facing change?
   
   No
   
   ### How was this patch tested?
   
   Added unit tests
   
   ```
   build/sbt
   > project network-common
   > testOnly org.apache.spark.network.protocol.EncryptedMessageWithHeaderSuite
   ``` 
   
   The rest of the changes and integration were tested as part of 
https://github.com/apache/spark/pull/42685
   
   ### Was this patch authored or co-authored using generative AI tooling?
   
   No


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to