liuzqt commented on PR #40629: URL: https://github.com/apache/spark/pull/40629#issuecomment-1505873421
I think inline it in TorrentBroadcast still suffer from the multiple copies issue. Need to send a id and fetch-when-needed. Might be possible to implement on TorrentBroadcast with slightly API change, but not sure whether this will add more complexity, since there are not too much that we would like to share with current TorrentBroadcast implementation -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
