gaogaotiantian commented on PR #59019: URL: https://github.com/apache/spark/pull/59019#issuecomment-5823387249
This is significantly more complicated than my original thought. The new thing should just replace the old "multi-int" protocol. This should be simple and quick, no version because for now we always sync between the executor and the worker. This should be a relatively simple change - just replace the old multi int with a json string and parse it on the scala side - then report the same data after parsing. The only thing changed for the first PR is just how they pass data around. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
