holdenk commented on pull request #32397: URL: https://github.com/apache/spark/pull/32397#issuecomment-867892496
Ah wait now I'm remembering, we serve the files from the driver to the workers. So yeah the design makes more sense than I thought originally. +1 on more testing though. We could add a package and then try and load it in the Kube integration tests if doing the manual deps testing is too complicated? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
