tgravescs commented on pull request #30738: URL: https://github.com/apache/spark/pull/30738#issuecomment-745311878
I thought most of our launcher use straight java. ie Yarn, standalone, etc. They setup the env as necessary for the executor side. Generally speaking many times the env is not be the same on the executor side as the driver side as well, or the files might not be on the executor, only on the launcher. You want to use a consistent env so that is passed to the executors. So without more detail I'm against the change, but I'm not as familiar with the k8s side here so if there is something broken in the executor env can you please describe in more detail as to what is happening so we can decide on an appropriate fix. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
