dungdm93 commented on pull request #30738: URL: https://github.com/apache/spark/pull/30738#issuecomment-745734958
@tgravescs I understand that env could be passed to driver & executors in k8s. But the main focus of this change is supporting pre-start hooks. For example, in our in-house DWH system, we have a s3-compatible service with self-signed certificate. So custom CA need to be imported into both driver & executor pods. After some short of research, we decided to wrote a scrip like `keytool -import ...` in `spark-env.sh`, then mounted it into spark pods. Then this time I realize that spark driver load that script, but spark executors are not, this is because spark executor use straight java. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
