kyprifog edited a comment on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-749289466
~@jahstreet Pulling in my comment from here: https://github.com/JahstreetOrg/spark-on-kubernetes-helm/issues/54 It seems like that spark submit in spark 3.0 is the one responsible for managing the forwarding of AWS keys so I think that maybe this is getting missed in this corresponding livy implementation. I'm going to dig deeper and confirm/ make the appropriate fix.~ Scratch that, this actually works how I would expect using spark conf. Will look into ENV variable AWS config later, but not high priority, and out of scope for incubator-livy. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
