Github user danosipov commented on the pull request:
https://github.com/apache/spark/pull/1120#issuecomment-54854888
@JoshRosen Yes, the credentials could be supplied in boto specific config
files, but if they're not there the spark_ec2 script will look in the env
variables, and error out with a message - see
https://github.com/apache/spark/blob/master/ec2/spark_ec2.py#L174
So this PR will not work for those who have the credentials in boto
configs, but at least it doesn't break anything.
As far as security, EMR uses essentially the same method for transferring
credentials to the cluster nodes, so I don't think there are any additional
concerns.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
