Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/2320#issuecomment-55327730
@huozhanfeng I don't think there's any way to transfer files securely to
workers right now. Perhaps a mode where the launcher / driver uses HDFS to
distribute files instead of how it's done today, but that's a different change.
I'm really uncomfortable with this change because of the limitations of
standalone mode today. If standalone supported running executors as different
users this would be a lot more palatable.
But if this is blocking you in any way, it seems like it would be possible
to add this feature to your application without having to modify Spark, if the
security concerns are not an issue. That way you can have something working for
you and we have more time to come up with a proper solution for Spark.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
