Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/969#issuecomment-46052446
@tgravescs thanks for clarifying. I should have read the most recent patch
- I still had the original one in my head, which did a lot of things that
didn't need to be done. My bad there.
You're right, setting that in the conf file doesn't work. (It would be nice
to have the PR title and description reflect the actual issue.)
Also, perhaps this is a good chance to get rid of `spark.yarn.dist.files`
and use `spark.files` like the others? It doesn't seem like it was documented,
and if there's a need to keep backwards compatibility, that can be done in the
yarn code; that means one less custom OptionAssigner for Yarn in SparkSubmit.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
