Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/1214#issuecomment-47224015
Yep it wasn't used before we added spark-submit.
I'd really like to clean up a lot of these configs/parameter passing on
yarn since its not obvious to people whats for backwards compatibility and it
seems parsing is now in a bunch of places and like this place it can set things
twice. Some of the other configs are also in their twice too.
Anyway, I'm ok with this change. +1. Thanks @kayousterhout
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
