Github user liancheng commented on the pull request:
https://github.com/apache/spark/pull/1715#issuecomment-50970982
The main point is that we need a new mode to pass user arguments
"correctly", and retain the old style for downward compatibility. At first
@pwendell suggested that we can just omit primary resource and ask user to put
it in `--jars` and/or `--py-files` in the new mode. But that means
`SparkSubmitArguments.primaryResource` can be `null`, and may potentially break
many corner cases that rely on this assumption. That is the reason I added
`--primary`: to make the new mode mutually exclusive with the old one, and at
the same time minimize the changes and the risk of breaking any corner cases.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
