Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/1699#issuecomment-50807449
I think this is a welcome change, but I don't like the
compatibility-breaking aspect of it. It shouldn't be hard to maintain the
current semantics (stop parsing SparkSubmit options when an unknown option is
found) while still adding support for "--".
It will be sub-optimal for those who run into the situation you described,
but on the other hand it won't break every single existing application out
there using spark-submit.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
