Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/1825#issuecomment-51550144
@liancheng However that means every time we want to change a spark-submit
config, we need to change it in multiple places, which might make things harder
to maintain. For spark-shell, aren't we only expecting one type of argument?
I'm not super familiar with this functionality of passing a settings file to
spark-shell, but I don't think this file path matches `--*`, so maybe we can
filter this argument out this way. This might be simpler than enumerating all
of spark-submit's flags.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
