Github user aarondav commented on the pull request:
https://github.com/apache/spark/pull/116#issuecomment-38531729
That looks like a good setup. I think for now it would be ideal just to
have the intersection of the #86 options and the options currently in this PR.
The major thing is to not expose extra options that we'll need to support
later, but having fewer is OK since we can always add more functionality later.
Rather than spending time encoding all those extra options into the shell's
bash, it would be better to just have spark-shell call spark-app and possibly
blacklist some of the options that don't make sense for the shell. This will
need to wait until spark-app is finalized and in, though, which could be too
late to make the necessary updates to spark-shell for 1.0.0.
We will also need to continue supporting -c for some time for backwards
compatibility.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
