Just pulled again just in case. Verified your fix is there. $ ./bin/spark-submit --master yarn --deploy-mode client --driver-java-options "-Dfoo -Dbar" blah blah blah error: Unrecognized option '-Dbar'. run with --help for more information or --verbose for debugging output
On Wed, Apr 30, 2014 at 12:49 PM, Patrick Wendell <pwend...@gmail.com> wrote: > I added a fix for this recently and it didn't require adding -J > notation - are you trying it with this patch? > > https://issues.apache.org/jira/browse/SPARK-1654 > > ./bin/spark-shell --driver-java-options "-Dfoo=a -Dbar=b" > scala> sys.props.get("foo") > res0: Option[String] = Some(a) > scala> sys.props.get("bar") > res1: Option[String] = Some(b) > > - Patrick > > On Wed, Apr 30, 2014 at 11:29 AM, Marcelo Vanzin <van...@cloudera.com> wrote: >> Hello all, >> >> Maybe my brain is not evolved enough to be able to trace through what >> happens with command-line arguments as they're parsed through all the >> shell scripts... but I really can't figure out how to pass more than a >> single JVM option on the command line. >> >> Unless someone has an obvious workaround that I'm missing, I'd like to >> propose something that is actually pretty standard in JVM tools: using >> -J. From javac: >> >> -J<flag> Pass <flag> directly to the runtime system >> >> So "javac -J-Xmx1g" would pass "-Xmx1g" to the underlying JVM. You can >> use several of those to pass multiple options (unlike >> --driver-java-options), so it helps that it's a short syntax. >> >> Unless someone has some issue with that I'll work on a patch for it... >> (well, I'm going to do it locally for me anyway because I really can't >> figure out how to do what I want to otherwise.) >> >> >> -- >> Marcelo -- Marcelo
