Thomas Graves created SPARK-25995:
-------------------------------------
Summary: sparkR should ensure user args are after the argument
used for the port
Key: SPARK-25995
URL: https://issues.apache.org/jira/browse/SPARK-25995
Project: Spark
Issue Type: Bug
Components: SparkR
Affects Versions: 2.3.2
Reporter: Thomas Graves
Currently if you run sparkR and accidentally specify an argument, it fails with
a useless error message. For example:
$SPARK_HOME/bin/sparkR --master yarn --deploy-mode client fooarg
This gets turned into:
Launching java with spark-submit command spark-submit "--master" "yarn"
"--deploy-mode" "client" "sparkr-shell" "fooarg"
/tmp/Rtmp6XBGz2/backend_port162806ea36bca
Notice that "fooarg" got put before /tmp file which is how R and jvm know which
port to connect to. SparkR eventually fails with timeout exception after 10
seconds.
SparkR should either not allow args or make sure the order is correct so the
backend_port is always first. see
https://github.com/apache/spark/blob/master/R/pkg/R/sparkR.R#L129
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
