GitHub user sun-rui opened a pull request:
https://github.com/apache/spark/pull/9179
[SPARK-10971][SPARKR] RRunner should allow setting path to Rscript.
Add a new spark conf option "spark.sparkr.r.driver.command" to specify the
executable for an R script in client modes.
The existing spark conf option "spark.sparkr.r.command" is used to specify
the executable for an R script in cluster modes for both driver and workers.
See also [launch R worker
script](https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/api/r/RRDD.scala#L395).
BTW, [envrionment variable
"SPARKR_DRIVER_R"](https://github.com/apache/spark/blob/master/launcher/src/main/java/org/apache/spark/launcher/SparkSubmitCommandBuilder.java#L275)
is used to locate R shell on the local host.
For your information, PYSPARK has two environment variables serving simliar
purpose:
PYSPARK_PYTHON Python binary executable to use for PySpark in
both driver and workers (default is `python`).
PYSPARK_DRIVER_PYTHON Python binary executable to use for PySpark in
driver only (default is PYSPARK_PYTHON).
pySpark use the code
[here](https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/PythonRunner.scala#L41)
to determine the python executable for a python script.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sun-rui/spark SPARK-10971
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9179.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9179
----
commit 3de695cc265b6362200fa191c6394f6d77823163
Author: Sun Rui <[email protected]>
Date: 2015-10-20T11:21:20Z
[SPARK-10971][SPARKR] RRunner should allow setting path to Rscript.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
