Github user shivaram commented on a diff in the pull request:
https://github.com/apache/spark/pull/6743#discussion_r32375062
--- Diff: R/install-dev.bat ---
@@ -25,3 +25,8 @@ set SPARK_HOME=%~dp0..
MKDIR %SPARK_HOME%\R\lib
R.exe CMD INSTALL --library="%SPARK_HOME%\R\lib" %SPARK_HOME%\R\pkg\
+
+REM Zip the SparkR package so that it can be distributed to worker nodes
on YARN
+pushd %SPARK_HOME%\R\lib
+jar cfM "%SPARK_HOME%\R\lib\sparkr.zip" SparkR
--- End diff --
@sun-rui -- this should be `jar.exe` instead of `jar`. The other thing is
that `jar.exe` is only available in the JDK and not in the JAR version. So
sometimes this may not be in the `PATH`. There are a couple of options for
things we can do here
1. We can use `%JAVA_HOME%\bin\jar.exe` -- This might be more safer as
users need to set JAVA_HOME for the compilation to work correctly
2. Rtools [1] by default installs a zip utility [2] as `zip.exe`. At least
on my machine running `zip.exe -r sparkr.zip SparkR` seems to work.
[1] http://cran.r-project.org/bin/windows/Rtools/
[2] http://www.info-zip.org/
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
