RE: SparkR Error in sparkR.init(master=“local”) in RStudio

It seems the problem is with creating Usage: RBackend From: Sun, Rui [mailto:rui@intel.com] Sent: Wednesday, October 07, 2015 10:23 PM To: Khandeshi, Ami; Hossein Cc: akhandeshi; user@spark.apache.org Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio Can you extract

RE: SparkR Error in sparkR.init(master=“local”) in RStudio

; user@spark.apache.org<mailto:user@spark.apache.org> Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio Tried, multiple permutation of setting home… Still same issue > Sys.setenv(SPARK_HOME="c:\\DevTools\\spark-1.5.1") > .libPaths(c(file.path(Sys.getenv("

RE: SparkR Error in sparkR.init(master=“local”) in RStudio

m] Sent: Wednesday, October 07, 2015 2:35 AM To: Hossein; Khandeshi, Ami Cc: akhandeshi; user@spark.apache.org<mailto:user@spark.apache.org> Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio Not sure "/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" is a valid? From: Hos

RE: SparkR Error in sparkR.init(master=“local”) in RStudio

Not sure "/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" is a valid? From: Hossein [mailto:fal...@gmail.com] Sent: Wednesday, October 7, 2015 12:46 AM To: Khandeshi, Ami Cc: Sun, Rui; akhandeshi; user@spark.apache.org Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio

RE: SparkR Error in sparkR.init(master=“local”) in RStudio

Cc: Sun, Rui; akhandeshi; user@spark.apache.org<mailto:user@spark.apache.org> Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio Have you built the Spark jars? Can you run the Spark Scala shell? --Hossein On Tuesday, October 6, 2015, Khandeshi, Ami <ami.khande...

Re: SparkR Error in sparkR.init(master=“local”) in RStudio

Is it possible that your user does not have permission to write temp file? On Tue, Oct 6, 2015 at 10:26 AM -0700, "akhandeshi" wrote: It seems it is failing at path <- tempfile(pattern = "backend_port") I do not see backend_port directory created... -- View

RE: SparkR Error in sparkR.init(master=“local”) in RStudio

9\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391' had status 127 -Original Message- From: Sun, Rui [mailto:rui@intel.com] Sent: Tuesday, October 06, 2015 9:39 AM To: akhandeshi; user@spark.apache.org Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio What

Re: SparkR Error in sparkR.init(master=“local”) in RStudio

I couldn't get this working... I have have JAVA_HOME set. I have defined SPARK_HOME Sys.setenv(SPARK_HOME="c:\DevTools\spark-1.5.1") .libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths())) library("SparkR", lib.loc="c:\\DevTools\\spark-1.5.1\\lib") library(SparkR)

RE: SparkR Error in sparkR.init(master=“local”) in RStudio

d any hint in the console output -Original Message- From: akhandeshi [mailto:ami.khande...@gmail.com] Sent: Tuesday, October 6, 2015 8:21 PM To: user@spark.apache.org Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio I couldn't get this working... I have have JAVA_HOME s

Re: SparkR Error in sparkR.init(master=“local”) in RStudio

t; > -Original Message- > From: Sun, Rui [mailto:rui@intel.com <javascript:;>] > Sent: Tuesday, October 06, 2015 9:39 AM > To: akhandeshi; user@spark.apache.org <javascript:;> > Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio > >

Re: SparkR Error in sparkR.init(master=“local”) in RStudio

It seems it is failing at path <- tempfile(pattern = "backend_port") I do not see backend_port directory created... -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24958.html Sent from the

Re: SparkR Error in sparkR.init(master=“local”) in RStudio

Hello Rui Sun, Thanks for your reply. On reading the file readme.md in the section Using SparkR from RStudio it mentions to set the .libPaths(c(file.path(Sys.getenv(SPARK_HOME), R, lib), .libPaths())) Please tell me how I can set this in Windows environment? What I mean is how to setup

Re: SparkR Error in sparkR.init(master=“local”) in RStudio

Hi, Try this Sys.setenv(SPARK_HOME=C:\\spark-1.4.0) # The path to your spark installation .libPaths(c(file.path(Sys.getenv(SPARK_HOME), R, lib), .libPaths())) library(SparkR, lib.loc=C:\\spark-1.4.0\\lib) # The path to the lib folder in the spark location library(SparkR)

RE: SparkR Error in sparkR.init(master=“local”) in RStudio

Hi, Kachau, If you are using SparkR with RStudio, have you followed the guidelines in the section Using SparkR from RStudio in https://github.com/apache/spark/tree/master/R ? From: kachau [umesh.ka...@gmail.com] Sent: Saturday, July 11, 2015 12:30 AM