Re: executor failed, cannot find compute-classpath.sh

2014-01-24 Thread Imran Rashid
if I understand your issue correctly, there is an open PR to deal w/ this issue: https://github.com/apache/incubator-spark/pull/192 though I dunno if its gonna get merged or not ... On Thu, Jan 23, 2014 at 6:16 PM, kyocum wrote: > Trying to run spark-shell from my laptop to a master node in a

Re: executor failed, cannot find compute-classpath.sh

2014-01-23 Thread Matei Zaharia
Hi Ken, This is unfortunately a limitation of spark-shell and the way it works on the standalone mode. spark-shell sets an environment variable, SPARK_HOME, which tells Spark where to find its code installed on the cluster. This means that the path on your laptop must be the same as on the clus

executor failed, cannot find compute-classpath.sh

2014-01-23 Thread kyocum
Trying to run spark-shell from my laptop to a master node in a cluster. It appears that if you've installed spark at loc A on a cluster and in loc B on your local machine, the current app framework uses loc B as the path for start up. Any way to config my way around this? TIA The shell connects