There is a pull request currently to fix this exact issue, I believe, at
https://github.com/apache/incubator-spark/pull/192. It's very small and
only touches the script files, so you could apply it to your current
version and distribute it to the workers. The fix here is that you add an
additional variable in spark-env that specifies the REMOTE_SPARK_HOME.


On Mon, Nov 25, 2013 at 3:40 AM, Grega Kešpret <[email protected]> wrote:

> It seems there is already an open ticket for this -
> https://spark-project.atlassian.net/browse/SPARK-905 , but for version
> 0.7.3.
>
> Grega
> --
> [image: Inline image 1]
> *Grega Kešpret*
> Analytics engineer
>
> Celtra — Rich Media Mobile Advertising
> celtra.com <http://www.celtra.com/> | 
> @celtramobile<http://www.twitter.com/celtramobile>
>
>
> On Mon, Nov 25, 2013 at 12:13 PM, Grega Kešpret <[email protected]> wrote:
>
>> Sorry, forgot to mention, I run spark version "v0.8.0-incubating" from
>> https://github.com/apache/incubator-spark.git.
>> It seems to work when local Spark directory is also /opt/spark, so I
>> think this confirms my doubt that SPARK_HOME somehow doesn't get passed to
>> the Executor?
>>
>> Grega
>> --
>> [image: Inline image 1]
>> *Grega Kešpret*
>> Analytics engineer
>>
>> Celtra — Rich Media Mobile Advertising
>> celtra.com <http://www.celtra.com/> | 
>> @celtramobile<http://www.twitter.com/celtramobile>
>>
>
>

<<celtra_logo.png>>

Reply via email to