((key, value) <- sysProps) {
System.setProperty(key, value)
}
Best Regards
Zhanfeng Huo
From: Akhil Das
Date: 2014-08-21 14:36
To: Darin McBeath
CC: Spark User Group
Subject: Re: How to pass env variables from master to executors within
spark-shell
One approach would be to set these environmen
One approach would be to set these environment variables inside the
spark-env.sh in all workers then you can access them using the
System.getEnv("WHATEVER")
Thanks
Best Regards
On Wed, Aug 20, 2014 at 9:49 PM, Darin McBeath
wrote:
> Can't seem to figure this out. I've tried several different
Can't seem to figure this out. I've tried several different approaches without
success. For example, I've tried setting spark.executor.extraJavaOptions in the
spark-default.conf (prior to starting the spark-shell) but this seems to have
no effect.
Outside of spark-shell (within a java applicat
