Re: hadoop_conf_dir when running spark on yarn

2014-11-03 Thread Amey Chaugule
I'm using org.apache.spark.deploy.yarn.Client object to run my spark job. I guess this is what spark-submit wraps really. - Amey On Mon, Nov 3, 2014 at 5:25 PM, Tobias Pfeiffer wrote: > Hi, > > On Mon, Nov 3, 2014 at 1:29 PM, Amey Chaugule wrote: > >> I thought that o

Re: hadoop_conf_dir when running spark on yarn

2014-11-02 Thread Amey Chaugule
I thought that only applied when you're trying to run a job using spark-submit or in the shell... On Sun, Nov 2, 2014 at 8:47 AM, Akhil Das wrote: > You can set HADOOP_CONF_DIR inside the spark-env.sh file > > Thanks > Best Regards > > On Sat, Nov 1, 2014 at 4:14 AM, ameyc wrote: > >> How do i