RE: Problem submitting a spark job using yarn-client as master

Sent: Tuesday, November 15, 2016 9:27 PM To: David Robison <david.robi...@psgglobal.net> Cc: user@spark.apache.org Subject: Re: Problem submitting a spark job using yarn-client as master you can set hdfs as defaults, sparksession.sparkContext().hadoopConfiguration().set("fs.defaultFS&

Re: Problem submitting a spark job using yarn-client as master

you can set hdfs as defaults, sparksession.sparkContext().hadoopConfiguration().set("fs.defaultFS", “hdfs://master_node:8020”); Regards Rohit On Nov 16, 2016, at 3:15 AM, David Robison > wrote: I am trying to submit a spark job