Hi Amal,
For yarn-cluster mode, please use the --scratch-ufo argument and point it
to a location on HDFS where you have write access to. PIO will copy the
necessary files to the HDFS location for your yarn-cluster Spark driver to
read.
Regards,
Donald
On Tuesday, October 18, 2016, amal kumar
Hi,
We are using Spark on yarn and after referring the below URL, we have been
able to submit the jobs to yarn from remote machine (i.e. PredictionIO
Server).
http://theckang.com/2015/remote-spark-jobs-on-yarn/
1. copied core-site.xml and yarn-site.xml from Yarn cluster onto remote
machine
