This archive contains all the jars required by Spark runtime, you could zip all the jars under <SPARK-HOME>/jars and upload this archive to HDFS, then configure spark.yarn.archive with the path of this archive on HDFS.
On Sun, Aug 28, 2016 at 9:59 PM, Srikanth Sampath <ssampath.apa...@gmail.com > wrote: > Hi, > With SPARK-11157, the big fat assembly jar build was removed. > > Has anyone used spark.yarn.archive - the alternative provided and > successfully deployed Spark on a Yarn cluster. If so, what does the > archive > contain. What should be the minimal set. Any suggestion is greatly > appreciated. > > Thanks, > -Srikanth > > > > > -- > View this message in context: http://apache-spark- > developers-list.1001551.n3.nabble.com/Spark-2-0-and-Yarn-tp18748.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > >
