RE: Unable to load additional JARs in yarn-client mode

2013-12-24 Thread Karavany, Ido
ymond [mailto:raymond@intel.com] Sent: Tuesday, December 24, 2013 07:53 To: user@spark.incubator.apache.org Subject: RE: Unable to load additional JARs in yarn-client mode Ido, when you say add external JARS, do you mean by -addJars which adding some jar for SparkContext to use in the AM env? If

RE: Unable to load additional JARs in yarn-client mode

2013-12-23 Thread Liu, Raymond
esday, December 24, 2013 1:17 PM To: user@spark.incubator.apache.org Subject: Re: Unable to load additional JARs in yarn-client mode I'm surprised by this, but one way that will definitely work is to assemble your application into a single JAR. If passing them to the constructor doesn'

Re: Unable to load additional JARs in yarn-client mode

2013-12-23 Thread Matei Zaharia
I’m surprised by this, but one way that will definitely work is to assemble your application into a single JAR. If passing them to the constructor doesn’t work, that’s probably a bug. Matei On Dec 23, 2013, at 12:03 PM, Karavany, Ido wrote: > Hi All, > > For our application we need to use t

Unable to load additional JARs in yarn-client mode

2013-12-23 Thread Karavany, Ido
Hi All, For our application we need to use the yarn-client mode featured in 0.8.1. (Yarn 2.0.5) We've successfully executed it both yarn-client and yarn-standalone with our java applications. While in yarn-standalone there is a way to add external JARs - we couldn't find a way to add those in