Thanks a lot, Marcelo!! It did the work. :)
Regards,
Arjun
From: Marcelo Vanzin
Sent: Friday, June 15, 2018 2:07 AM
To: Arjun kr
Cc: user@spark.apache.org
Subject: Re: Spark user classpath setting
I only know of a way to do that with YARN.
You can distribute
I only know of a way to do that with YARN.
You can distribute the jar files using "--files" and add just their
names (not the full path) to the "extraClassPath" configs. You don't
need "userClassPathFirst" in that case.
On Thu, Jun 14, 2018 at 1:28 PM, Arjun kr wrote:
> Hi All,
>
>
> I am
Hi All,
I am trying to execute a sample spark script ( that use spark jdbc ) which has
dependencies on a set of custom jars. These custom jars need to be added first
in the classpath. Currently, I have copied custom lib directory to all the
nodes and able to execute it with below command.
