[
https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Parth Gandhi updated SPARK-21888:
---------------------------------
Description: While running Spark on Yarn in cluster mode, currently there
is no way to add any config files, jars etc. to Client classpath. An example
for this is that suppose you want to run an application that uses hbase. Then,
unless and until we do not copy the necessary config files required by hbase to
Spark Config folder, we cannot specify or set their exact locations in
classpath on Client end which we could do so earlier by setting the environment
variable "SPARK_CLASSPATH". (was: While running Spark on Yarn in cluster mode,
currently there is no way to add any config files, jars etc. to Client
classpath. An example for this is that suppose you want to run an application
that uses hbase. Then, unless and until we do not copy the necessary config
files required by hbase to Spark Config folder, we cannot specify or set their
exact locations in classpath on Client end which we could do earlier by setting
the environment variable "SPARK_CLASSPATH".)
> Cannot add stuff to Client Classpath for Yarn Cluster Mode
> ----------------------------------------------------------
>
> Key: SPARK-21888
> URL: https://issues.apache.org/jira/browse/SPARK-21888
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.2.0
> Reporter: Parth Gandhi
> Priority: Minor
>
> While running Spark on Yarn in cluster mode, currently there is no way to add
> any config files, jars etc. to Client classpath. An example for this is that
> suppose you want to run an application that uses hbase. Then, unless and
> until we do not copy the necessary config files required by hbase to Spark
> Config folder, we cannot specify or set their exact locations in classpath on
> Client end which we could do so earlier by setting the environment variable
> "SPARK_CLASSPATH".
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
