tgravescs commented on issue #28200: URL: https://github.com/apache/spark/pull/28200#issuecomment-618446261
I'm not sure I understand the description of the use case here, you want to point to a separate JAR directory but keep the same SPARK_CONF_DIR? I'm trying to understand why not set SPARK_HOME to a different location. note that on yarn there are other options for jars in HDFS like spark.yarn.jars and spark.yarn.archive which will be more efficient using the distributed cache. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
