dbtsai edited a comment on pull request #28376: URL: https://github.com/apache/spark/pull/28376#issuecomment-620738022
@tgravescs the standard "with hadoop" Spark built with Yarn is sufficient to work in our CDH env. Thanks for the review. I'll update the doc and config.md. @viirya the idea of this PR is isolate the classpath in cluster from the Spark distribution, so when Spark runs in the Yarn clusters, the deps from Yarn will not be added. Thus, users don't need to pay attention on dep issue since Spark distribution is the only source of the classpath. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
