tgravescs edited a comment on pull request #28788: URL: https://github.com/apache/spark/pull/28788#issuecomment-642237229
This could definitely be a breaking change. Your Hadoop deployment could include other jars that are being picked up via the class path that aren't distributed with your Spark distribution that include Hadoop. I know I saw this previous where the Hadoop configuration required certain classes and those were picked up from the cluster Hadoop class path and not distributed with spark, even though spark also had the standard Hadoop jars with it. @dhruve @redsanket ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
