bharatviswa504 commented on pull request #29030: URL: https://github.com/apache/spark/pull/29030#issuecomment-655787847
The reason for doing this is similar to the idea of spark packaging cloud connector jars, so that spark will be out of the box can work with them. (And the user does not require to copy jars to spark executor classpath) Similar support we want to add for ozone also. Right now to make spark work with ozone, we are using a --files and then running spark jobs. If spark executor has ozone jar included, we shall not require this step. Purpose of this Jira is to include an ozone file system jar in spark release tarball, in this way spark can out of box work with an ozone cluster when used with ozone paths. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
