modi95 opened a new pull request #26122: [SPARK-29472][YARN] Mechanism for Excluding Jars at Launch for YARN URL: https://github.com/apache/spark/pull/26122 ### What changes were proposed in this pull request? This PR addresses https://issues.apache.org/jira/browse/SPARK-29472. It changes the part of the YARN Client class that packages the spark build's jar (in the `./jars` directory) so that these jars are conditionally added only if they do not match a certain regex. This regex can be provided by the user as `spark.yarn.jars.exclusionRegex`. ### Why are the changes needed? Explained in https://issues.apache.org/jira/browse/SPARK-29472. ### Does this PR introduce any user-facing change? This PR adds a conf to spark - `spark.yarn.jars.exclusionRegex`. No other output is changed. ### How was this patch tested? - Manual Testinng - Unit Tests - Is currently in production at Uber.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
