dongjoon-hyun commented on pull request #28200: URL: https://github.com/apache/spark/pull/28200#issuecomment-619619107
Thank you for updating, @marblejenka . According to the above discussion, it seems that the scope of this PR should be narrow downed. `spark-shell` is a good environment, but the majority of job submissions is `spark-submit` with `cluster` mode. And, @tgravescs pointed out, `spark.yarn.jars` and `spark.yarn.archive` is the popular way in YARN environment. Could you be more specific in the PR description about **the newly beneficial scope**? Is it beneficially only for `spark-shell`? Also, it would be great if you describe the alternatives like `spark.yarn.jars` and `spark.yarn.archive` together to be fair in the PR description. > it does not change the dependency of spark-shell process for example, so it is not sufficient for my usecase. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
