Github user devaraj-kavali commented on the issue:
https://github.com/apache/spark/pull/19141
Thanks @jerryshao for looking into this PR.
> Can you please describe your usage scenario and steps to reproduce your
issue, from my understanding. Did you configure your default FS to a local FS?
Yea, this can be reproduced with one node YARN cluster and LocalFileSystem
as default FS. All the spark applications fail with YARN with LocalFileSystem.
This issue can be avoided by setting any one of the spark.yarn.jars /
spark.yarn.archive configurations.
> Also looks like this is not a Spark 2.2 issue, would you please fix the
PR title be more accurate about the problem?
I have updated the PR.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
