Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21533
I think maybe we could:
1) either ignore the files with "local" scheme, and let user to decide how
to fetch the files, like what current fix.
2) or copy the 'local' scheme files to the `SparkFiles#getRootDirectory`
both in driver and executor. The change would be in `Utils#fetchFile`.
@jiangxb1987 @vanzin what's your option?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
