Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19130#discussion_r138692611
--- Diff: docs/running-on-yarn.md ---
@@ -212,6 +212,14 @@ To use a custom metrics.properties for the application
master and executors, upd
</td>
</tr>
<tr>
+ <td><code>spark.yarn.dist.forceDownloadSchemes</code></td>
+ <td><code>(none)</code></td>
+ <td>
+ Comma-separated schemes in which remote resources have to download to
local disk and upload
--- End diff --
Better wording:
Comma-separated list of schemes for which files will be downloaded to the
local disk prior to being added to YARN's distributed cache. For use in cases
where the YARN service does not support schemes that are supported by Spark.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
