[
https://issues.apache.org/jira/browse/SPARK-4642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14230805#comment-14230805
]
Masayoshi TSUZUKI commented on SPARK-4642:
------------------------------------------
As discussed in https://github.com/apache/spark/pull/3500,
- spark.yarn.report.interval
- spark.yarn.user.classpath.first
- spark.yarn.scheduler.reporterThread.maxFailures
are intentionally undocumented.
> Documents about running-on-YARN needs update
> --------------------------------------------
>
> Key: SPARK-4642
> URL: https://issues.apache.org/jira/browse/SPARK-4642
> Project: Spark
> Issue Type: Improvement
> Components: Documentation
> Affects Versions: 1.1.0
> Reporter: Masayoshi TSUZUKI
> Priority: Minor
>
> Documents about running-on-YARN needs update
> There are some parameters missing in the document about running-on-YARN page.
> We need to add the descriptions about the following parameters:
> - spark.yarn.report.interval
> - spark.yarn.queue
> - spark.yarn.user.classpath.first
> - spark.yarn.scheduler.reporterThread.maxFailures
> And the description about this default parameter is not strictly accurate:
> - spark.yarn.submit.file.replication
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
