[ https://issues.apache.org/jira/browse/SPARK-4642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14230805#comment-14230805 ]
Masayoshi TSUZUKI commented on SPARK-4642: ------------------------------------------ As discussed in https://github.com/apache/spark/pull/3500, - spark.yarn.report.interval - spark.yarn.user.classpath.first - spark.yarn.scheduler.reporterThread.maxFailures are intentionally undocumented. > Documents about running-on-YARN needs update > -------------------------------------------- > > Key: SPARK-4642 > URL: https://issues.apache.org/jira/browse/SPARK-4642 > Project: Spark > Issue Type: Improvement > Components: Documentation > Affects Versions: 1.1.0 > Reporter: Masayoshi TSUZUKI > Priority: Minor > > Documents about running-on-YARN needs update > There are some parameters missing in the document about running-on-YARN page. > We need to add the descriptions about the following parameters: > - spark.yarn.report.interval > - spark.yarn.queue > - spark.yarn.user.classpath.first > - spark.yarn.scheduler.reporterThread.maxFailures > And the description about this default parameter is not strictly accurate: > - spark.yarn.submit.file.replication -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org