squito commented on a change in pull request #23260: [SPARK-26311][CORE] New
feature: apply custom log URL pattern for executor log URLs in SHS
URL: https://github.com/apache/spark/pull/23260#discussion_r249838692
##########
File path: docs/monitoring.md
##########
@@ -248,6 +248,27 @@ Security options for the Spark History Server are covered
more detail in the
written to disk will be re-used in the event of a history server
restart.
</td>
</tr>
+ <tr>
+ <td>spark.history.custom.executor.log.url</td>
+ <td>(none)</td>
+ <td>
+ Specifies custom spark executor log url for supporting external log
service instead of using resource managers' app log urls.
+ Spark will support some path variables via patterns which can be vary
on resource managers.
+ Please check the document for resource manager to refer which patterns
are supported.
+ <p/>
+ For now, YARN mode only supports this configuration.
+ </td>
+ </tr>
+ <tr>
+ <td>spark.history.custom.executor.log.url.applyIncompleteApplication</td>
+ <td>false</td>
+ <td>
+ Specifies whether apply custom spark executor log url to incomplete
applications as well.
Review comment:
whether to apply (missing "to")
also as above, add "Even if this is true, this still only affects the
behavior of the history server, not running spark applications."
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
