LucaCanali commented on issue #27329: [SPARK-27324][DOC][CORE] Document configurations related to executor metrics and modify a configuration. URL: https://github.com/apache/spark/pull/27329#issuecomment-580657056 Thanks @wypoon for the changes, LGTM. In case you are interested, I would like to propose a small change to monitoring.md that I think may be a good fit here as an addition/complement to the PR (or I can do a separate PR for that, if preferred). At line 643, Delete the current text and replace it with an updated one with more details: Delete: """ Metrics `peakExecutorMetrics.*` are only enabled if `spark.eventLog.logStageExecutorMetrics.enabled` is true. """ Replace with: """ Executor metric values and their measured peak values per executor are exposed via the REST API at the end point `/applications/[app-id]/executors`. In addition, aggregated per-stage peak values of the executor metrics are written to the event log if `spark.eventLog.logStageExecutorMetrics.enabled` is true. Executor metrics are also exposed via the Spark metrics system based on the Dropwizard metrics library. """
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
