LucaCanali commented on issue #24090: [SPARK-27157][DOCS] Add Executor level metrics to monitoring docs URL: https://github.com/apache/spark/pull/24090#issuecomment-472950776 This looks to me a useful addition to the monitoring documentation. An additional comment is that ProcessTree executor metrics are collected only under certain conditions. I was thinking that maybe this fact can be documented in this PR? As far as I can see the conditions are the logical AND of the folloving: /proc filesystem exists, spark.eventLog.logStageExecutorProcessTreeMetrics.enabled=true, spark.eventLog.logStageExecutorMetrics.enabled=true
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
