attilapiros commented on issue #24011: [SPARK-27071][CORE] Expose additional metrics in status.api.v1.StageData URL: https://github.com/apache/spark/pull/24011#issuecomment-470607412 Unfortunately this change also increases the event log size meanwhile there are problems caused by the too huge event logs (think about a long running streaming app). As this metrics are available via the monitoring subsystem and can be sent to an external system I have some doubts whether this is really needed.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
