Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22411
Since this is a new feature, we can't just merge it like #22353 without a
proper design.
Making the event logs as a structured, unified and reliable source for
Spark metrics looks like a good idea. Let's write a design doc to explain what
we already have in the event logs, and what is missing, and how to make it
reliable, and what's the issue if we read it in real time. It's better to
discuss it in the dev list and see if other people have different ideas to get
Spark metrics.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
