Marcelo Masiero Vanzin created SPARK-29766:
----------------------------------------------
Summary: Aggregate metrics asynchronously in SQL listener
Key: SPARK-29766
URL: https://issues.apache.org/jira/browse/SPARK-29766
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.4.4
Reporter: Marcelo Masiero Vanzin
This is a follow up to SPARK-29562.
That change made metrics collection faster, and also sped up metrics
aggregation. But it is still too slow to execute in an event handler, so we
should do it asynchronously to minimize events being dropped by the listener
bus.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
