Marcelo Vanzin created SPARK-20651:
--------------------------------------
Summary: Speed up the new app state listener
Key: SPARK-20651
URL: https://issues.apache.org/jira/browse/SPARK-20651
Project: Spark
Issue Type: Sub-task
Components: Spark Core
Affects Versions: 2.3.0
Reporter: Marcelo Vanzin
See spec in parent issue (SPARK-18085) for more details.
This task tracks enhancements to the code added in previous tasks so that the
new app state listener is faster; it adds a caching layer and an asynchronous
write layer that also does deduplication, so that it avoids blocking the
listener thread and also avoids unnecessary writes to disk.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
