[
https://issues.apache.org/jira/browse/SPARK-20651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-20651.
------------------------------------
Resolution: Won't Do
I've done some perf work to make sure live applications don't regress, and made
a bunch of changes that make the original code I had for this milestone
obsolete, so I removed it from my plan.
The current list of "upcoming" PRs can be seen at:
https://github.com/vanzin/spark/pulls
> Speed up the new app state listener
> -----------------------------------
>
> Key: SPARK-20651
> URL: https://issues.apache.org/jira/browse/SPARK-20651
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Affects Versions: 2.3.0
> Reporter: Marcelo Vanzin
>
> See spec in parent issue (SPARK-18085) for more details.
> This task tracks enhancements to the code added in previous tasks so that the
> new app state listener is faster; it adds a caching layer and an asynchronous
> write layer that also does deduplication, so that it avoids blocking the
> listener thread and also avoids unnecessary writes to disk.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
