Zhongwei Zhu created SPARK-43399:
------------------------------------
Summary: Add config to control threshold of unregister map output
when fetch failed
Key: SPARK-43399
URL: https://issues.apache.org/jira/browse/SPARK-43399
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.4.0
Reporter: Zhongwei Zhu
Spark will unregister map output on the executor when fetch failed from this
executor. This might be too aggressive when fetch failed is temporary and
recoverable. So adding the config to control the number of fetch failed
failures needed to unregister map output and allow to disable unregister.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
