SongYadong created SPARK-26698:
----------------------------------
Summary: Use ConfigEntry for hardcoded configs for memory and
storage categories
Key: SPARK-26698
URL: https://issues.apache.org/jira/browse/SPARK-26698
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.0.0
Reporter: SongYadong
Some of following memory and storage related configs are still hardcoded, We
try to use ConfigEntry and put them in the config package :
spark.storage.cleanupFilesAfterExecutorExit
spark.diskStore.subDirectories
spark.block.failures.beforeLocationRefresh
spark.storage.unrollMemoryThreshold
spark.storage.memoryMapThreshold
spark.memory.storageFraction
spark.memory.offHeap.enabled
spark.memory.offHeap.size
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
