[
https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shahid K I updated SPARK-23134:
-------------------------------
Environment:
Run Cache command with below configuration to cache the RDD blocks
spark.dynamicAllocation.cachedExecutorIdleTimeout=120s
spark.dynamicAllocation.executorIdleTimeout=60s
spark.dynamicAllocation.enabled=true
spark.dynamicAllocation.minExecutors=0
spark.dynamicAllocation.maxExecutors=8
was:
Run Cache command with below configuration to cache the RDD blocks
````
spark.dynamicAllocation.cachedExecutorIdleTimeout=120s
spark.dynamicAllocation.executorIdleTimeout=60s
spark.dynamicAllocation.enabled=true
spark.dynamicAllocation.minExecutors=0
spark.dynamicAllocation.maxExecutors=8
````
> WebUI is showing the cache table details even after cache idle timeout
> ----------------------------------------------------------------------
>
> Key: SPARK-23134
> URL: https://issues.apache.org/jira/browse/SPARK-23134
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 2.1.0, 2.2.0, 2.2.1
> Environment: Run Cache command with below configuration to cache the
> RDD blocks
> spark.dynamicAllocation.cachedExecutorIdleTimeout=120s
> spark.dynamicAllocation.executorIdleTimeout=60s
> spark.dynamicAllocation.enabled=true
> spark.dynamicAllocation.minExecutors=0
> spark.dynamicAllocation.maxExecutors=8
>
>
>
> Reporter: Shahid K I
> Priority: Major
>
> After cachedExecutorIdleTimeout, WebUI shows the cached partition details in
> storage tab. It should be the same scenario as in the case of uncache table.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
