[
https://issues.apache.org/jira/browse/SPARK-15967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Umesh K updated SPARK-15967:
----------------------------
Description: As of Spark 1.6.x we have unified memory management and hence
execution/storage memory changes over time for e.g. if execution grows it will
take memory from storage and vice-versa. But if we see Spark UI it shows one
storage value all the time in storage tab like it used to in previous version
<=1.5.2. Ideally storage memory values should get refreshed to show real time
value of storage memory in the Spark UI so we can actually visualize that
stealing between execution and storage is happening. (was: As of Spark 1.6.x
we have unified memory management and hence execution/storage memory changes
over time for e.g. if execution grows it will take memory from storage and
vice-versa. But if we Spark UI shows one value all the time in storage tab like
it used to in previous version. Ideally storage memory values should get
refreshed to show real time value of storage memory in the Spark UI so we can
actually visualize that stealing between execution and storage is happening.)
> Spark UI should show realtime value of storage memory instead of showing one
> static value all the time
> ------------------------------------------------------------------------------------------------------
>
> Key: SPARK-15967
> URL: https://issues.apache.org/jira/browse/SPARK-15967
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Affects Versions: 1.6.0, 1.6.1
> Reporter: Umesh K
> Priority: Minor
>
> As of Spark 1.6.x we have unified memory management and hence
> execution/storage memory changes over time for e.g. if execution grows it
> will take memory from storage and vice-versa. But if we see Spark UI it shows
> one storage value all the time in storage tab like it used to in previous
> version <=1.5.2. Ideally storage memory values should get refreshed to show
> real time value of storage memory in the Spark UI so we can actually
> visualize that stealing between execution and storage is happening.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
