[
https://issues.apache.org/jira/browse/SPARK-29097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942339#comment-16942339
]
George Papa commented on SPARK-29097:
-------------------------------------
I think that SPARK-29055 resolved the increasing of the Storage Memory, so now
I don't observe the high values of the driver memory. But, I don't know how the
fixing SPARK-29055 secures the used memory < total memory in all the times.
> Spark driver memory exceeded the storage memory
> -----------------------------------------------
>
> Key: SPARK-29097
> URL: https://issues.apache.org/jira/browse/SPARK-29097
> Project: Spark
> Issue Type: Bug
> Components: Block Manager, Spark Core, Web UI
> Affects Versions: 2.3.3, 2.4.4
> Reporter: George Papa
> Priority: Minor
>
> In Spark UI, the driver used storage memory (2.1GB) exceeds the total
> available memory (1.5GB). When I use the same application with Spark 2.1.1 I
> don't have this behavior.
>
> !https://i.stack.imgur.com/4gFYk.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
