[
https://issues.apache.org/jira/browse/SPARK-35613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-35613.
-----------------------------------------
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 32754
[https://github.com/apache/spark/pull/32754]
> Cache commonly occurring strings from SQLMetrics, JsonProtocol and
> AccumulatorV2
> --------------------------------------------------------------------------------
>
> Key: SPARK-35613
> URL: https://issues.apache.org/jira/browse/SPARK-35613
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, SQL
> Affects Versions: 3.2.0
> Reporter: Venkata krishnan Sowrirajan
> Assignee: Venkata krishnan Sowrirajan
> Priority: Major
> Fix For: 3.2.0
>
>
> SQLMetrics allows creation of different metrics like sizing, timing metrics
> etc. some of those names for the metric can be duplicated and along with that
> the `Some` wrapper objects adds additional memory overhead. In our internal
> platform, this has caused huge memory usage on driver causing Full GC to kick
> in every so often.
> cc [~mridulm80]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
