[
https://issues.apache.org/jira/browse/IMPALA-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Quanlong Huang updated IMPALA-13117:
------------------------------------
Epic Link: IMPALA-13915
> Improve the heap usage during metadata loading and DDL/DML executions
> ---------------------------------------------------------------------
>
> Key: IMPALA-13117
> URL: https://issues.apache.org/jira/browse/IMPALA-13117
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Critical
> Labels: catalog-2024
> Attachments: Selection_125.png
>
>
> The JVM heap size of catalogd is not just used by the metadata cache. The
> in-progress metadata loading threads and DDL/DML executions also creates temp
> objects, which introduces spikes in the heap usage. We should improve the
> heap usage in this part, especially when the metadata loading is slow due to
> external slowness (e.g. listing files on S3).
> CC [[email protected]]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
