Csaba Ringhofer has uploaded this change for review. (
http://gerrit.cloudera.org:8080/24523
Change subject: POC/slop: decrease mem overhead of IcebergContentFileStore
......................................................................
POC/slop: decrease mem overhead of IcebergContentFileStore
Tested with Iceberg table with ~1M files, 25K partititons.
mem need on coordinntor decreased around 10%:
389MB->350MB
Main changes with estimated saved bytes:
- IcebergContentFileStore:
- removed EncodedFileDescriptor and store desc +
metadata as a single array (~48 byte)
Change-Id: Ic44ffa6011b0c7eaeac23a64bd763266a3cfdb30
Assisted-by: Claude Sonnet 4.6
---
M fe/src/main/java/org/apache/impala/catalog/FileDescriptor.java
M fe/src/main/java/org/apache/impala/catalog/IcebergContentFileStore.java
M fe/src/main/java/org/apache/impala/catalog/IcebergFileDescriptor.java
3 files changed, 56 insertions(+), 45 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/23/24523/3
--
To view, visit http://gerrit.cloudera.org:8080/24523
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ic44ffa6011b0c7eaeac23a64bd763266a3cfdb30
Gerrit-Change-Number: 24523
Gerrit-PatchSet: 3
Gerrit-Owner: Csaba Ringhofer <[email protected]>
