Hello Zoltan Borok-Nagy, Noemi Pap-Takacs, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/24177
to look at the new patch set (#3).
Change subject: WIP IMPALA-14806: Cache IcebergContentFileStore
......................................................................
WIP IMPALA-14806: Cache IcebergContentFileStore
This change was split out from larger change
https://gerrit.cloudera.org/#/c/24049/
It also affects
https://gerrit.cloudera.org/#/c/24091/
With this patch Iceberg file descriptors are cached in
IcebergFileContentStore instead of TPartialTableInfo.
TPartialInfo is still cached without files but doesn't
seem to have significant size..
Based on experiments this both makes mem need smaller and
planning much faster by not needing to convert TPartialTableInfo
to IcebergFileContentStore in each query.
TODO: measure again, numbers look a bit different than in
https://gerrit.cloudera.org/#/c/24049/
Change-Id: Ic93eeb3a90a280a7138672affd71ac6f87df71a1
---
M fe/src/main/java/org/apache/impala/catalog/FeIcebergTable.java
M fe/src/main/java/org/apache/impala/catalog/IcebergContentFileStore.java
M fe/src/main/java/org/apache/impala/catalog/IcebergTable.java
M fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java
M fe/src/main/java/org/apache/impala/catalog/local/DirectMetaProvider.java
M fe/src/main/java/org/apache/impala/catalog/local/IcebergMetaProvider.java
M fe/src/main/java/org/apache/impala/catalog/local/LocalIcebergTable.java
M fe/src/main/java/org/apache/impala/catalog/local/MetaProvider.java
M fe/src/main/java/org/apache/impala/catalog/local/MetaProviderDecorator.java
M fe/src/main/java/org/apache/impala/catalog/local/MultiMetaProvider.java
M fe/src/test/java/org/apache/impala/catalog/local/LocalCatalogTest.java
M
fe/src/test/java/org/apache/impala/catalog/local/MetaProviderDecoratorTest.java
12 files changed, 204 insertions(+), 41 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/77/24177/3
--
To view, visit http://gerrit.cloudera.org:8080/24177
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ic93eeb3a90a280a7138672affd71ac6f87df71a1
Gerrit-Change-Number: 24177
Gerrit-PatchSet: 3
Gerrit-Owner: Csaba Ringhofer <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Noemi Pap-Takacs <[email protected]>
Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
