Csaba Ringhofer created IMPALA-15118:
----------------------------------------

             Summary: IMPALA-14564
                 Key: IMPALA-15118
                 URL: https://issues.apache.org/jira/browse/IMPALA-15118
             Project: IMPALA
          Issue Type: Bug
          Components: Catalog, Frontend
            Reporter: Csaba Ringhofer


IMPALA-14564 deduplicated Iceberg partition info and individual files referred 
to their partition only with an integer. IcebergContentFileStore.partitionList_ 
is indexed with this integer to get actual partition info.

The issues is that when filling partitionList_ in 
IcebergContentFileStore.fromThrift() the byteBuffers are not copied and can 
still reference the whole Thrift binary transport buffer (this issue is 
specific to binary type in Thrift in Java). This cam almost doubles the size of 
IcebergContentFileStore.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to