[
https://issues.apache.org/jira/browse/HIVE-29853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raghav Aggarwal updated HIVE-29853:
-----------------------------------
Description:
When Hive checks if an Iceberg table needs to be compacted, it calls a method
named *addFiles().* Because this method is mistakenly called twice—once in the
constructor and again in *isEligibleForCompaction()* — every single file and
byte in the table gets counted twice in memory.
was:
When Hive checks if an Iceberg table needs to be compacted, it calls a method
named
*addFiles().* Because this method is mistakenly called twice—once in the
constructor and again in *isEligibleForCompaction()* — every single file and
byte in the table gets counted twice in memory.
> Iceberg CompactionEvaluator double-counts input files
> -----------------------------------------------------
>
> Key: HIVE-29853
> URL: https://issues.apache.org/jira/browse/HIVE-29853
> Project: Hive
> Issue Type: Bug
> Reporter: Raghav Aggarwal
> Assignee: Raghav Aggarwal
> Priority: Major
>
> When Hive checks if an Iceberg table needs to be compacted, it calls a method
> named *addFiles().* Because this method is mistakenly called twice—once in
> the constructor and again in *isEligibleForCompaction()* — every single file
> and byte in the table gets counted twice in memory.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
