Dmitriy Fingerman created HIVE-28344:
----------------------------------------

             Summary: Iceberg: Use binpack to rewrite files
                 Key: HIVE-28344
                 URL: https://issues.apache.org/jira/browse/HIVE-28344
             Project: Hive
          Issue Type: Task
          Components: Hive, Iceberg integration
         Environment: Use binpack strategy to rewrite files: they group small 
data files so that 1 group of small files will be rewritten to 1 big data file. 
1 group = 1 commit, and every commit is validated separately.  If a conflict 
occurs in case of some, they can be omitted and the others can still be 
committed in the transaction, no need to revert all the changes.
            Reporter: Dmitriy Fingerman
            Assignee: Dmitriy Fingerman






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to