Marton Bod created HIVE-24629:
---------------------------------

             Summary: Invoke optional output committer in TezProcessor
                 Key: HIVE-24629
                 URL: https://issues.apache.org/jira/browse/HIVE-24629
             Project: Hive
          Issue Type: Improvement
            Reporter: Marton Bod
            Assignee: Marton Bod


In order to enable Hive to write to Iceberg tables, we need to use an output 
committer which will fire at the end of each Tez task execution (commitTask) 
and the after the execution of each vertex (commitOutput/commitJob). This 
output committer will issue a commit containing the written-out data files to 
the Iceberg table, replacing its previous snapshot pointer with a new one.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to