Csaba Ringhofer created IMPALA-10656:
----------------------------------------

             Summary: Fire insert events before commit
                 Key: IMPALA-10656
                 URL: https://issues.apache.org/jira/browse/IMPALA-10656
             Project: IMPALA
          Issue Type: Bug
          Components: Backend, Frontend
            Reporter: Csaba Ringhofer


Currently Impala commits an insert first, then reloads the table from HMS, and 
generates the insert events based on the difference between the two snapshots. 
(e.g. which file was not present in the old snapshot but are there in the new). 
Hive replication expects the insert events before the commit, so this may 
potentially lead to issues there,

The solution is to collect the new files during the insert in the backend, and 
send the insert events based on this file set.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to