[
https://issues.apache.org/jira/browse/IMPALA-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on IMPALA-10656 started by Csaba Ringhofer.
------------------------------------------------
> Fire insert events before commit
> --------------------------------
>
> Key: IMPALA-10656
> URL: https://issues.apache.org/jira/browse/IMPALA-10656
> Project: IMPALA
> Issue Type: Bug
> Components: Backend, Frontend
> Reporter: Csaba Ringhofer
> Assignee: Csaba Ringhofer
> Priority: Major
>
> Currently Impala commits an insert first, then reloads the table from HMS,
> and generates the insert events based on the difference between the two
> snapshots. (e.g. which file was not present in the old snapshot but are there
> in the new). Hive replication expects the insert events before the commit, so
> this may potentially lead to issues there,
> The solution is to collect the new files during the insert in the backend,
> and send the insert events based on this file set.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
