[
https://issues.apache.org/jira/browse/IMPALA-13769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Csaba Ringhofer resolved IMPALA-13769.
--------------------------------------
Fix Version/s: Impala 4.6.0
Resolution: Fixed
> Use Hive ACID metadata files when detecting base dirs created by compaction
> ----------------------------------------------------------------------------
>
> Key: IMPALA-13769
> URL: https://issues.apache.org/jira/browse/IMPALA-13769
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Csaba Ringhofer
> Priority: Major
> Labels: ACID
> Fix For: Impala 4.6.0
>
>
> Hive uses metadata files to differentiate between base dirs created by INSERT
> OVERWRITE / TRUNCATE and compacted bases created by older Hives (that did not
> use visibiliyTxnId).
> This doesn't cause issues at the moment, but once IMPALA-13759 is merged,
> Impala will treat IO/TRUNCATE base dirs differently and accept them even if
> there is an earlier open write id. I don't think that this is a significant
> problem because if Impala sees folders written by older Hive versions then
> these transactions must be already closed.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
