[
https://issues.apache.org/jira/browse/IMPALA-12851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Venugopal Reddy K updated IMPALA-12851:
---------------------------------------
Description:
*Description:*
txnId to tableWriteIds map in Catalog(i.e.,
org.apache.impala.catalog.Catalog#txnToWriteIds_) is not updated in the
following cases:
# When CREATE_TABLE event is followed by ALLOC_WRITE_ID_EVENT for a table in
the same batch of MetastoreEventsProcessor.processEvents(), process
AllocWriteIdEvent do not update txnId to tableWriteIds map in catalog. It
happens, because we get table from catalog in the AllocWriteIdEvent
constructor. And catalog_.getTable() returns null as the CREATE_TABLE is not
processed by the time of AllocWriteIdEvent construction.Following events get
the catalog table in the constructors:-
## AllocWriteIdEvent,
## ReloadEvent,
## CommitCompactionEvent.
# When the table is not loaded, msTbl_ is null. process AllocWriteIdEvent
returns without updating txnId to tableWriteIds map in catalog.
was:
*Description:*
When CREATE_TABLE event is followed by ALLOC_WRITE_ID_EVENT for a table in the
same batch of MetastoreEventsProcessor.processEvents(), process
AllocWriteIdEvent do not update txnId to tableWriteIds map(i.e.,
org.apache.impala.catalog.Catalog#txnToWriteIds_).
*Root Cause:*
It happens, because we get table from catalog in the AllocWriteIdEvent
constructor. And catalog_.getTable() returns null as the CREATE_TABLE is not
processed by the time of AllocWriteIdEvent construction in this case.
Following events get the catalog table in the constructors:
AllocWriteIdEvent
ReloadEvent
CommitCompactionEvent
> Process AllocWriteIdEvent do not update txnId to tableWriteIds map in Catalog
> -----------------------------------------------------------------------------
>
> Key: IMPALA-12851
> URL: https://issues.apache.org/jira/browse/IMPALA-12851
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Reporter: Venugopal Reddy K
> Assignee: Venugopal Reddy K
> Priority: Major
>
> *Description:*
> txnId to tableWriteIds map in Catalog(i.e.,
> org.apache.impala.catalog.Catalog#txnToWriteIds_) is not updated in the
> following cases:
> # When CREATE_TABLE event is followed by ALLOC_WRITE_ID_EVENT for a table in
> the same batch of MetastoreEventsProcessor.processEvents(), process
> AllocWriteIdEvent do not update txnId to tableWriteIds map in catalog. It
> happens, because we get table from catalog in the AllocWriteIdEvent
> constructor. And catalog_.getTable() returns null as the CREATE_TABLE is not
> processed by the time of AllocWriteIdEvent construction.Following events get
> the catalog table in the constructors:-
> ## AllocWriteIdEvent,
> ## ReloadEvent,
> ## CommitCompactionEvent.
> # When the table is not loaded, msTbl_ is null. process AllocWriteIdEvent
> returns without updating txnId to tableWriteIds map in catalog.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
