[
https://issues.apache.org/jira/browse/IMPALA-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911973#comment-17911973
]
ASF subversion and git services commented on IMPALA-13650:
----------------------------------------------------------
Commit 46115e9a8ec1c6016cad7a1f3af7f7c260c170e3 in impala's branch
refs/heads/master from Sai Hemanth Gantasala
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=46115e9a8 ]
IMPALA-13126: Obtain table read lock in EP to process partitioned event
For a partition-level event, isOlderEvent() in catalogD needs to check
whether the corresponding partition is reloaded after the event. This
should be done after holding the table read lock. Otherwise,
EventProcessor could hit ConcurrentModificationException error when
there are concurrent DDLs/DMLs modifying the partition list.
note: Created IMPALA-13650 for a cleaner solution to clear the inflight
events list for partitioned table events.
Testing:
- Added a end-to-end stress test to verify the above scenario
Change-Id: I26933f98556736f66df986f9440ebb64be395bc1
Reviewed-on: http://gerrit.cloudera.org:8080/21663
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Inflight events may be incorrectly modified in Alter table event
> ----------------------------------------------------------------
>
> Key: IMPALA-13650
> URL: https://issues.apache.org/jira/browse/IMPALA-13650
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Sai Hemanth Gantasala
> Assignee: Sai Hemanth Gantasala
> Priority: Major
>
> This Jira originated from this review comment:
> [https://gerrit.cloudera.org/c/21663/6/fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java#1825]
> The idea is to clean up dangling self-event-related table properties by
> adding GC for InFlightEvents. When we witness an event ID or catalog version
> from an event on the table, we remove all eventIds/versions lower than that
> since they are stale.
> Need to identify if there more places where inflight events list incorrectly
> identified.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
