[
https://issues.apache.org/jira/browse/IMPALA-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403332#comment-17403332
]
Vihang Karajgaonkar commented on IMPALA-9057:
---------------------------------------------
Just to update the latest here, I found that HMS has new a API which was
introduced in https://issues.apache.org/jira/browse/HIVE-25137 which gives the
clients the ability to fetch the WriteId information given the commit
transaction id. Using this API we can enhance the MetastoreEventsProcessor to
fetch ACID_WRITE events from HMS and refresh the ACID tables, when commit
transaction event is received. This should fix the race condition described
above.
I will see if we can bump up the GBN which includes the new HMS API.
> TestEventProcessing.test_insert_events_transactional is flaky
> -------------------------------------------------------------
>
> Key: IMPALA-9057
> URL: https://issues.apache.org/jira/browse/IMPALA-9057
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Affects Versions: Impala 3.4.0
> Reporter: Alice Fan
> Assignee: Vihang Karajgaonkar
> Priority: Blocker
> Labels: build-failure, flaky
>
> Assertion failure for
> custom_cluster.test_event_processing.TestEventProcessing.test_insert_events_transactional
>
> {code:java}
> Error Message
> assert ['101', 'x', ..., '3', '2019'] == ['101', 'z', '28', '3', '2019'] At
> index 1 diff: 'x' != 'z' Full diff: - ['101', 'x', '28', '3', '2019'] ?
> ^ + ['101', 'z', '28', '3', '2019'] ? ^
> Stacktrace
> custom_cluster/test_event_processing.py:49: in
> test_insert_events_transactional
> self.run_test_insert_events(is_transactional=True)
> custom_cluster/test_event_processing.py:131: in run_test_insert_events
> assert data.split('\t') == ['101', 'z', '28', '3', '2019']
> E assert ['101', 'x', ..., '3', '2019'] == ['101', 'z', '28', '3', '2019']
> E At index 1 diff: 'x' != 'z'
> E Full diff:
> E - ['101', 'x', '28', '3', '2019']
> E ? ^
> E + ['101', 'z', '28', '3', '2019']
> E ? ^
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
