[
https://issues.apache.org/jira/browse/IMPALA-8633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16864211#comment-16864211
]
ASF subversion and git services commented on IMPALA-8633:
---------------------------------------------------------
Commit dec14abbd46467a73d1159508971e04da68fa508 in impala's branch
refs/heads/master from Vihang Karajgaonkar
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=dec14ab ]
IMPALA-8633 : Insert event should not error when table does not exists
When a insert event is received by the events processor it is possible
that the table has already been removed from metastore. In such cases,
the reloadTable method throws a NoSuchObjectException which is
unhandled. This causes EventProcessor to go in NEEDS_INVALIDATE state.
The patch adds exception handling for such cases so that the error can
be ignored and a warning is logged.
Ideally, if the table has been removed from metastore, this insert event
should be followed by a drop-table event and hence the table is cleaned
up from the catalog subsequently. Hence Event processor does not need to
remove the table from the catalog.
Also, the patch adds the exception trace to the error messages during
processing of Insert events to improve debugging ability in case of
such errors.
Testing:
Refactored the existing test for insert events into util methods
which can be reused for other tests. Added a new test case which
generates a insert event on a table which has been dropped. This test
reproduces the scenario seen by debugging test failures in IMPALA-8567.
The newly added test succeeds after the patch.
Change-Id: I961cd7cbede4c248dba538c7fabb4bc708e49693
Reviewed-on: http://gerrit.cloudera.org:8080/13548
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Insert event should not error when table does not exists
> --------------------------------------------------------
>
> Key: IMPALA-8633
> URL: https://issues.apache.org/jira/browse/IMPALA-8633
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Vihang Karajgaonkar
> Assignee: Vihang Karajgaonkar
> Priority: Major
>
> When a insert event is received by the events processor it is possible
> that the table has already been removed from metastore. In such cases,
> the reloadTable method throws a NoSuchObjectException which is
> unhandled. This causes EventProcessor to go in NEEDS_INVALIDATE state.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
