[
https://issues.apache.org/jira/browse/IMPALA-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703598#comment-17703598
]
ASF subversion and git services commented on IMPALA-12002:
----------------------------------------------------------
Commit 5607fba4ff8b2a7bd789cb5dd873ff0ff3f3ad3c in impala's branch
refs/heads/master from Sai Hemanth Gantasala
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=5607fba4f ]
IMPALA-12002: COMMIT_COMPACTION_EVENT should silently fail if the db
is not found
In the test runs, it is found that event processor is stopped when
processing a commit compaction event due to database being droppped.
Instead of stopping the event processor, it is enough to throw a warn
message and skip the commit compaction event.
Change-Id: I543abc596efa710f903b2e20d6a8ed73a8d5a315
Reviewed-on: http://gerrit.cloudera.org:8080/19625
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> COMMIT_COMPACTION_EVENT are not correctly skipped if the db not found
> ---------------------------------------------------------------------
>
> Key: IMPALA-12002
> URL: https://issues.apache.org/jira/browse/IMPALA-12002
> Project: IMPALA
> Issue Type: Bug
> Reporter: Quanlong Huang
> Assignee: Sai Hemanth Gantasala
> Priority: Blocker
>
> I saw event-processor is stopped due to an error in a CORE build:
> https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/18906/
> {code}
> I0313 02:30:30.313375 30039 MetastoreEventsProcessor.java:805] Received 8
> events. Start event id : 26504
> I0313 02:30:30.313757 30039 MetastoreEventsProcessor.java:1026] Time elapsed
> in processing event batch: 283.896us
> E0313 02:30:30.313935 30039 MetastoreEventsProcessor.java:865] Unexpected
> exception received while processing event
> Java exception follows:
> org.apache.impala.catalog.events.MetastoreNotificationException: EventId:
> 26506 EventType: COMMIT_COMPACTION_EVENT Unable to parse commit compaction
> message
> at
> org.apache.impala.catalog.events.MetastoreEvents$CommitCompactionEvent.<init>(MetastoreEvents.java:2684)
> at
> org.apache.impala.catalog.events.MetastoreEvents$MetastoreEventFactory.get(MetastoreEvents.java:223)
> at
> org.apache.impala.catalog.events.MetastoreEvents$MetastoreEventFactory.getFilteredEvents(MetastoreEvents.java:255)
> at
> org.apache.impala.catalog.events.MetastoreEventsProcessor.processEvents(MetastoreEventsProcessor.java:999)
> at
> org.apache.impala.catalog.events.MetastoreEventsProcessor.processEvents(MetastoreEventsProcessor.java:851)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.impala.catalog.DatabaseNotFoundException: Database
> 'test_acid_compaction_5c682e9f' not found
> at org.apache.impala.catalog.Catalog.getTable(Catalog.java:196)
> at
> org.apache.impala.catalog.events.MetastoreEvents$CommitCompactionEvent.<init>(MetastoreEvents.java:2679)
> ... 11 more
> E0313 02:30:30.314000 30039 MetastoreEventsProcessor.java:1040] Notification
> event is null
> W0313 02:30:31.314235 30039 MetastoreEventsProcessor.java:844] Event
> processing is skipped since status is ERROR. Last synced event id is 26504
> {code}
> "test_acid_compaction_5c682e9f" is a temp db created by tests. It's already
> dropped when catalogd received the commit compaction event. The exception is
> thrown from the constructor of CommitCompactionEvent. We should skip the
> event instead of let it fails the event-processor.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
