[
https://issues.apache.org/jira/browse/ATLAS-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16127514#comment-16127514
]
Ashutosh Mestry commented on ATLAS-2047:
----------------------------------------
CC: [~nixonrodrigues]
CC: [~madhan.neethiraj]
> NotificationHookConsumer: Exception Thrown by Kafka Consumer Ends up Filling
> Logs Due to Incorrect Handling
> ------------------------------------------------------------------------------------------------------------
>
> Key: ATLAS-2047
> URL: https://issues.apache.org/jira/browse/ATLAS-2047
> Project: Atlas
> Issue Type: Bug
> Components: atlas-core
> Affects Versions: trunk, 0.8-incubating
> Reporter: Ashutosh Mestry
> Assignee: Ashutosh Mestry
> Fix For: trunk
>
> Attachments: ATLAS-2047-HookConsumer-ExceptionHandling.patch
>
>
> *Background*
> _KafkaConsumer_ is abstracted by _AtlasKafkaConsumer_. This is run using
> _HookConsumer_ which is derived from _kafka.utils.ShutdownableThread_.
> The _ShutdownableThread_ manages the thread. It handles exceptions thrown in
> the _doWork_ method and logs them.
> *Problem*
> Exception reported in the bug is thrown by _KafkaConsumer_ is handed by
> _HookConsumer_. Exception is logged but the thread keeps running. In cases
> where Kafa is in irrecoverable state, this behavior ends up filling up logs
> and providing no value in return.
> *Solution*
> Let _ShutdownableThread_ hand exceptions thrown by _KafkaConsumer_. Stop the
> thread if _KafkaConsumer_ suffers from irrecoverable error. This will avoid
> the situation described in the problem section.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
