[
https://issues.apache.org/jira/browse/FLUME-2564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
waynewan updated FLUME-2564:
----------------------------
Attachment: FLUME-2564.patch
> Failover processor does not kick-in for HDFS sink on IOException
> ----------------------------------------------------------------
>
> Key: FLUME-2564
> URL: https://issues.apache.org/jira/browse/FLUME-2564
> Project: Flume
> Issue Type: Bug
> Affects Versions: v1.5.2
> Reporter: Arvind Prabhakar
> Assignee: Arvind Prabhakar
> Labels: easyfix
> Attachments: FLUME-2564.patch
>
>
> From a recent thread on the user mailing list:
> {quote}
> I have investigated the HDFSEventSink source code, found if the exception
> was IOException , the exception would not throw to the upper layer,
> So FailOverSinkProcessor would not mark this sink as dead.
> {quote}
> {code}
> ....
> } catch (IOException eIO) {
> transaction.rollback();
> LOG.warn("HDFS IO error", eIO);
> return Status.BACKOFF;
> } catch (Throwable th) {
> transaction.rollback();
> LOG.error("process failed", th);
> if (th instanceof Error) {
> throw (Error) th;
> } else {
> throw new EventDeliveryException(th);
> }
> }
> ....
> {code}
> The failover processor should be able to use the backoff signal as indication
> of failure and switch over to the next sink.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
