Sverre Bakke created FLUME-2584:
-----------------------------------
Summary: Need graceful shutdown of HDFSEventSink
Key: FLUME-2584
URL: https://issues.apache.org/jira/browse/FLUME-2584
Project: Flume
Issue Type: Bug
Components: Sinks+Sources
Affects Versions: v1.5.1
Environment: Tested with Flume 1.5.0 and 1.5.2 on Redhat 6.
Reporter: Sverre Bakke
Priority: Minor
When pressing ctrl+c (or otherwise signal to kill the flume process), the HDFS
sink seems to have issues dealing with interruption. 100% of the times I do
this I get the following errors back:
2015-01-05 11:16:52,448 (SinkRunner-PollingRunner-DefaultSinkProcessor) [WARN -
org.apache.flume.sink.hdfs.BucketWriter.callWithTimeout(BucketWriter.java:752)]
Unexpected Exception null
java.lang.InterruptedException
at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:400)
at java.util.concurrent.FutureTask.get(FutureTask.java:199)
at
org.apache.flume.sink.hdfs.BucketWriter.callWithTimeout(BucketWriter.java:725)
at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:262)
at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:554)
at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:426)
at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:745)
2015-01-05 11:16:52,451 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR
- org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:467)]
proc ess failed
java.lang.RuntimeException: java.lang.InterruptedException
at com.google.common.base.Throwables.propagate(Throwables.java:156)
at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:291)
at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:554)
at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:426)
at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.InterruptedException
at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:400)
at java.util.concurrent.FutureTask.get(FutureTask.java:199)
at
org.apache.flume.sink.hdfs.BucketWriter.callWithTimeout(BucketWriter.java:725)
at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:262)
... 5 more
2015-01-05 11:16:52,452 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR
- org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:160)] Unable to
deliver event. Exception follows.
org.apache.flume.EventDeliveryException: java.lang.RuntimeException:
java.lang.InterruptedException
at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:471)
at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.InterruptedException
at com.google.common.base.Throwables.propagate(Throwables.java:156)
at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:291)
at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:554)
at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:426)
... 3 more
Caused by: java.lang.InterruptedException
at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:400)
at java.util.concurrent.FutureTask.get(FutureTask.java:199)
at
org.apache.flume.sink.hdfs.BucketWriter.callWithTimeout(BucketWriter.java:725)
at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:262)
... 5 more
or
2015-01-05 11:20:34,706 (agent-shutdown-hook) [DEBUG -
org.apache.flume.SinkRunner.stop(SinkRunner.java:104)] Waiting for runner
thread to exit
2015-01-05 11:20:34,709 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR
- org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:467)]
process failed
java.lang.InterruptedException: Timed out before HDFS call was made. Your
hdfs.callTimeout might be set too low or HDFS calls are taking too long.
at
org.apache.flume.sink.hdfs.BucketWriter.checkAndThrowInterruptedException(BucketWriter.java:699)
at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:523)
at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:426)
at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:745)
2015-01-05 11:20:34,711 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR
- org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:160)] Unable to
deliver event. Exception follows.
org.apache.flume.EventDeliveryException: java.lang.InterruptedException: Timed
out before HDFS call was made. Your hdfs.callTimeout might be set too low or
HDFS calls are taking too long.
at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:471)
at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.InterruptedException: Timed out before HDFS call was made.
Your hdfs.callTimeout might be set too low or HDFS calls are taking too long.
at
org.apache.flume.sink.hdfs.BucketWriter.checkAndThrowInterruptedException(BucketWriter.java:699)
at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:523)
at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:426)
... 3 more
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
