[
https://issues.apache.org/jira/browse/FLUME-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13855648#comment-13855648
]
Hudson commented on FLUME-2265:
-------------------------------
SUCCESS: Integrated in flume-trunk #533 (See
[https://builds.apache.org/job/flume-trunk/533/])
FLUME-2265. Closed bucket writers should be removed from sfwriters map (jarcec:
http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=3b1034e8229eb9ad3e27ed0faab77c3f68f708c6)
*
flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/HDFSEventSink.java
*
flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/BucketClosedException.java
*
flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestBucketWriter.java
*
flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/HDFSTestWriterFactory.java
*
flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/HDFSBadWriterFactory.java
*
flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSink.java
*
flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/HDFSBadSeqWriter.java
*
flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/BucketWriter.java
*
flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/HDFSTestSeqWriter.java
> Closed bucket writers should be removed from sfwriters map
> ----------------------------------------------------------
>
> Key: FLUME-2265
> URL: https://issues.apache.org/jira/browse/FLUME-2265
> Project: Flume
> Issue Type: Bug
> Reporter: Hari Shreedharan
> Assignee: Hari Shreedharan
> Fix For: v1.5.0
>
> Attachments: FLUME-2265.patch
>
>
> If we don't remove the bucket writer from the map, the reference is kept in
> the map and not removed till the maxOpenFiles limit is hit, even though the
> bucket writer is closed. This leads to HDFS buffers sticking around for a
> long time after the bucket writer is closed.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
