[
https://issues.apache.org/jira/browse/FLUME-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13845648#comment-13845648
]
Hari Shreedharan commented on FLUME-2265:
-----------------------------------------
Idle close does remove the reference to the bucket writer from the map. But
when a normal file roll occurs - say once every 10 mins or so (and idle is not
configured), then the references will remain in the map. If the user does not
set idle timeout, then this leads to a leak of the handle until maxOpenFiles is
reached. Of course, this is fixed if idleTimeout is set, but we should also
handle the case where it is not.
> Closed bucket writers should be removed from sfwriters map
> ----------------------------------------------------------
>
> Key: FLUME-2265
> URL: https://issues.apache.org/jira/browse/FLUME-2265
> Project: Flume
> Issue Type: Bug
> Reporter: Hari Shreedharan
> Assignee: Hari Shreedharan
>
> If we don't remove the bucket writer from the map, the reference is kept in
> the map and not removed till the maxOpenFiles limit is hit, even though the
> bucket writer is closed. This leads to HDFS buffers sticking around for a
> long time after the bucket writer is closed.
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)
