[
https://issues.apache.org/jira/browse/FLUME-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hari Shreedharan updated FLUME-2265:
------------------------------------
Attachment: FLUME-2265.patch
Patch that handles this. It changes the way we handle rollInterval-based close.
Added a couple of tests to test this as well.
> Closed bucket writers should be removed from sfwriters map
> ----------------------------------------------------------
>
> Key: FLUME-2265
> URL: https://issues.apache.org/jira/browse/FLUME-2265
> Project: Flume
> Issue Type: Bug
> Reporter: Hari Shreedharan
> Assignee: Hari Shreedharan
> Attachments: FLUME-2265.patch
>
>
> If we don't remove the bucket writer from the map, the reference is kept in
> the map and not removed till the maxOpenFiles limit is hit, even though the
> bucket writer is closed. This leads to HDFS buffers sticking around for a
> long time after the bucket writer is closed.
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)
