[
https://issues.apache.org/jira/browse/FLUME-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13479599#comment-13479599
]
Hari Shreedharan commented on FLUME-1660:
-----------------------------------------
Juhani,
I must admit I did not follow much of the discussion that happened on
FLUME-1350 - and now there is too much to read. Why can't we really use the
rollInterval for this? Once the rollInterval passes, don't we close the file? I
am just concerned that we really end up having multiple configs which do almost
the same thing. Or is this so that we can keep the rollInterval separate from
the interval to consider a directory as "no longer written to?"
> Close "idle" hdfs handles
> -------------------------
>
> Key: FLUME-1660
> URL: https://issues.apache.org/jira/browse/FLUME-1660
> Project: Flume
> Issue Type: Improvement
> Affects Versions: v1.4.0
> Reporter: Juhani Connolly
> Assignee: Juhani Connolly
> Priority: Minor
> Fix For: v1.4.0
>
>
> When hdfs paths are date dependent, many handles can get left open for a long
> time without anything happening to them.
> Idea here is to watch the last update of each bucketWriter, and track idle
> writers, closing them once they pass a configured timeout
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
