[ 
https://issues.apache.org/jira/browse/FLUME-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13286258#comment-13286258
 ] 

Juhani Connolly commented on FLUME-1238:
----------------------------------------

Was having a look through the code myself, but go ahead. It looks like you 
could probably add in some logic to the WriterLinkedHashMap to keep tracking of 
last access time to a bucketwriter local to one place in code. It would involve 
some threading issues that would require some care, but it looks like a 
tractable solution that doesn't add logic all over the place.
                
> Support active rolling of files created by HDFS Event Sink
> ----------------------------------------------------------
>
>                 Key: FLUME-1238
>                 URL: https://issues.apache.org/jira/browse/FLUME-1238
>             Project: Flume
>          Issue Type: Improvement
>            Reporter: Arvind Prabhakar
>            Assignee: Mike Percy
>
> The HDFS Event Sink uses lazy rolling for closing files that are being 
> written to. This results in many files being open for longer than their 
> expected roll-interval if they are not actively written to and can even last 
> in open state until the sink shuts down.
> It will be preferable to have these files roll proactively rather than 
> waiting for a write to trigger the roll. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to