[ 
https://issues.apache.org/jira/browse/FLUME-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14295860#comment-14295860
 ] 

ASF subversion and git services commented on FLUME-2586:
--------------------------------------------------------

Commit 13a03003e7c1817d73451d3b6b1a58250c9469bd in flume's branch 
refs/heads/flume-1.6 from [~hshreedharan]
[ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=13a0300 ]

FLUME-2586. HDFS Sink must try to rename files even if close fails.

(Johny Rufus via Hari)


> HDFS Sink should have an option to try rename even if close fails
> -----------------------------------------------------------------
>
>                 Key: FLUME-2586
>                 URL: https://issues.apache.org/jira/browse/FLUME-2586
>             Project: Flume
>          Issue Type: Bug
>            Reporter: Johny Rufus
>            Assignee: Johny Rufus
>             Fix For: v1.6.0
>
>         Attachments: FLUME-2586.patch
>
>
> "The issue is that the file close fails, but the stream on the Flume side is 
> considered closed by HDFS. So retrying the close, is failing - which causes 
> the rename never to be attempted. Since the rename is never attempted the 
> file sticks around with the ".tmp" file name. "
> We should add a parameter "renameIfCloseFails", that will attempt rename even 
> if the close fails and possibly log information that the user need to run 
> lease recovery



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to