[ 
https://issues.apache.org/jira/browse/FLUME-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14295859#comment-14295859
 ] 

ASF subversion and git services commented on FLUME-2586:
--------------------------------------------------------

Commit 0d6eccad2781884fe0f000f74b8f964cbdd7971f in flume's branch 
refs/heads/trunk from [~hshreedharan]
[ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=0d6ecca ]

FLUME-2586. HDFS Sink must try to rename files even if close fails.

(Johny Rufus via Hari)


> HDFS Sink should have an option to try rename even if close fails
> -----------------------------------------------------------------
>
>                 Key: FLUME-2586
>                 URL: https://issues.apache.org/jira/browse/FLUME-2586
>             Project: Flume
>          Issue Type: Bug
>            Reporter: Johny Rufus
>            Assignee: Johny Rufus
>             Fix For: v1.6.0
>
>         Attachments: FLUME-2586.patch
>
>
> "The issue is that the file close fails, but the stream on the Flume side is 
> considered closed by HDFS. So retrying the close, is failing - which causes 
> the rename never to be attempted. Since the rename is never attempted the 
> file sticks around with the ".tmp" file name. "
> We should add a parameter "renameIfCloseFails", that will attempt rename even 
> if the close fails and possibly log information that the user need to run 
> lease recovery



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to