[
https://issues.apache.org/jira/browse/FLUME-2614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329867#comment-14329867
]
Hari Shreedharan commented on FLUME-2614:
-----------------------------------------
Do you mean that once the done flag is in the directory, you would not write
anything to that directory? What if there are late events? How do we handle
those?
> add done-flag to HDFS Sink for integration with oozie
> -----------------------------------------------------
>
> Key: FLUME-2614
> URL: https://issues.apache.org/jira/browse/FLUME-2614
> Project: Flume
> Issue Type: New Feature
> Components: Sinks+Sources
> Affects Versions: v1.6.0
> Reporter: ray
> Original Estimate: 10h
> Remaining Estimate: 10h
>
> cannot create review, the website seems not work, https://reviews.apache.org
> add new feature to create done file for HDFS Sink to denote a folder transfer
> complete for integration with oozie.
> I attached the patch.
> it need following params, the reason using timer is to create doneFlag for
> latest folder when long time no new file coming.
> hdfs.doneFlag=done (default disabled)
> hdfs.useLocalTimeStamp=true (must use local time to enable doneFlag)
> hdfs.checkFolderDoneTimerInterval=1 (timer interval(s) to check if create
> doneFlag)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
