[
https://issues.apache.org/jira/browse/FLUME-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14560765#comment-14560765
]
Somin Mithraa commented on FLUME-2704:
--------------------------------------
Thanks for your interest in this issue. The idea is to make the poll delay
configurable, so users can set it as per their application. If new files will
be posted only once every hour, then polling for new files twice a second can
be waste of resource and also the log file will grow large due to log message
is generated twice a second. This has nothing to do with flume seeing the file
before its written completely. For that issue we can make use of excludes in
file names. This patch is meant to enhance the configuration Flume provides now.
In my opinion, the poll delay should have been configurable in the first place.
Do you see why this isn't the case.
> Configurable poll delay for spooling directory source
> -----------------------------------------------------
>
> Key: FLUME-2704
> URL: https://issues.apache.org/jira/browse/FLUME-2704
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v1.5.2, 1.6
> Reporter: Somin Mithraa
> Priority: Minor
> Labels: SpoolDir, pollDelay, sources
> Attachments: FLUME-2704.patch
>
>
> SpoolDir source polls a directory for new files at specific interval. This
> interval(or poll delay) is currently hardcoded as 500ms.
> 500ms may be too fast for some applications. This JIRA is to make this
> property configurable.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
