[ 
https://issues.apache.org/jira/browse/FLUME-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13529204#comment-13529204
 ] 

Brock Noland commented on FLUME-1754:
-------------------------------------

Roman,

Currently if the file starts with a . the file is ignored 
(https://github.com/apache/flume/blob/trunk/flume-ng-core/src/main/java/org/apache/flume/client/avro/SpoolingFileLineReader.java#L296).
 As such, files could be copied in as `.file` and then renamed to `file`.

This implements this requested feature, correct?
                
> augment Spooling Directory Source with a filemask property
> ----------------------------------------------------------
>
>                 Key: FLUME-1754
>                 URL: https://issues.apache.org/jira/browse/FLUME-1754
>             Project: Flume
>          Issue Type: Improvement
>            Reporter: Roman Shaposhnik
>              Labels: newbie
>
> Since the contract with Spooling Directory Source is that the files that are 
> given to it are NOT supposed to be appended to, the only reliable way to 
> satisfy it right now is to have a spooling subdirectory into which real files 
> get symlinked or renamed (copying doesn't cut it since there's a race 
> condition between flume seeing the file and cp actually closing it).
> The above works, but is clunky. It would be much nicer if I can point flume 
> to a subdirectory AND also tell it to only pay attention to the files that 
> match a particular mask. This would enable me to configure my log rolling 
> system to roll to filenames that would match the mask and thus feed them to 
> flume (while still appending to the active logs)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to