[ 
https://issues.apache.org/jira/browse/FLUME-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700823#comment-14700823
 ] 

Hudson commented on FLUME-2498:
-------------------------------

SUCCESS: Integrated in Flume-trunk-hbase-1 #119 (See 
[https://builds.apache.org/job/Flume-trunk-hbase-1/119/])
FLUME-2498.  Implement Taildir Source (roshan: 
http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=757a560db73c2e6fbec56deea4c753a45ccf9032)
* 
flume-ng-sources/flume-taildir-source/src/test/java/org/apache/flume/source/taildir/TestTaildirEventReader.java
* pom.xml
* 
flume-ng-configuration/src/main/java/org/apache/flume/conf/source/SourceConfiguration.java
* 
flume-ng-sources/flume-taildir-source/src/test/java/org/apache/flume/source/taildir/TestTaildirSource.java
* 
flume-ng-sources/flume-taildir-source/src/main/java/org/apache/flume/source/taildir/ReliableTaildirEventReader.java
* 
flume-ng-sources/flume-taildir-source/src/main/java/org/apache/flume/source/taildir/TaildirSource.java
* 
flume-ng-configuration/src/main/java/org/apache/flume/conf/source/SourceType.java
* flume-ng-sources/flume-taildir-source/pom.xml
* 
flume-ng-sources/flume-taildir-source/src/main/java/org/apache/flume/source/taildir/TaildirSourceConfigurationConstants.java
* flume-ng-dist/pom.xml
* 
flume-ng-sources/flume-taildir-source/src/main/java/org/apache/flume/source/taildir/TailFile.java
* flume-ng-sources/pom.xml
* flume-ng-doc/sphinx/FlumeUserGuide.rst


> Implement Taildir Source
> ------------------------
>
>                 Key: FLUME-2498
>                 URL: https://issues.apache.org/jira/browse/FLUME-2498
>             Project: Flume
>          Issue Type: New Feature
>          Components: Sinks+Sources
>            Reporter: Satoshi Iijima
>             Fix For: v1.7.0
>
>         Attachments: FLUME-2498-2.patch, FLUME-2498-3.patch, 
> FLUME-2498-4.patch, FLUME-2498-5.patch, FLUME-2498.patch
>
>
> This is the proposal of implementing a new tailing source.
> This source watches the specified files, and tails them in nearly real-time 
> once appends are detected to these files.
> * This source is reliable and will not miss data even when the tailing files 
> rotate.
> * It periodically writes the last read position of each file in a position 
> file using the JSON format.
> * If Flume is stopped or down for some reason, it can restart tailing from 
> the position written on the existing position file.
> * It can add event headers to each tailing file group. 
> A attached patch includes a config documentation of this.
> This source requires Unix-style file system and Java 1.7 or later.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to