Satoshi Iijima created FLUME-2498:
-------------------------------------
Summary: Implement Taildir Source
Key: FLUME-2498
URL: https://issues.apache.org/jira/browse/FLUME-2498
Project: Flume
Issue Type: New Feature
Components: Sinks+Sources
Reporter: Satoshi Iijima
This is the proposal of implementing a new tailing source.
This source watches the specified files, and tails them in nearly real-time
once appends are detected to these files.
* This source is reliable and will not miss data even when the tailing files
rotate.
* It periodically writes the last read position of each file in a position file
using the JSON format.
* If Flume is stopped or down for some reason, it can restart tailing from the
position written on the existing position file.
* It can add event headers to each tailing file group.
A attached patch includes a config documentation of this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
