[
https://issues.apache.org/jira/browse/FLUME-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14172294#comment-14172294
]
Satoshi Iijima commented on FLUME-2498:
---------------------------------------
I have added 'Windows support' and 'Minimum Java version' to the above links.
I think it is possible to support Windows because Windows has file ID instead
of inode.
If someone attaches a patch in which this source can run under Windows from
now, then I think it is good, although I do not have Windows environment.
'Pollable' means that the source implements PollableSource or that it continues
to process if tailing files was entirely consumed.
'Append header' means that the source can append headers to the events.
When the source tails multiple files, it is useful to be able to append headers
to events of each file such as Spooling Directory source.
> Implement Taildir Source
> ------------------------
>
> Key: FLUME-2498
> URL: https://issues.apache.org/jira/browse/FLUME-2498
> Project: Flume
> Issue Type: New Feature
> Components: Sinks+Sources
> Reporter: Satoshi Iijima
> Attachments: FLUME-2498.patch
>
>
> This is the proposal of implementing a new tailing source.
> This source watches the specified files, and tails them in nearly real-time
> once appends are detected to these files.
> * This source is reliable and will not miss data even when the tailing files
> rotate.
> * It periodically writes the last read position of each file in a position
> file using the JSON format.
> * If Flume is stopped or down for some reason, it can restart tailing from
> the position written on the existing position file.
> * It can add event headers to each tailing file group.
> A attached patch includes a config documentation of this.
> This source requires Unix-style file system and Java 1.7 or later.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
