Hello, We would like to contribute a new tailing source to the Apache Flume community. We have operated it in production for 1 month and there is no technical problem for now.
This source is below: --- Taildir source watches the specified files, and tails them in nearly real-time once appends are detected to these files. This source is reliable and will not miss data even when the tailing files rotate. It periodically writes the last read position, inode and absolute path of each file in a position file using the JSON format. --- If Flume is stopped or down for some reason, it can restart tailing from the position written in the position file. This source is very convenient for tailing files and recovering form the system failures such as the Flume process dying.. But it requires Unix-style file system and Java 1.7 or later because it uses inode to identify files. Can we contribute it to the Apache Flume community? If acceptable I will attach the patch of it in JIRA. Thank you, -Satoshi iijima
