[
https://issues.apache.org/jira/browse/NIFI-994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980981#comment-14980981
]
Mark Payne commented on NIFI-994:
---------------------------------
[~jskora] - the algorithm implemented uses the lastModifiedTime and the length
of the file in addition to the checksum, so there is no need to re-read the
whole file. It would re-read one file only when the processor is stopped and
restarted (or nifi is restarted). I'm OK with the cost of re-reading a file
when the user stops/starts the processor or when NiFi is restarted. Certainly
if we had to continually read from the start, I would not use that type of
approach.
> Processor to tail files
> -----------------------
>
> Key: NIFI-994
> URL: https://issues.apache.org/jira/browse/NIFI-994
> Project: Apache NiFi
> Issue Type: New Feature
> Affects Versions: 0.4.0
> Reporter: Joseph Percivall
> Assignee: Mark Payne
> Fix For: 0.4.0
>
> Attachments: 0001-NIFI-994-Initial-import-of-TailFile.patch,
> 0002-NIFI-994-Ensure-that-processor-is-not-valid-due-to-t.patch
>
>
> It's a very common data ingest situation to want to input text into the
> system by "tailing" a file, most commonly log files. Currently we don't have
> an easy way to do this.
> A simple processor to tail a file would benefit many users. There would need
> to be an option to not just tail a file but pick up where the processor left
> off if it is interrupted.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
