[
https://issues.apache.org/jira/browse/NIFI-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115227#comment-15115227
]
Richard Barnett edited comment on NIFI-1321 at 1/25/16 2:02 PM:
----------------------------------------------------------------
If there was to be an AppendLog processor, some useful features (for me :-) )
would be:
1. A rotation policy based on time or size. Automatically change to a new file
when a certain time rolls over or the file gets beyond a specified size.
2. A deletion policy that either ages out old files or limits the total number
to a certain value. Another factor might be remaining free space on the storage.
I have already implemented the first suggestion in a custom processor that
constructs the filename passed to PutFile. I am planning to add the second
suggestion either to that or as another stand-alone processor that checks the
criteria occasionally and performs the desired actions. While this is somewhat
Kafka-esque, I think it might be a great addition to NiFi.
was (Author: richards-tech):
If there was to be an AppendLog processor, some useful features (for me :-) )
would be:
1. A rotation policy based on time or size. Automatically change to a new file
when a certain time rolls over or the file gets beyond a specified size.
2. A deletion policy that either ages out old files or limits the total number
to a certain value. Another factor might be remaining free space on the storage.
I have already implemented the first suggestion in a custom processor that
constructs the filename passed to PuFile. I am planning to add the second
suggestion either to that or as another stand-alone processor that checks the
criteria occasionally and performs the desired actions. While this is somewhat
Kafka-esque, I think it might be a great addition to NiFi.
> Support appending files in PutFile
> ----------------------------------
>
> Key: NIFI-1321
> URL: https://issues.apache.org/jira/browse/NIFI-1321
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Extensions
> Affects Versions: 0.4.0
> Reporter: Scott
> Assignee: Joseph Witt
> Attachments: putfile_append.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
