[
https://issues.apache.org/jira/browse/NIFI-919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739107#comment-14739107
]
Bryan Bende commented on NIFI-919:
----------------------------------
For the extract path scenario, this may not be typical, but could we also
extract paths from a datafile with one record in it? Essentially the output of
SplitAvro with Output Size = 1 and Output Type = Datafile.
The extract processor would just have to do something in the case where the
datafile has more than one record, likely route to a failure with a
corresponding error message.
Regardless of the how extract scenario works, I am happy to keep or remove the
warning based on what everyone thinks makes sense with regards to how people
use bare records.
> Support Splitting Avro Files
> ----------------------------
>
> Key: NIFI-919
> URL: https://issues.apache.org/jira/browse/NIFI-919
> Project: Apache NiFi
> Issue Type: New Feature
> Reporter: Bryan Bende
> Assignee: Bryan Bende
> Priority: Minor
> Fix For: 0.4.0
>
> Attachments: NIFI-919-2.patch, NIFI-919.patch
>
>
> Provide a processor that splits an Avro file into multiple smaller files.
> Would be nice to have a configurable batch size so a user could produce
> single record files and also multi-record files of smaller size than the
> original. Also consider making the output format configurable, data file vs
> bare record.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
