[
https://issues.apache.org/jira/browse/NIFI-919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14731397#comment-14731397
]
Ryan Blue commented on NIFI-919:
--------------------------------
I think it makes sense to support bare record output because other systems use
it. We support Flume, for example, and a few Flume sinks use bare Avro record
payloads with headers to set the schema fingerprint, url, or literal.
I don't see a need to support the JSON encoding, at least as output. It is
needlessly expensive and is mostly used so that you can read the encoded
payload by viewing the file. Adequate tooling can avoid the need.
> Support Splitting Avro Files
> ----------------------------
>
> Key: NIFI-919
> URL: https://issues.apache.org/jira/browse/NIFI-919
> Project: Apache NiFi
> Issue Type: New Feature
> Reporter: Bryan Bende
> Assignee: Bryan Bende
> Priority: Minor
> Fix For: 0.4.0
>
>
> Provide a processor that splits an Avro file into multiple smaller files.
> Would be nice to have a configurable batch size so a user could produce
> single record files and also multi-record files of smaller size than the
> original. Also consider making the output format configurable, data file vs
> bare record.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)