[
https://issues.apache.org/jira/browse/NIFI-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994865#comment-15994865
]
Jonas Hartwig commented on NIFI-3759:
-------------------------------------
Thanks [~joewitt] for your explanation. Our use case is as follows: we get
events from kafka which go into elastic search and hdfs. Elastic will undergo
frequent cleanup keep the index clean and fast. Hdfs should be used as an
archive. But we dont want lots of small files, rather one accumulated file per
month level. We decided to store the events in avro files. Hence we need an
avro append into hdfs.
Would it make sense to put this into nifi as well like parquet put?
regards
> Enable Avro append for Put HDFS
> -------------------------------
>
> Key: NIFI-3759
> URL: https://issues.apache.org/jira/browse/NIFI-3759
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Core Framework
> Affects Versions: 1.1.0, 1.1.1
> Reporter: Jonas Hartwig
> Priority: Minor
>
> It would be nice where Nifi already supports working with AVRO to enable hdfs
> append working correctly with avro files coming from MergeContent processor.
> I suggest making a similar choice in as in MergeContent to be able to choose
> a file format which applies file format specific logic when required.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
