[
https://issues.apache.org/jira/browse/NIFI-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16712086#comment-16712086
]
ASF GitHub Bot commented on NIFI-5872:
--------------------------------------
Github user pvillard31 commented on the issue:
https://github.com/apache/nifi/pull/3208
Ran a test on my laptop with a workflow generating a lot of data:
- without compression, I reached 129M events / 11.15GB out per 5 minutes
- with compression (Snappy), I reached 161M events / 1GB out per 5 minutes
It improves the number of processed eps while reducing the amount of data
on disk.
> Add compression option on JsonRecordSetWriter
> ---------------------------------------------
>
> Key: NIFI-5872
> URL: https://issues.apache.org/jira/browse/NIFI-5872
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Extensions
> Reporter: Pierre Villard
> Assignee: Pierre Villard
> Priority: Major
>
> Add a compression option on the JsonRecordSetWriter controller service as we
> have on the AvroRecordSetWriter controller service. This can be useful in
> case of very IO intensive workflows.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
