[ 
https://issues.apache.org/jira/browse/NIFI-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Handermann resolved NIFI-5683.
------------------------------------
    Resolution: Won't Fix

ListenBeats can be configured to write out a set number of messages per 
FlowFile based on hte Max Batch Size property. The Beats protocol sends 
messages as JSON, and the ListenBeats configuration writes multiple messages 
separated using a configurable delimiter. This approach preserves the original 
JSON format of Beats messages, without requiring additional JSON parsing. 
Introducing a Record Writer would also require parsing JSON messages to NiFi 
Records, incurring additional processing overhead. FlowFiles that ListenBeats 
produces can be converted or handled using other record-oriented Processors 
with the standard JsonTreeReader, so it seems best to avoid introducing a 
configurable Record Writer to ListenBeats. 

> Add record writer capability to ListenBeats
> -------------------------------------------
>
>                 Key: NIFI-5683
>                 URL: https://issues.apache.org/jira/browse/NIFI-5683
>             Project: Apache NiFi
>          Issue Type: New Feature
>            Reporter: Mike Thomsen
>            Priority: Major
>
> Make ListenBeats able to write beats output as record sets using a configured 
> writer, with a limit for the number of records per flowfile.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to