[ 
https://issues.apache.org/jira/browse/NIFI-11889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Handermann updated NIFI-11889:
------------------------------------
    Status: Patch Available  (was: In Progress)

> Add Record Handling to PutTCP
> -----------------------------
>
>                 Key: NIFI-11889
>                 URL: https://issues.apache.org/jira/browse/NIFI-11889
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Extensions
>            Reporter: David Handermann
>            Assignee: David Handermann
>            Priority: Major
>             Fix For: 1.latest, 2.latest
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> The PutTCP Processor should be updated to support sending serialized records 
> over a TCP socket connection.
> Record-oriented processing enables high-volume throughput for similar 
> records, and various components support sending serialized records to various 
> destinations. Record-oriented handling in PuTCP would support sending to 
> other Processors such as ListenTCP or ListenTCPRecord, and could also support 
> simple transmission protocols like syslog over TCP, depending on the 
> configured Record Writer.
> Although PutTCP can be used to send batches of records in a FlowFIle over 
> TCP, adding configurable record handling properties avoids the need for 
> record conversion prior to network transmission.
> It is worth noting that although TCP provides connection-oriented 
> transmission, it does not provide application-level delivery guarantees. For 
> this reason, record-oriented transmission could result in partial deliveries 
> where an initial number of records will be sent and subsequent records could 
> result in failures. Flows that make use of record-oriented transmission 
> should be consider a duplication handling strategy in the event of needing to 
> retry failed FlowFiles.
> Record handling in PutTCP should be introduced through a new property 
> describing a configurable transmission strategy. The default behavior should 
> be retained through a FlowFile-Oriented option, and new behavior can be 
> enabled through a Record-Oriented option. The Outgoing Message Delimiter and 
> Character Set properties should not apply to Record-Oriented processing 
> because the configured Record Writer handles message formatting.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to