David Handermann created NIFI-11889:
---------------------------------------
Summary: Add Record Handling to PutTCP
Key: NIFI-11889
URL: https://issues.apache.org/jira/browse/NIFI-11889
Project: Apache NiFi
Issue Type: New Feature
Components: Extensions
Reporter: David Handermann
Assignee: David Handermann
Fix For: 1.latest, 2.latest
The PutTCP Processor should be updated to support sending serialized records
over a TCP socket connection.
Record-oriented processing enables high-volume throughput for similar records,
and various components support sending serialized records to various
destinations. Record-oriented handling in PuTCP would support sending to other
Processors such as ListenTCP or ListenTCPRecord, and could also support simple
transmission protocols like syslog over TCP, depending on the configured Record
Writer.
Although PutTCP can be used to send batches of records in a FlowFIle over TCP,
adding configurable record handling properties avoids the need for record
conversion prior to network transmission.
It is worth noting that although TCP provides connection-oriented transmission,
it does not provide application-level delivery guarantees. For this reason,
record-oriented transmission could result in partial deliveries where an
initial number of records will be sent and subsequent records could result in
failures. Flows that make use of record-oriented transmission should be
consider a duplication handling strategy in the event of needing to retry
failed FlowFiles.
Record handling in PutTCP should be introduced through a new property
describing a configurable transmission strategy. The default behavior should be
retained through a FlowFile-Oriented option, and new behavior can be enabled
through a Record-Oriented option. The Outgoing Message Delimiter and Character
Set properties should not apply to Record-Oriented processing because the
configured Record Writer handles message formatting.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
