David Handermann created NIFI-14752:
---------------------------------------
Summary: Add Max Uncommitted Size Property to ConsumeKafka
Key: NIFI-14752
URL: https://issues.apache.org/jira/browse/NIFI-14752
Project: Apache NiFi
Issue Type: Improvement
Components: Extensions
Reporter: David Handermann
Assignee: David Handermann
The {{ConsumeKafka}} Processor should be updated with a new property named
{{Max Uncommitted Size}} to provide an optional boundary for the total size of
records consumed from Kafka in a single invocation.
The current {{Max Uncommitted Time}} property defines the total amount of time
that {{ConsumeKafka}} should spend before transferring FlowFiles to an output
relationship, but some of that time spent may be unnecessary if the desired
size of records consumed provides an earlier threshold.
The new {{Max Uncommitted Size}} property should not be required, maintaining
compatibility with existing Processor configuration. The property should
support standard data size validation.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)