David Handermann created NIFI-14752:
---------------------------------------

             Summary: Add Max Uncommitted Size Property to ConsumeKafka
                 Key: NIFI-14752
                 URL: https://issues.apache.org/jira/browse/NIFI-14752
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
            Reporter: David Handermann
            Assignee: David Handermann


The {{ConsumeKafka}} Processor should be updated with a new property named 
{{Max Uncommitted Size}} to provide an optional boundary for the total size of 
records consumed from Kafka in a single invocation.

The current {{Max Uncommitted Time}} property defines the total amount of time 
that {{ConsumeKafka}} should spend before transferring FlowFiles to an output 
relationship, but some of that time spent may be unnecessary if the desired 
size of records consumed provides an earlier threshold.

The new {{Max Uncommitted Size}} property should not be required, maintaining 
compatibility with existing Processor configuration. The property should 
support standard data size validation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to