[jira] [Created] (NIFI-5539) ConsumeKafka* processors should use a default yield duration much smaller than the typical default of 1 second

Mon, 20 Aug 2018 11:30:13 -0700 

Mark Payne created NIFI-5539:
--------------------------------

             Summary: ConsumeKafka* processors should use a default yield 
duration much smaller than the typical default of 1 second
                 Key: NIFI-5539
                 URL: https://issues.apache.org/jira/browse/NIFI-5539
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
            Reporter: Mark Payne
            Assignee: Mark Payne


ConsumeKafka* processors work by requesting a batch of records from Kafka, then 
waiting up to 10 milliseconds to receive the data. If not received by then, the 
processor will yield. However, for high volume flows this can happen pretty 
often, especially with small batch sizes, and that can result in a lot of time 
spent yielding when it could be pulling data. We should instead use a default 
of "0 millis" or "10 millis"



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to