Purushotham Pushpavanthar created NIFI-6501:
-----------------------------------------------

             Summary: Add config to limit buffer queue size in 
CaptureChangeMySQL
                 Key: NIFI-6501
                 URL: https://issues.apache.org/jira/browse/NIFI-6501
             Project: Apache NiFi
          Issue Type: Bug
          Components: Configuration
    Affects Versions: 1.9.2
            Reporter: Purushotham Pushpavanthar
            Assignee: Purushotham Pushpavanthar


CaptureChangeMySQL processor registers a listener with Blocking Queue as buffer 
with the BinLogClient. When the thread polling from the Queue is slower 
compared to writer, the queue grows uncontrollably and brings down the node.

Since the flow writing to listeners in 
[mysql-binlog-connector-java|[https://github.com/shyiko/mysql-binlog-connector-java]]
 is blocking, we should initialize the queue with *initial size* and *queue 
offer timeout* specified by the user based in cluster configuration.

[http://apache-nifi-developer-list.39713.n7.nabble.com/NiFi-Cluster-crashes-while-running-CaptureChangeMySQL-for-CDC-td20895.html]



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Reply via email to