[
https://issues.apache.org/jira/browse/NIFI-6501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898675#comment-16898675
]
Purushotham Pushpavanthar edited comment on NIFI-6501 at 8/2/19 7:53 AM:
-------------------------------------------------------------------------
Yes. But the state ( binlog filename and position) will be retained.
I guess if the downstream processor is stopped, there is no point in keeping
binlogClient running. We need to disconnect the client and reconnect to
particular binlog filename and position when triggered next. Correct me if I'm
wrong.
was (Author: pushpavanthar):
Yes. But the state ( binlog filename and position) will be retained.
I guess if the downstream processor is stopped, there is no point in keeping
binlogClient running. We need to stop the client and restart to particular
binlog filename and position when triggered next. Correct me if I'm wrong.
> Add config to limit buffer queue size in CaptureChangeMySQL
> -----------------------------------------------------------
>
> Key: NIFI-6501
> URL: https://issues.apache.org/jira/browse/NIFI-6501
> Project: Apache NiFi
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 1.9.2
> Reporter: Purushotham Pushpavanthar
> Assignee: Purushotham Pushpavanthar
> Priority: Critical
> Labels: easyfix
> Attachments: image-2019-08-02-11-29-10-829.png
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> CaptureChangeMySQL processor registers a listener with Blocking Queue as
> buffer with the BinLogClient. When the thread polling from the Queue is
> slower compared to writer, the queue grows uncontrollably and brings down the
> node.
> Since the flow writing to listeners in
> [mysql-binlog-connector-java|[https://github.com/shyiko/mysql-binlog-connector-java]]
> is blocking, we should initialize the queue with *initial size* and *queue
> offer timeout* specified by the user based in cluster configuration.
> [http://apache-nifi-developer-list.39713.n7.nabble.com/NiFi-Cluster-crashes-while-running-CaptureChangeMySQL-for-CDC-td20895.html]
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
