[
https://issues.apache.org/jira/browse/NIFI-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949740#comment-15949740
]
ASF GitHub Bot commented on NIFI-3189:
--------------------------------------
Github user bbende commented on the issue:
https://github.com/apache/nifi/pull/1527
+1 I recreated the scenario with 0.9 and 0.10 by setting back-pressure to 1
on the queues after ConsumeKafka and ConsumeKafka_0_10, and verified that after
this patch they have no problem resuming after sitting with back-pressure for
long periods of time. Will merge to master.
> ConsumeKafka 0.9 and 0.10 can cause consumer rebalance when backpressure is
> engaged
> -----------------------------------------------------------------------------------
>
> Key: NIFI-3189
> URL: https://issues.apache.org/jira/browse/NIFI-3189
> Project: Apache NiFi
> Issue Type: Bug
> Affects Versions: 1.1.0
> Reporter: Joseph Witt
> Assignee: Koji Kawamura
> Fix For: 1.2.0
>
>
> ConsumeKafka processors can alert to rebalance issues when backpressure is
> engaged on the output connection and is then freed up. This is because we're
> not doing anything with those consumers for a period of time and the kafka
> client detects this and initiates a rebalance. We should ensure that even
> when we cannot send more data due to back pressure that we at least have some
> sort of keep alive behavior with the kafka client. Or, if that isn't an
> option we should at least document the situation.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)