[
https://issues.apache.org/jira/browse/NIFI-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817092#comment-17817092
]
Paul Grey commented on NIFI-12783:
----------------------------------
Can you share more detail about your observations?
- Are we talking about PublishKafka_2_6 or PublishKafkaRecord_2_6?
- Is there a network timeout connecting to Kafka?
- Is there a network timeout sending to Kafka?
- Do you have any stack traces from your NiFi app log at the point in time
where you see a yield to an incoming connection?
- What do you mean about needing dynamically configurable expiration times in
the incoming queue?
- If a queue could expire FlowFiles after an interval based on FlowFile
attributes, would that meet your need?
>From a brief scan of the processor code, it looks like the yield() is reserved
>for situations where connectivity to Kafka cannot be established. Are you
>seeing something different?
> Kafka Producer Processors do not route in failure queue on timeout
> ------------------------------------------------------------------
>
> Key: NIFI-12783
> URL: https://issues.apache.org/jira/browse/NIFI-12783
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.23.2
> Reporter: Denis Jakupovic
> Priority: Major
>
> Hi,
> the Kafka producer processors do not route the FlowFiles on a timeout e.g.
> into the failure connection. They are yielded in the incomming connection.
> You can see the behaviour here e.g.:
> [https://stackoverflow.com/questions/71460008/apache-nifi-publishkafka-timeout-exception]
> I think this is a design flaw. I have a use case where messages should be
> dropped after a specific configurable time. If the messages are yielded in
> the incomming queue they are always published when the kafka broker are
> available again. I know I can set the expiration time in secs or mins in the
> incomming queue but it is not dynamically configurable because no attributes
> are allowed.
> Best
> Denis
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
