Doin Cha created NIFI-12499:
-------------------------------
Summary: When the PublishKafka_2_6 processor attempts to publish,
if any one of the FlowFiles fails, all of them are being forwarded to the
failure queue.
Key: NIFI-12499
URL: https://issues.apache.org/jira/browse/NIFI-12499
Project: Apache NiFi
Issue Type: Improvement
Components: Extensions
Reporter: Doin Cha
When the PublishKafka processor is triggered, it uses
PublishKafkaUtil.pollFlowFiles() to read FlowFiles.
The problem is that {*}even if only one FlowFile fails to publish, the entire
FlowFile List is sent to the failure queue{*}.
As a result, even the successfully processed FlowFiles are being sent to the
failure queue. Is this the intended behavior?
If transactions are not being used, it seems more appropriate to forward only
the failed FlowFile to the failure queue.
(related source code :
[https://github.com/apache/nifi/blob/9a5ec83baa1b3593031f0917659a69e7a36bb0be/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-2-6-processors/src/main/java/org/apache/nifi/processors/kafka/pubsub/PublishKafka_2_6.java#L423)|https://github.com/apache/nifi/blob/9a5ec83baa1b3593031f0917659a69e7a36bb0be/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-2-6-processors/src/main/java/org/apache/nifi/processors/kafka/pubsub/PublishKafka_2_6.java#L423]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
