[
https://issues.apache.org/jira/browse/NIFI-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989533#comment-14989533
]
Mark Payne commented on NIFI-1097:
----------------------------------
Hmmm, I am going to remove the patch that i attached - I don't think it's
ready. It does appear to work properly. However, performance tests show that I
was only able to push about 1500 messages per second to Kafka on my laptop
single-threaded. Just ran the same test against the old processor to compare
and got about 6300 messages/sec. For both tests was using Best Effort, Async
delivery against the same Kafka server. Need to find out why performance is so
bad.
> PutKafka should be changed to use the new 0.8.2 Producer API
> ------------------------------------------------------------
>
> Key: NIFI-1097
> URL: https://issues.apache.org/jira/browse/NIFI-1097
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Reporter: Mark Payne
> Assignee: Mark Payne
> Priority: Critical
> Fix For: 0.4.0
>
> Attachments:
> 0001-NIFI-1097-Rewrite-PutKafka-to-use-the-new-producer-a.patch
>
>
> Currently, PutKafka uses the old Producer API, which provides several
> limitations. The most critical of these limitations is that the asynchronous
> send does not provide an indication of its success. As a result, when
> PutKafka is configured to send asynchronously, it will always route the
> FlowFIle to 'success' even if it does not send the data to Kafka.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
