[
https://issues.apache.org/jira/browse/NIFI-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15270530#comment-15270530
]
ASF GitHub Bot commented on NIFI-1296:
--------------------------------------
Github user pvillard31 commented on the pull request:
https://github.com/apache/nifi/pull/366#issuecomment-216842191
I just played a little bit with the processors and here are some remarks:
- Cosmetic remarks
1. add the duration in provenance events
2. add the number of messages sent/received (useful when batching)
- Testing
1. Simple case
When I have a topic with one broker and one partition. It seems to be OK:
no more data loss, demarcator seems to be used correctly. LGTM.
2. I then deleted my topic and recreated it with 5 partitions. I am sending
flow files with 2 JSON strings (one by line). The PublishKafka is set with
appropriate demarcator, plaintext, guarantee replicated delivery, round robin
partitioner and snappy compression. All messages are correctly sent to Kafka.
The ConsumeKafka has no particular settings (no demarcator). The thing is I do
not retrieve all the published messages. For each FlowFile, each JSON contains
the date, I can confirm that the very first flow file is correctly published
and consumed (two messages), then I have 3 FlowFiles (not consecutive) for
which 2 messages are published but only one is consumed.
I don't know it that helps a lot. I'll try to look closer later in the day.
> Add capabilities to Kafka NAR to use new Kafka API (0.9)
> --------------------------------------------------------
>
> Key: NIFI-1296
> URL: https://issues.apache.org/jira/browse/NIFI-1296
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Core Framework
> Affects Versions: 0.4.0
> Reporter: Oleg Zhurakousky
> Assignee: Oleg Zhurakousky
> Fix For: 0.7.0
>
>
> Not sure when can we address this, but the interesting comment in
> https://github.com/apache/nifi/pull/143. The usage of new API may introduce
> issues with running against older Kafka brokers (e.g., 0.8). Need to
> investigate.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
