[ 
https://issues.apache.org/jira/browse/NIFI-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986706#comment-14986706
 ] 

Andre commented on NIFI-1095:
-----------------------------

Seems also Kafka's new API introduce the functionality:

http://kafka.apache.org/082/javadoc/org/apache/kafka/clients/producer/ProducerRecord.html

However we still use the old API:

https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-processors/src/main/java/org/apache/nifi/processors/kafka/PutKafka.java#L59

> Add Round Robin custom partitioner class to PutKafka
> ----------------------------------------------------
>
>                 Key: NIFI-1095
>                 URL: https://issues.apache.org/jira/browse/NIFI-1095
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Core Framework
>    Affects Versions: 0.3.0
>            Reporter: Andre
>
> While Kafka offers some flexibility around partitioning and data rebalancing, 
> the current PutKafka processor has just two strategies for rebalancing:
> - Random (default?)
> - Key (aka Hashed)
> It would be great if it also had RoundRobin as some of the other Kafka 
> producers around there [1][2].
> Implementation can be done with certain ease:
> http://ankitasblogger.blogspot.com.au/2014/12/kafka-round-robin-partition.html
> [1] see partitioner -> 
> https://hekad.readthedocs.org/en/v0.9.2/config/outputs/kafka.html
> [2] see roundrobin.py -> 
> https://github.com/mumrah/kafka-python/tree/master/kafka/partitioner



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to