Li Ye created FLUME-2872:
----------------------------

             Summary: Kafka Sink should be able to select which header as the 
key
                 Key: FLUME-2872
                 URL: https://issues.apache.org/jira/browse/FLUME-2872
             Project: Flume
          Issue Type: Improvement
          Components: Sinks+Sources
    Affects Versions: v1.6.0
            Reporter: Li Ye


In Flume 1.6.0, Kafka Sink uses the topic and key properties from the 
FlumeEvent headers to send events to Kafka. If topic exists in the headers, the 
event will be sent to that specific topic, overriding the topic configured for 
the Sink. If key exists in the headers, the key will used by Kafka to partition 
the data between the topic partitions. Events with same key will be sent to the 
same partition. If the key is null, events will be sent to random partitions.
But if Kafka Sink is able to select which header as the key, much convieience 
will be brought to Flume users.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to