Li Ye created FLUME-2874:
----------------------------

             Summary: A new interceptor called Key Interceptor should be 
created to insert a header with key "key" which will be used in Kakfa Sink
                 Key: FLUME-2874
                 URL: https://issues.apache.org/jira/browse/FLUME-2874
             Project: Flume
          Issue Type: New Feature
    Affects Versions: v1.6.0
            Reporter: Li Ye


Kafka Sink uses the topic and key properties from the FlumeEvent headers to 
send events to Kafka. If topic exists in the headers, the event will be sent to 
that specific topic, overriding the topic configured for the Sink. If key 
exists in the headers, the key will used by Kafka to partition the data between 
the topic partitions. Events with same key will be sent to the same partition. 
If the key is null, events will be sent to random partitions.
If there is a new interceptor called Key Interceptor to insert a header with 
key "key", much convienience will be brought to Kafka Sink users.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to