[
https://issues.apache.org/jira/browse/FLUME-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173384#comment-14173384
]
ASF subversion and git services commented on FLUME-2499:
--------------------------------------------------------
Commit 02973a98a223c4b72126b6db3b1b6c1dbdc9239a in flume's branch
refs/heads/flume-1.6 from [~hshreedharan]
[ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=02973a9 ]
FLUME-2499. Include Kafka Message Key in Event Headers.
(Ricky Saltzer via Hari)
> Include Kafka Message Key in Event Header, Updated Comments
> ------------------------------------------------------------
>
> Key: FLUME-2499
> URL: https://issues.apache.org/jira/browse/FLUME-2499
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v1.5.0.1
> Reporter: Ricky Saltzer
> Priority: Minor
> Attachments: FLUME-2499.diff, FLUME-2499.diff
>
>
> I believe it would be useful to include a message's key in the event header,
> as users will often want to partition based on this key when ingesting into a
> sink.
> *Example:*
> {code}
> sfdc.sinks.hdfs.hdfs.path =
> /data/testing/kafka_flume/dataset=%{key}/year=%Y/month=%m/day=%d/
> {code}
> In this case, the first part of the partition key is the Kafka message key,
> which will ensure messages are organized by key.
> I also updated some of the comments and cleaned up the code slightly.
> Cheers,
> Ricky
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
