[
https://issues.apache.org/jira/browse/BEAM-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856653#comment-15856653
]
Xu Mingmin commented on BEAM-1407:
----------------------------------
add a design doc
https://docs.google.com/document/d/1YlCWws4SYCqUWAtVz9mrmVdFNM8b3E8DLCImYep-I6k/edit?usp=sharing
[~davor] could you help for a review?
> Support multiple Kafka client in KakaIO
> ---------------------------------------
>
> Key: BEAM-1407
> URL: https://issues.apache.org/jira/browse/BEAM-1407
> Project: Beam
> Issue Type: Improvement
> Components: sdk-java-extensions
> Reporter: Xu Mingmin
> Assignee: Xu Mingmin
>
> enhance KafkaIO to work with Kafka client 0.9 and 0.10, (maybe 0.8 as well
> ?),
> 1). to fully leverage new features in each version, like external
> authentication, timestamp in 0.10;
> 2). hide kafka API changed, to support steamless switch between different
> cluster versions;
> Scope of change:
> 1). add an abstract API for Kafka Consumer in existing KafkaIO. By default
> it's kafka 0.9 to keep compatible, with an option for extension;
> 2). Wrapped API for Kafka 0.10, with Kafka message timestamp support;
> 3). wrapped API for Kafka 0.8 (TBD);
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
