GitHub user mxm opened a pull request:
https://github.com/apache/incubator-beam/pull/266
Add option to use Flink's Kafka Write IO
This pull request adds the counterpart of the UnboundedFlinkSource, the
`UnboundedFlinkSink` which uses the `Write` API. Users have requested this
multiple times, e.g. to use the Flink Kafka Producer in a Beam program. In the
long run we will opt only for Beam IO interfaces. I would like to replace the
custom Flink sources and sinks as soon as we have the relevant connectors for
users in place. In the meantime, users can explore the potential of Beam using
also native backend connectors.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mxm/incubator-beam kafkaSink-pr
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/266.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #266
----
commit 3780b01f9ff0a2ffb645b961e127c50ae97affd8
Author: Maximilian Michels <[email protected]>
Date: 2016-04-22T10:33:26Z
Kafka sink implementation
commit 1db316971b6ecd0a27cefb0408266c914c1f7d89
Author: Maximilian Michels <[email protected]>
Date: 2016-04-28T10:00:18Z
fix Flink source coder handling
commit fff968b03177ba53f3bdad2055f67dc5633d5628
Author: Maximilian Michels <[email protected]>
Date: 2016-04-28T10:02:05Z
add Kafka IO examples
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
