GitHub user tzulitai opened a pull request:
https://github.com/apache/flink/pull/1911
[FLINK-3229] Flink streaming consumer for AWS Kinesis
I've been using this consumer for a while in off-production environments.
I understand we should have good test coverage for each PR, but since
Kinesis is a hosted service, reliable integration tests are hard to pull off.
To speed up merging Kinesis connector for the next release, I'm submitting the
consumer now for some early reviews.
On the other hand, since @rmetzger is submitting a separate PR for Kinesis
producer, I'd like to postpone writing more tests for the consumer, as well as
corresponding modification to the document until both the consumer and producer
are in place.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tzulitai/flink FLINK-3229
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/1911.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1911
----
commit 0e7c4eccca132e0fcf35262b36229e681c77530e
Author: Gordon Tai <[email protected]>
Date: 2016-04-16T03:33:17Z
[FLINK-3229] Initial working version for FlinkKinesisConsumer.
commit 6d46a6d09c346e490053a2f6319616a5178dab4e
Author: Gordon Tai <[email protected]>
Date: 2016-04-17T09:34:55Z
[FLINK-3229] Change access level of `assignShards` and
`validatePropertiesConfig` to protected for testing purposes
commit c92b491fce8b3c35b409bc6f308d25ce52835027
Author: Gordon Tai <[email protected]>
Date: 2016-04-17T11:12:00Z
[FLINK-3229] Fix coding stype violations regarding leading spaces in
indentations
commit bc9f771c0f36618ce07772cfdefe7d87a35800fb
Author: Gordon Tai <[email protected]>
Date: 2016-04-19T09:56:57Z
[FLINK-3229] Change scope of flink-streaming-java module to provided
commit fc454efaac5dc7969ad4834b892f26799cfe5a33
Author: Gordon Tai <[email protected]>
Date: 2016-04-19T09:58:46Z
[FLINK-3229] Basic unit test for stable shard-to-consumer assignment
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
