Hi, Christopher,
I am glad that you are interested in the Kinesis integration to Samza! Yes,
Renato's implementation is so far the most complete one. However, I think
that it might not handle dynamic shard split/merge cases. Aditya Toomula in
our team is currently working on a complete proposal to address these
issues as listed in https://issues.apache.org/jira/browse/SAMZA-489. He
will be able to share more details.
-Yi
On Sun, Aug 6, 2017 at 4:16 PM, Christopher Kelly wrote:
> Hi all!
>
> I am relatively new to using Samza and am trying to hook it up with Kinesis
> rather than Kafka as the messaging bus behind it. There are a few
> references to functionality intended to make working with Kinesis a bit
> easier (in the latest release notes for example), but I haven't seen much
> code with examples.
>
> I think the most complete implementation I've seen is this github repo:
> https://github.com/renato2099/SamzaKinesis, but I did notice that it
> hasn't
> been updated for a bit. Has anyone had any experience working with Kinesis
> as the backend? Any guidance would be appreciated!
>
> Thanks,
> Chris
>
