Re: Change Data Capture Feature

[Pavel Strashkin]

This is exactly what I was looking for, Denis. Thanks a lot!

On Fri, Aug 14, 2020 at 10:02 AM Denis Magda  wrote:

> Hello Pavel,
>
> GridGain supports a Kafka Connect integration that supports all
> sophisticated CDC scenarios:
> https://www.gridgain.com/docs/latest/integrations/kafka/cert-kafka-connect
>
> Debezium is another option. This article covers how to capture changes
> with GridGain Kafka Connect
> 
>  while
> that's not the only option for sure.
>
> Finally, continuous  queries is a way to go as well but you have to keep
> track of messages that have already been pushed to a Kafka topic. So, that
> last position has to be maintained in Ignite somehow.
>
> -
> Denis
>
>
> On Thu, Aug 13, 2020 at 8:48 AM Pavel Strashkin 
> wrote:
>
>> Hello,
>>
>> Is there a Change Data Capture (CDC) feature in plans to make it possible
>> to stream cache updates to Kafka for example?
>>
>> I've found the Continuous Queries feature, but it's not clear to me
>> whether it's possible to use it for implementation. What's missing it seems
>> is ability to start from the last position whenever the client restarts.
>>
>> Thanks.
>>
>

Re: Change Data Capture Feature

[Denis Magda]

Hello Pavel,

GridGain supports a Kafka Connect integration that supports all
sophisticated CDC scenarios:
https://www.gridgain.com/docs/latest/integrations/kafka/cert-kafka-connect

Debezium is another option. This article covers how to capture changes
with GridGain
Kafka Connect

while
that's not the only option for sure.

Finally, continuous  queries is a way to go as well but you have to keep
track of messages that have already been pushed to a Kafka topic. So, that
last position has to be maintained in Ignite somehow.

-
Denis


On Thu, Aug 13, 2020 at 8:48 AM Pavel Strashkin 
wrote:

> Hello,
>
> Is there a Change Data Capture (CDC) feature in plans to make it possible
> to stream cache updates to Kafka for example?
>
> I've found the Continuous Queries feature, but it's not clear to me
> whether it's possible to use it for implementation. What's missing it seems
> is ability to start from the last position whenever the client restarts.
>
> Thanks.
>

Change Data Capture Feature

[Pavel Strashkin]

Hello,

Is there a Change Data Capture (CDC) feature in plans to make it possible
to stream cache updates to Kafka for example?

I've found the Continuous Queries feature, but it's not clear to me whether
it's possible to use it for implementation. What's missing it seems is
ability to start from the last position whenever the client restarts.

Thanks.