Re: CDC Tools

2020-06-02 Thread Johnny Miller
Dor - that looks very useful. Looking forward to trying the CDC Kafka connector! On Thu, 28 May 2020 at 02:53, Dor Laor wrote: > If it's helpful, IMO, the approach Cassandra needs to take isn't > by tracking the individual node commit log and putting the burden > on the client. At Scylla, we

Re: CDC Tools

2020-05-27 Thread Dor Laor
If it's helpful, IMO, the approach Cassandra needs to take isn't by tracking the individual node commit log and putting the burden on the client. At Scylla, we had the 'opportunity' to be a late comer and see what approach Cassadnra took and what DynamoDB streams took. We've implemented CDC as a

Re: CDC Tools

2020-05-27 Thread Erick Ramirez
> > I have looked at DataStax CDC but I think it works only for DSE ! > Yes, thanks for the correction. I just got confirmation myself -- the Kafka-Cassandra connector works with OSS C* but the CDC connector relies on a DSE feature that's not yet available in OSS C*. Cheers!

Re: CDC Tools

2020-05-27 Thread Ahmed Eljami
Hi Erick, I have looked at DataStax CDC but I think it works only for DSE ! Maybe it will be open-sourced like other drivers :) Cheers. Le mer. 27 mai 2020 à 04:42, Erick Ramirez a écrit : > I think I recall seeing you post the same question on ASF Slack yesterday. > > I haven't used Debezium

Re: CDC Tools

2020-05-26 Thread Erick Ramirez
I think I recall seeing you post the same question on ASF Slack yesterday. I haven't used Debezium so I can't comment on it. But are you looking for something to consume the CDC logs? If so, you might be interested in the DataStax CDC Kafka connector that offers bi-directional data movement. For

Re: CDC Tools

2020-05-26 Thread guo Maxwell
I have found some project that support parse Commitlog (CDC), such as : https://github.com/rustyrazorblade/commitlog-viz this seems wrote by Jon Haddad , but is not work yet. and commitlog extract tool : https://github.com/carloscm/cassandra-commitlog-extract but it also do some output to other