Re: Is there a plan for Feature like this in C* ?

[Rahul Singh]

Some of my links related to Kafka and Cassandra

http://leaves.anant.us/#!/leaf/10767?tag=cassandra,kafka


Rahul
On Jul 3, 2018, 11:48 AM -0400, Joshua Galbraith 
, wrote:
> There is more info and background context on CDC here:
> https://issues.apache.org/jira/browse/CASSANDRA-8844
>
> > On Mon, Jul 2, 2018 at 9:26 PM, Justin Cameron  
> > wrote:
> > > Sorry - you'd need a source connector, not the sink.
> > >
> > > > On Tue, 3 Jul 2018 at 04:24 Justin Cameron  
> > > > wrote:
> > > > > Yeah, if you're using Kafka Connect you could use the Cassandra sink 
> > > > > connector
> > > > >
> > > > > > On Tue, 3 Jul 2018 at 02:37 Jeff Jirsa  wrote:
> > > > > > > Its a stable API - the project doesn’t ship a Kafka connector but 
> > > > > > > certainly people have written them
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Jeff Jirsa
> > > > > > >
> > > > > > >
> > > > > > > On Jul 2, 2018, at 6:50 PM, Kant Kodali  wrote:
> > > > > > >
> > > > > > > > Hi Justin,
> > > > > > > >
> > > > > > > > Thanks, Looks like a very early stage feature and no 
> > > > > > > > integration with Kafka yet I suppose.
> > > > > > > >
> > > > > > > > Thanks!
> > > > > > > >
> > > > > > > > > On Mon, Jul 2, 2018 at 6:24 PM, Justin Cameron 
> > > > > > > > >  wrote:
> > > > > > > > > > yes, take a look at 
> > > > > > > > > > http://cassandra.apache.org/doc/latest/operating/cdc.html
> > > > > > > > > >
> > > > > > > > > > > On Tue, 3 Jul 2018 at 01:20 Kant Kodali 
> > > > > > > > > > >  wrote:
> > > > > > > > > > > > https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html
> > > > > > > > > > --
> > > > > > > > > > Justin Cameron
> > > > > > > > > > Senior Software Engineer
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > This email has been sent on behalf of Instaclustr Pty. 
> > > > > > > > > > Limited (Australia) and Instaclustr Inc (USA).
> > > > > > > > > >
> > > > > > > > > > This email and any attachments may contain confidential and 
> > > > > > > > > > legally privileged information.  If you are not the 
> > > > > > > > > > intended recipient, do not copy or disclose its content, 
> > > > > > > > > > but please reply to this email immediately and highlight 
> > > > > > > > > > the error to the sender and then immediately delete the 
> > > > > > > > > > message.
> > > > > > > >
> > > > > --
> > > > > Justin Cameron
> > > > > Senior Software Engineer
> > > > >
> > > > >
> > > > > This email has been sent on behalf of Instaclustr Pty. Limited 
> > > > > (Australia) and Instaclustr Inc (USA).
> > > > >
> > > > > This email and any attachments may contain confidential and legally 
> > > > > privileged information.  If you are not the intended recipient, do 
> > > > > not copy or disclose its content, but please reply to this email 
> > > > > immediately and highlight the error to the sender and then 
> > > > > immediately delete the message.
> > > --
> > > Justin Cameron
> > > Senior Software Engineer
> > >
> > >
> > > This email has been sent on behalf of Instaclustr Pty. Limited 
> > > (Australia) and Instaclustr Inc (USA).
> > >
> > > This email and any attachments may contain confidential and legally 
> > > privileged information.  If you are not the intended recipient, do not 
> > > copy or disclose its content, but please reply to this email immediately 
> > > and highlight the error to the sender and then immediately delete the 
> > > message.
>
>
>
> --
> Joshua Galbraith | Lead Software Engineer | New Relic

Re: Is there a plan for Feature like this in C* ?

[Rahul Singh]

There is a source connector from Landoop for Kafka Connect but it is based on 
polling a “kcql” select statement. They claim to be working on a CDC source 
connector for Kafka Connect but I couldn’t find anything.

Smart Cat Labs has a CDC trigger based Kafka producer but I don’t think it uses 
Kafka Connect.

Theoretically you should be able to use the Smart Cat Labs CDC Kafka producer 
and then use that with Kafka Connect to write to else where.

Rahul
On Jul 3, 2018, 11:48 AM -0400, Joshua Galbraith 
, wrote:
> There is more info and background context on CDC here:
> https://issues.apache.org/jira/browse/CASSANDRA-8844
>
> > On Mon, Jul 2, 2018 at 9:26 PM, Justin Cameron  
> > wrote:
> > > Sorry - you'd need a source connector, not the sink.
> > >
> > > > On Tue, 3 Jul 2018 at 04:24 Justin Cameron  
> > > > wrote:
> > > > > Yeah, if you're using Kafka Connect you could use the Cassandra sink 
> > > > > connector
> > > > >
> > > > > > On Tue, 3 Jul 2018 at 02:37 Jeff Jirsa  wrote:
> > > > > > > Its a stable API - the project doesn’t ship a Kafka connector but 
> > > > > > > certainly people have written them
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Jeff Jirsa
> > > > > > >
> > > > > > >
> > > > > > > On Jul 2, 2018, at 6:50 PM, Kant Kodali  wrote:
> > > > > > >
> > > > > > > > Hi Justin,
> > > > > > > >
> > > > > > > > Thanks, Looks like a very early stage feature and no 
> > > > > > > > integration with Kafka yet I suppose.
> > > > > > > >
> > > > > > > > Thanks!
> > > > > > > >
> > > > > > > > > On Mon, Jul 2, 2018 at 6:24 PM, Justin Cameron 
> > > > > > > > >  wrote:
> > > > > > > > > > yes, take a look at 
> > > > > > > > > > http://cassandra.apache.org/doc/latest/operating/cdc.html
> > > > > > > > > >
> > > > > > > > > > > On Tue, 3 Jul 2018 at 01:20 Kant Kodali 
> > > > > > > > > > >  wrote:
> > > > > > > > > > > > https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html
> > > > > > > > > > --
> > > > > > > > > > Justin Cameron
> > > > > > > > > > Senior Software Engineer
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > This email has been sent on behalf of Instaclustr Pty. 
> > > > > > > > > > Limited (Australia) and Instaclustr Inc (USA).
> > > > > > > > > >
> > > > > > > > > > This email and any attachments may contain confidential and 
> > > > > > > > > > legally privileged information.  If you are not the 
> > > > > > > > > > intended recipient, do not copy or disclose its content, 
> > > > > > > > > > but please reply to this email immediately and highlight 
> > > > > > > > > > the error to the sender and then immediately delete the 
> > > > > > > > > > message.
> > > > > > > >
> > > > > --
> > > > > Justin Cameron
> > > > > Senior Software Engineer
> > > > >
> > > > >
> > > > > This email has been sent on behalf of Instaclustr Pty. Limited 
> > > > > (Australia) and Instaclustr Inc (USA).
> > > > >
> > > > > This email and any attachments may contain confidential and legally 
> > > > > privileged information.  If you are not the intended recipient, do 
> > > > > not copy or disclose its content, but please reply to this email 
> > > > > immediately and highlight the error to the sender and then 
> > > > > immediately delete the message.
> > > --
> > > Justin Cameron
> > > Senior Software Engineer
> > >
> > >
> > > This email has been sent on behalf of Instaclustr Pty. Limited 
> > > (Australia) and Instaclustr Inc (USA).
> > >
> > > This email and any attachments may contain confidential and legally 
> > > privileged information.  If you are not the intended recipient, do not 
> > > copy or disclose its content, but please reply to this email immediately 
> > > and highlight the error to the sender and then immediately delete the 
> > > message.
>
>
>
> --
> Joshua Galbraith | Lead Software Engineer | New Relic

Re: Is there a plan for Feature like this in C* ?

[Joshua Galbraith]

There is more info and background context on CDC here:
https://issues.apache.org/jira/browse/CASSANDRA-8844

On Mon, Jul 2, 2018 at 9:26 PM, Justin Cameron 
wrote:

> Sorry - you'd need a source connector, not the sink.
>
> On Tue, 3 Jul 2018 at 04:24 Justin Cameron  wrote:
>
>> Yeah, if you're using Kafka Connect you could use the Cassandra sink
>> connector
>>
>> On Tue, 3 Jul 2018 at 02:37 Jeff Jirsa  wrote:
>>
>>> Its a stable API - the project doesn’t ship a Kafka connector but
>>> certainly people have written them
>>>
>>>
>>> --
>>> Jeff Jirsa
>>>
>>>
>>> On Jul 2, 2018, at 6:50 PM, Kant Kodali  wrote:
>>>
>>> Hi Justin,
>>>
>>> Thanks, Looks like a very early stage feature and no integration with
>>> Kafka yet I suppose.
>>>
>>> Thanks!
>>>
>>> On Mon, Jul 2, 2018 at 6:24 PM, Justin Cameron 
>>> wrote:
>>>
 yes, take a look at http://cassandra.apache.org/
 doc/latest/operating/cdc.html

 On Tue, 3 Jul 2018 at 01:20 Kant Kodali  wrote:

> https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html
>
 --


 *Justin Cameron*Senior Software Engineer


 


 This email has been sent on behalf of Instaclustr Pty. Limited
 (Australia) and Instaclustr Inc (USA).

 This email and any attachments may contain confidential and legally
 privileged information.  If you are not the intended recipient, do not copy
 or disclose its content, but please reply to this email immediately and
 highlight the error to the sender and then immediately delete the message.

>>>
>>> --
>>
>>
>> *Justin Cameron*Senior Software Engineer
>>
>>
>> 
>>
>>
>> This email has been sent on behalf of Instaclustr Pty. Limited
>> (Australia) and Instaclustr Inc (USA).
>>
>> This email and any attachments may contain confidential and legally
>> privileged information.  If you are not the intended recipient, do not copy
>> or disclose its content, but please reply to this email immediately and
>> highlight the error to the sender and then immediately delete the message.
>>
> --
>
>
> *Justin Cameron*Senior Software Engineer
>
>
> 
>
>
> This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
> and Instaclustr Inc (USA).
>
> This email and any attachments may contain confidential and legally
> privileged information.  If you are not the intended recipient, do not copy
> or disclose its content, but please reply to this email immediately and
> highlight the error to the sender and then immediately delete the message.
>



-- 
*Joshua Galbraith *| Lead Software Engineer | New Relic

Re: Is there a plan for Feature like this in C* ?

[Justin Cameron]

Sorry - you'd need a source connector, not the sink.

On Tue, 3 Jul 2018 at 04:24 Justin Cameron  wrote:

> Yeah, if you're using Kafka Connect you could use the Cassandra sink
> connector
>
> On Tue, 3 Jul 2018 at 02:37 Jeff Jirsa  wrote:
>
>> Its a stable API - the project doesn’t ship a Kafka connector but
>> certainly people have written them
>>
>>
>> --
>> Jeff Jirsa
>>
>>
>> On Jul 2, 2018, at 6:50 PM, Kant Kodali  wrote:
>>
>> Hi Justin,
>>
>> Thanks, Looks like a very early stage feature and no integration with
>> Kafka yet I suppose.
>>
>> Thanks!
>>
>> On Mon, Jul 2, 2018 at 6:24 PM, Justin Cameron 
>> wrote:
>>
>>> yes, take a look at
>>> http://cassandra.apache.org/doc/latest/operating/cdc.html
>>>
>>> On Tue, 3 Jul 2018 at 01:20 Kant Kodali  wrote:
>>>
 https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html

>>> --
>>>
>>>
>>> *Justin Cameron*Senior Software Engineer
>>>
>>>
>>> 
>>>
>>>
>>> This email has been sent on behalf of Instaclustr Pty. Limited
>>> (Australia) and Instaclustr Inc (USA).
>>>
>>> This email and any attachments may contain confidential and legally
>>> privileged information.  If you are not the intended recipient, do not copy
>>> or disclose its content, but please reply to this email immediately and
>>> highlight the error to the sender and then immediately delete the message.
>>>
>>
>> --
>
>
> *Justin Cameron*Senior Software Engineer
>
>
> 
>
>
> This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
> and Instaclustr Inc (USA).
>
> This email and any attachments may contain confidential and legally
> privileged information.  If you are not the intended recipient, do not copy
> or disclose its content, but please reply to this email immediately and
> highlight the error to the sender and then immediately delete the message.
>
-- 


*Justin Cameron*Senior Software Engineer





This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
and Instaclustr Inc (USA).

This email and any attachments may contain confidential and legally
privileged information.  If you are not the intended recipient, do not copy
or disclose its content, but please reply to this email immediately and
highlight the error to the sender and then immediately delete the message.

Re: Is there a plan for Feature like this in C* ?

[Justin Cameron]

Yeah, if you're using Kafka Connect you could use the Cassandra sink
connector

On Tue, 3 Jul 2018 at 02:37 Jeff Jirsa  wrote:

> Its a stable API - the project doesn’t ship a Kafka connector but
> certainly people have written them
>
>
> --
> Jeff Jirsa
>
>
> On Jul 2, 2018, at 6:50 PM, Kant Kodali  wrote:
>
> Hi Justin,
>
> Thanks, Looks like a very early stage feature and no integration with
> Kafka yet I suppose.
>
> Thanks!
>
> On Mon, Jul 2, 2018 at 6:24 PM, Justin Cameron 
> wrote:
>
>> yes, take a look at
>> http://cassandra.apache.org/doc/latest/operating/cdc.html
>>
>> On Tue, 3 Jul 2018 at 01:20 Kant Kodali  wrote:
>>
>>> https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html
>>>
>> --
>>
>>
>> *Justin Cameron*Senior Software Engineer
>>
>>
>> 
>>
>>
>> This email has been sent on behalf of Instaclustr Pty. Limited
>> (Australia) and Instaclustr Inc (USA).
>>
>> This email and any attachments may contain confidential and legally
>> privileged information.  If you are not the intended recipient, do not copy
>> or disclose its content, but please reply to this email immediately and
>> highlight the error to the sender and then immediately delete the message.
>>
>
> --


*Justin Cameron*Senior Software Engineer





This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
and Instaclustr Inc (USA).

This email and any attachments may contain confidential and legally
privileged information.  If you are not the intended recipient, do not copy
or disclose its content, but please reply to this email immediately and
highlight the error to the sender and then immediately delete the message.

Re: Is there a plan for Feature like this in C* ?

[Jeff Jirsa]

Its a stable API - the project doesn’t ship a Kafka connector but certainly 
people have written them

-- 
Jeff Jirsa


> On Jul 2, 2018, at 6:50 PM, Kant Kodali  wrote:
> 
> Hi Justin,
> 
> Thanks, Looks like a very early stage feature and no integration with Kafka 
> yet I suppose.
> 
> Thanks!
> 
>> On Mon, Jul 2, 2018 at 6:24 PM, Justin Cameron  
>> wrote:
>> yes, take a look at http://cassandra.apache.org/doc/latest/operating/cdc.html
>> 
>>> On Tue, 3 Jul 2018 at 01:20 Kant Kodali  wrote:
>>> https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html
>> -- 
>> Justin Cameron
>> Senior Software Engineer
>> 
>> 
>> 
>> 
>> 
>> 
>> This email has been sent on behalf of Instaclustr Pty. Limited (Australia) 
>> and Instaclustr Inc (USA).
>> 
>> This email and any attachments may contain confidential and legally 
>> privileged information.  If you are not the intended recipient, do not copy 
>> or disclose its content, but please reply to this email immediately and 
>> highlight the error to the sender and then immediately delete the message.
>> 
> 

Re: Is there a plan for Feature like this in C* ?

[Kant Kodali]

Hi Justin,

Thanks, Looks like a very early stage feature and no integration with Kafka
yet I suppose.

Thanks!

On Mon, Jul 2, 2018 at 6:24 PM, Justin Cameron 
wrote:

> yes, take a look at http://cassandra.apache.org/
> doc/latest/operating/cdc.html
>
> On Tue, 3 Jul 2018 at 01:20 Kant Kodali  wrote:
>
>> https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html
>>
> --
>
>
> *Justin Cameron*Senior Software Engineer
>
>
> 
>
>
> This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
> and Instaclustr Inc (USA).
>
> This email and any attachments may contain confidential and legally
> privileged information.  If you are not the intended recipient, do not copy
> or disclose its content, but please reply to this email immediately and
> highlight the error to the sender and then immediately delete the message.
>

Re: Is there a plan for Feature like this in C* ?

[Justin Cameron]

yes, take a look at
http://cassandra.apache.org/doc/latest/operating/cdc.html

On Tue, 3 Jul 2018 at 01:20 Kant Kodali  wrote:

> https://www.cockroachlabs.com/docs/v2.1/change-data-capture.html
>
-- 


*Justin Cameron*Senior Software Engineer





This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
and Instaclustr Inc (USA).

This email and any attachments may contain confidential and legally
privileged information.  If you are not the intended recipient, do not copy
or disclose its content, but please reply to this email immediately and
highlight the error to the sender and then immediately delete the message.