Re: Use DL stream to store offsets?

2016-11-09 Thread Jay Juma
I am also interested in a framework/library that makes building state machine easier. When do you think you can share that? I'd like to contribute too. - Jay On Wed, Nov 2, 2016 at 9:19 AM, Leigh Stewart wrote: > Whats your timeline Khurrum? Maybe we can work

Re: Use DL stream to store offsets?

2016-11-03 Thread Khurrum Nasim
That's cool, Leigh. It would be good that you can have some basic version out as soon as possible. I'd like to leverage any existing solution, rather than building a separate one. - KN On Wed, Nov 2, 2016 at 9:19 AM, Leigh Stewart wrote: > Whats your timeline

Re: Use DL stream to store offsets?

2016-11-02 Thread Sijie Guo
On Wed, Nov 2, 2016 at 2:43 AM, Khurrum Nasim wrote: > As part of implementing the kafka subscriber interface, I am wondering is > there anyone use DL stream for storing the offsets? > > For example, if I have N streams (0..N-1), I need to track the read offset > for

Re: Use DL stream to store offsets?

2016-11-02 Thread Leigh Stewart
We have in fact built something like this. No plans as yet to release, but I think we would like to eventually. On Wed, Nov 2, 2016 at 2:43 AM, Khurrum Nasim wrote: > As part of implementing the kafka subscriber interface, I am wondering is > there anyone use DL stream

Use DL stream to store offsets?

2016-11-02 Thread Khurrum Nasim
As part of implementing the kafka subscriber interface, I am wondering is there anyone use DL stream for storing the offsets? For example, if I have N streams (0..N-1), I need to track the read offset for each stream and store them somewhere. I can probably use other external services (like any