Re: ZK subscription store

2016-12-28 Thread Jay Juma
Sijie, Thank you for your reply. I created a proposal about using log segment to store the subscription updates for the subscription store. https://cwiki.apache.org/confluence/display/DL/DP-7+-+LogSegment+based+subscription+store Let me know if you have any suggestions. - Jay On Thu, Dec 15, 2

Re: ZK subscription store

2016-12-15 Thread Sijie Guo
Hmm, this is a good idea. yes, we can use a log segment to store the DLSN changes for the subscription store. And I think that's basically how Pulsar is doing with its cursors. beside this, I had a brief discussion with Matteo Merli (who is the TL of Pulsar) about distributedlog and managedledger

ZK subscription store

2016-12-14 Thread Jay Juma
Hi, Currently there is a zookeeper based subscription store in DL. Why can't DL store it using a log segment (ledger) and offer this capability in distributedlog service? - Jay