gRPC

2016-08-01 Thread Jon Derrick
I saw the write proxy is using finagle and thrift for the wire protocol. but the finagle thrift seems to use a pretty old version of thrift. this seems to be a bit annoying when it is used in other thrift based services. Do you guys consider using gPRC as the wire protocol? Since bookkeeper wire p

Re: gRPC

2016-08-10 Thread Jon Derrick
The proxy layer isn't really tied to any protocol. It should be able to > support any network wire protocol. Can you file a DL jira for this? > > - Sijie > > On Mon, Aug 1, 2016 at 2:07 PM, Jon Derrick > wrote: > > > I saw the write proxy is using finagle and thrift

question about DL namespace

2016-08-15 Thread Jon Derrick
Hello all, I read the distributed log code closely. I found that the DL namespace is a flat namespace. There will be a potential issue if there are a lot of streams created under a same namespace. I am very curious what are the thoughts behind that. Here are some questions: - How many streams tha

Single writer and fencing

2016-09-12 Thread Jon Derrick
Hello all, If I understand correctly, the fencing mechanism (aka single-writer) is offered in distributedlog-core library. but the write proxy service doesn't offer such feature. I am wondering if there is any plan on adding fencing mechanism to write proxy. Is it in the roadmap of 0.4.0? -- -

Re: question about DL namespace

2016-09-12 Thread Jon Derrick
wrote: > > > Jon, > > > > Sorry for late response. This is a very good question. Comments in line. > > > > Sijie > > > > On Monday, August 15, 2016, Jon Derrick > > wrote: > > > > > Hello all, > > > > > > I read the

Etcd as the metadata store

2016-12-08 Thread Jon Derrick
Hi, I just found that there is a jira for integrating ectd as the metadata store. https://issues.apache.org/jira/browse/DL-48 And DL-117 is for stream metadata store. is DL-48 going to happen after DL-117 is landed? Is there anyone working on this?

Re: Proxy Client - Batch Ordering / Commit

2016-12-08 Thread Jon Derrick
On Fri, Nov 18, 2016 at 2:37 PM, Sijie Guo wrote: > On Thu, Nov 17, 2016 at 2:30 AM, Xi Liu wrote: > > > Cameron, > > > > Thank you for your comments. It's very helpful. My replies are inline. > > > > On Wed, Nov 16, 2016 at 11:59 AM, Cameron Hatfield > > wrote: > > > > > "A couple of questions

[DISCUSS] DP-6 - CAS Style Writes

2016-12-13 Thread Jon Derrick
Hi, I've been thinking about a DP to provide a CAS style write capability in DL. If you are interested, please check out: https://cwiki.apache.org/confluence/display/DL/DP-6+-+CAS+Style+Writes -- - jderrick

Re: [DISCUSS] DP-6 - CAS Style Writes

2016-12-14 Thread Jon Derrick
would happen. > I was thinking providing this in the distributedlog-core first and make it available in the service. So the functionality is available to both core library user and thin client user. No strong preference here. Let me know your suggestion. > > - Xi > > > On Tue, Dec 13

Re: [discuss] Official Slack or Gitter channel for Distributedlog

2016-12-14 Thread Jon Derrick
+1 for slack. On Wed, Dec 14, 2016 at 6:09 AM, Jia Zhai wrote: > +1 for slack > > On Wed, Dec 14, 2016 at 10:00 PM, Flavio Junqueira wrote: > > > I'm +1 for Slack. > > > > -Flavio > > > > > On 14 Dec 2016, at 08:32, Stevo Slavić wrote: > > > > > > Either works for me, as long as it's documente

Re: vote process for proposals?

2016-12-14 Thread Jon Derrick
I think it really worth having a voting proposal, as sometime I might lose track of if a proposal is accepted or not and whether it is under development. Beam's process looks promising. You can try to start with that. Another suggestion is it would be awesome if the DL jira queue can have new typ

Re: Is there a page like "who is using BK/DL"?

2016-12-14 Thread Jon Derrick
I would like to also know "what module are you using [core library, core library + proxy service]". On Fri, Dec 9, 2016 at 1:28 AM, Jia Zhai wrote: > Thanks for the suggestions. would like to collect some suggestions and > feedbacks here, then update the tickets. And will update the ticket at n

Re: [VOTE] Release 0.4.0, release candidate #2

2017-01-16 Thread Jon Derrick
+1 LGTM. compiled the source packages and ran dbench. the license files look good. - jd On Tue, Jan 10, 2017 at 11:56 PM, Sijie Guo wrote: > Hi all, > > Please review and vote on the release candidate #2 for the version 0.4.0, > as follows: > > [ ] +1, Approve the release > [ ] -1, Do not appr

Re: [VOTE] Merge DistributedLog as the subproject of Apache BookKeeper

2017-06-09 Thread Jon Derrick
+1 (non-binding) On Fri, Jun 9, 2017 at 9:39 AM, Gerrit Sundaram wrote: > +1 (non-binding) > > On Fri, Jun 9, 2017 at 9:38 AM, Xi Liu wrote: > > > +1 (non-binding) > > > > On Fri, Jun 9, 2017 at 3:21 AM, Jia Zhai wrote: > > > > > +1 (non-binding) > > > > > > On Fri, Jun 9, 2017 at 3:02 PM, Ste