Re: Questions about Hedwig architecture

2010-11-16 Thread amit jaiswal
rwin On Thu, 2010-11-04 at 08:02 -0700, Mahadev Konar wrote: > Flavio, Ben, Adam, Erwin? > > Can you guys please respond on zookeeper-user mailing list? > > Thanks > mahadev > > > On 11/2/10 11:06 PM, "amit jaiswal" wrote: > > > Hi, > > >

Questions about Hedwig architecture

2010-11-02 Thread amit jaiswal
Hi, I am trying to understand hedwig. I tried reading the documentation user.txt, dev.txt along with the code but still some design aspects are not clear. Can someone please tell the following: (Lets say there are 2 regions A and B) 1. When a subscriber X subscribes to topic T in region A, th

[hedwig] Can multiple publishers publish to the same topic simultaneously

2010-10-26 Thread amit jaiswal
Hi, In hedwig, how many publishers can publish to a particular topic simultaneously. Any concerns / important points on message ordering? -regards Amit

Recovery from a complete node failure in BookKeeper

2010-10-22 Thread amit jaiswal
Hi, There is a class BookKeeperTools that has methods for complete recovery of a node. The recovery of dead bookie involves updating zk first with the replacement bookie and then replicating the necessary ledger entries. So, if the recovery process / target bookie dies before the actual entrie

Re: Is it possible to read/write a ledger concurrently

2010-10-21 Thread amit jaiswal
that information. we have talked about a way to push the last entry into the bookkeeper handle. flavio was working on it, but i don't think it has been implemented. ben On 10/21/2010 10:22 PM, amit jaiswal wrote: > Hi, > > In BookKeeper documentation, the sample program creates a

Is it possible to read/write a ledger concurrently

2010-10-21 Thread amit jaiswal
Hi, In BookKeeper documentation, the sample program creates a ledger, writes some entries and then *closes* the ledger. Then a client program opens the ledger, and reads the entries from it. Is it possible for program1 to write to a ledger, and program2 to read from the ledger at the same time

Question on production readiness, deployment, data of BookKeeper / Hedwig

2010-10-05 Thread amit jaiswal
Hi, In Hedwig talk (http://vimeo.com/13282102), it was mentioned that the primary use case for Hedwig comes from the distributed key-value store PNUTS in Yahoo!, but also said that the work is new. Could you please about the following: Production readiness / Deployment 1. What is the productio

Re: BookKeeper newbie question

2010-10-02 Thread amit jaiswal
Hi, After going through the hedwig/doc section, I was able to run hedwig server and sample client (though still there are issues). Any more documentation that refers to the APIs will be helpful. -regards Amit - Original Message From: amit jaiswal To: zookeeper-user

Re: BookKeeper newbie question

2010-10-02 Thread amit jaiswal
Amit - Original Message From: Flavio Junqueira To: "zookeeper-user@hadoop.apache.org" Sent: Fri, 1 October, 2010 2:37:35 PM Subject: Re: BookKeeper newbie question Thanks for your questions, Amit. On Sep 28, 2010, at 6:37 PM, amit jaiswal wrote: > Hi, > > I am exper

Re: BookKeeper newbie question

2010-09-30 Thread amit jaiswal
Hi, Can somebody please answer this query. -regards Amit - Original Message From: amit jaiswal To: zookeeper-user@hadoop.apache.org Sent: Tue, 28 September, 2010 10:07:33 PM Subject: BookKeeper newbie question Hi, I am experimenting with BookKeeper and have a question on

BookKeeper newbie question

2010-09-28 Thread amit jaiswal
Hi, I am experimenting with BookKeeper and have a question on LedgerHandler class. The readEntries(firstEntry, lastEntry) method takes the indexes of first and last entries. Also, the LedgerSequence object returned has method hasMoreElements(). Question: 1. How does a client knows the index of