Re: Running cluster behind load balancer

2010-11-04 Thread Chang Song
I would like to add some info on this. This may not be very important, but there are subtle differences. Two cases: 1. server hardware failure or kernel panic 2. zookeeper Java daemon process down In former one, timeout will be based on the timeout argument in

Re: Running cluster behind load balancer

2010-11-04 Thread Chang Song
Sorry. I made a mistake on retry timeout in load balancer section of my answer. The same timeout applies to load balancer case as well (depends on the recv timeout) Thank you Chang On Nov 4, 2010, at 10:22 PM, Chang Song wrote: I would like to add some info on this. This may not be

Re: JUnit tests do not produce logs if the JVM crashes

2010-11-04 Thread Mahadev Konar
Hi Andras, Junit unit will always buffer the logs unless you print it out to console. To do that, try running this ant test -Dtest.output=yes This will print out the logs to console as they are logged. Thanks mahadev On 11/4/10 3:33 AM, András Kövi allp...@gmail.com wrote: Hi all, I'm

Re: Running cluster behind load balancer

2010-11-04 Thread Patrick Hunt
Hi Chang, thanks for the insights, if you have a few minutes would you mind updating the FAQ with some of this detail? http://wiki.apache.org/hadoop/ZooKeeper/FAQ Thanks! Patrick On Thu, Nov 4, 2010 at 6:27 AM, Chang Song tru64...@me.com wrote: Sorry. I made a mistake on retry timeout in load

Re: JUnit tests do not produce logs if the JVM crashes

2010-11-04 Thread Patrick Hunt
In addition to what Mahadev suggested you can also change the log4j.properties to log to a file rather than the CONSOLE. Although that just redirects the logs, if there is some output to stdout/stderr then junit buffering is still in play. Patrick On Thu, Nov 4, 2010 at 8:15 AM, Mahadev Konar

Re: Running cluster behind load balancer

2010-11-04 Thread Benjamin Reed
one thing to note: the if you are using a DNS load balancer, some load balancers will return the list of resolved addresses in different orders to do the balancing. the zookeeper client will shuffle that list before it it used, so in reality, using a single DNS hostname resolving to all the

Re: Questions about Hedwig architecture

2010-11-04 Thread Erwin Tam
Hi Amit, sorry for the late responses to your Hedwig questions. I just joined the mailing list so hopefully I can shed some light on things. First, here's a response to a question you posted last month that I don't think has been answered In hedwig, how many publishers can publish to a

Re: Running cluster behind load balancer

2010-11-04 Thread Chang Song
Benjamin. It looks like ZK clients can handle a list of IPs from DNS query correctly. Yes you are right. I am updating wiki per Patrick's request. Thanks a lot. Chang On Nov 5, 2010, at 1:10 AM, Benjamin Reed wrote: one thing to note: the if you are using a DNS load balancer, some load

Re: Running cluster behind load balancer

2010-11-04 Thread Patrick Hunt
Great, thanks! On Thu, Nov 4, 2010 at 10:04 PM, Chang Song tru64...@me.com wrote: Benjamin. It looks like ZK clients can handle a list of IPs from DNS query correctly. Yes you are right. I am updating wiki per Patrick's request. Thanks a lot. Chang On Nov 5, 2010, at 1:10 AM,