[jira] Commented: (ZOOKEEPER-29) Flexible quorums

2009-04-08 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-29?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697378#action_12697378 ] Mahadev konar commented on ZOOKEEPER-29: flavio, can you elaborate on what else

[jira] Commented: (ZOOKEEPER-29) Flexible quorums

2009-04-08 Thread Flavio Paiva Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-29?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697364#action_12697364 ] Flavio Paiva Junqueira commented on ZOOKEEPER-29: - Thanks for you comment

[jira] Commented: (ZOOKEEPER-355) make validatePath non public in Zookeeper client api.

2009-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697348#action_12697348 ] Hadoop QA commented on ZOOKEEPER-355: - +1 overall. Here are the results of testing

[jira] Commented: (ZOOKEEPER-78) added a high level protocol/feature - for easy Leader Election or exclusive Write Lock creation

2009-04-08 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697346#action_12697346 ] Patrick Hunt commented on ZOOKEEPER-78: --- running doxygen-doc doesn't result in any

[jira] Commented: (ZOOKEEPER-78) added a high level protocol/feature - for easy Leader Election or exclusive Write Lock creation

2009-04-08 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697343#action_12697343 ] Patrick Hunt commented on ZOOKEEPER-78: --- comments on the c code: the api methods a

[jira] Commented: (ZOOKEEPER-369) remove multiple configs in server/quorums.

2009-04-08 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697294#action_12697294 ] Patrick Hunt commented on ZOOKEEPER-369: It would be great if we could ping the

[jira] Commented: (ZOOKEEPER-78) added a high level protocol/feature - for easy Leader Election or exclusive Write Lock creation

2009-04-08 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697277#action_12697277 ] Patrick Hunt commented on ZOOKEEPER-78: --- These comments are relative to the java co

RE: Preventing SessionExpired events

2009-04-08 Thread Benjamin Reed
I'm curious about your session scenario. If your servers can hang for X seconds without a problem and Y is your session timeout, why would you set Y < X? In your case if you set your session timeout to 5 secs for example, but your server can hang for 20 seconds doing GC, your clients cannot expe

[jira] Updated: (ZOOKEEPER-347) zkfuse uses non-standard String

2009-04-08 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated ZOOKEEPER-347: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch

[jira] Commented: (ZOOKEEPER-29) Flexible quorums

2009-04-08 Thread Stu Hood (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-29?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697220#action_12697220 ] Stu Hood commented on ZOOKEEPER-29: --- Two comments: This ticket seems to overlap

[jira] Updated: (ZOOKEEPER-370) Fix critical problems reported by findbugs

2009-04-08 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated ZOOKEEPER-370: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch

Re: Preventing SessionExpired events

2009-04-08 Thread Patrick Hunt
I see what you are saying, that's interesting. As Mahadev mentioned on another thread, we'd be interested to look at the JNI you've done. Perhaps we will need to include this as an option (and document where it's necessary, etc...) for other users who might run into this. Thanks much for bring

[jira] Commented: (ZOOKEEPER-370) Fix critical problems reported by findbugs

2009-04-08 Thread Flavio Paiva Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697203#action_12697203 ] Flavio Paiva Junqueira commented on ZOOKEEPER-370: -- These are just smal

Re: Preventing SessionExpired events

2009-04-08 Thread Joey Echeverria
Nitay is correct about the native threads. Using the pure Java API, the garbage collector will occasionally pause other Java threads to do a full mark and sweep. Even switching to the concurrent collector only delays the problem. The issues is mixing a high throughput application (HBase) with a low

Re: Preventing SessionExpired events

2009-04-08 Thread Mahadev Konar
Nitay, Thanks for sending us the info. We have experienced such gc problem in our HDFS (hadoop file system) setups. The gc had been quite a problem for us with the Namenode (hadoop hdfs) process. We have seen the namenode just stalling for minutes doing garbage collection. We currently run the nam

Re: Preventing SessionExpired events

2009-04-08 Thread Nitay
The default session timeout in HBase is currently 10 seconds. Bumping it up to 30 and 60 reduced SessionExpired exceptions, according to Andrew. I believe Andrew did run it under jconsole. He was also tuning GC parameters. He mentioned running using incremental garbage collector (-XX:+UseConcMarkSw

[jira] Commented: (ZOOKEEPER-29) Flexible quorums

2009-04-08 Thread Flavio Paiva Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-29?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697182#action_12697182 ] Flavio Paiva Junqueira commented on ZOOKEEPER-29: - Mahadev, I'm ok with m

Re: Preventing SessionExpired events

2009-04-08 Thread Patrick Hunt
This is good to know. It will allow us to try an replicate the situation, which we haven't been able to do. I'm hoping we can come up with something that we can proactively do to address this... Patrick Nitay wrote: Also, I should mention that some of the errors Andrew was seeing are relate

Re: Preventing SessionExpired events

2009-04-08 Thread Patrick Hunt
What are you running for a session timeout on your clients? Can you run with something like jvisualvm or jconsole, and watch the gc activity when the session timeouts occur? Might give you some insight. Have you tried one of the alternative GC's available in the VM? http://developer.amd.com/doc

Re: Preventing SessionExpired events

2009-04-08 Thread Nitay
Also, I should mention that some of the errors Andrew was seeing are related to ZOOKEEPER-344: I see this kind of stuff: 2009-04-07 17:58:13,344 - WARN [NIOServerCxn.Factory:2181: nioserverc...@417] - Exception causing close of session 0x2208296c38e due to java.io.IOException: Read error a

[jira] Commented: (ZOOKEEPER-370) Fix critical problems reported by findbugs

2009-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697162#action_12697162 ] Hadoop QA commented on ZOOKEEPER-370: - -1 overall. Here are the results of testing

Preventing SessionExpired events

2009-04-08 Thread Nitay
Hey guys, We've recently replaced a few pieces of HBase's cluster management and coordination with ZooKeeper. One of guys, Andrew Purtell, has a cluster that he throws a lot of load at. Andrew's cluster was getting a lot of SessionExpired events which were causing some havoc. After some discussion

[jira] Updated: (ZOOKEEPER-78) added a high level protocol/feature - for easy Leader Election or exclusive Write Lock creation

2009-04-08 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-78?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated ZOOKEEPER-78: --- Attachment: ZOOKEEPER-78.patch i attached header files to package.html makefile.am configur

[jira] Commented: (ZOOKEEPER-78) added a high level protocol/feature - for easy Leader Election or exclusive Write Lock creation

2009-04-08 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697127#action_12697127 ] Patrick Hunt commented on ZOOKEEPER-78: --- This first set of comments is relative to

[jira] Commented: (ZOOKEEPER-29) Flexible quorums

2009-04-08 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-29?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697112#action_12697112 ] Mahadev konar commented on ZOOKEEPER-29: flavio, i just took a cursory look at th

[jira] Updated: (ZOOKEEPER-29) Flexible quorums

2009-04-08 Thread Flavio Paiva Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-29?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flavio Paiva Junqueira updated ZOOKEEPER-29: Attachment: ZOOKEEPER-29.patch This new patch is partially functional. Fa

[jira] Commented: (ZOOKEEPER-347) zkfuse uses non-standard String

2009-04-08 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697080#action_12697080 ] Patrick Hunt commented on ZOOKEEPER-347: this fixes a C code gcc compiler warnin

[jira] Created: (ZOOKEEPER-371) to implement jdiff

2009-04-08 Thread Giridharan Kesavan (JIRA)
to implement jdiff --- Key: ZOOKEEPER-371 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-371 Project: Zookeeper Issue Type: Improvement Components: build Affects Versions: 3.2.0 Environment: to i

[jira] Commented: (ZOOKEEPER-78) added a high level protocol/feature - for easy Leader Election or exclusive Write Lock creation

2009-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12696986#action_12696986 ] Hadoop QA commented on ZOOKEEPER-78: -1 overall. Here are the results of testing the

[jira] Updated: (ZOOKEEPER-370) Fix critical problems reported by findbugs

2009-04-08 Thread Flavio Paiva Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flavio Paiva Junqueira updated ZOOKEEPER-370: - Status: Patch Available (was: Open) > Fix critical problems reported

[jira] Updated: (ZOOKEEPER-370) Fix critical problems reported by findbugs

2009-04-08 Thread Flavio Paiva Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flavio Paiva Junqueira updated ZOOKEEPER-370: - Status: Open (was: Patch Available) There is no hudson report after M

[jira] Commented: (ZOOKEEPER-347) zkfuse uses non-standard String

2009-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12696925#action_12696925 ] Hadoop QA commented on ZOOKEEPER-347: - -1 overall. Here are the results of testing