[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt updated ZOOKEEPER-597: --- Affects Version/s: 3.1.1 3.2.1 Fix Version/s: 3.2.2 3.1.2 ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Affects Versions: 3.1.1, 3.2.1 Reporter: Patrick Hunt Assignee: Benjamin Reed Priority: Critical Fix For: 3.1.2, 3.2.2, 3.3.0 Attachments: ZOOKEEPER-597-3.1.patch, ZOOKEEPER-597-3.2.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597_2.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_4.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated ZOOKEEPER-597: Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this to 3.1 and 3.2 branches. ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Benjamin Reed Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597-3.1.patch, ZOOKEEPER-597-3.2.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597_2.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_4.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated ZOOKEEPER-597: Attachment: ZOOKEEPER-597-3.2.patch patch for 3.2 release. ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Benjamin Reed Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597-3.1.patch, ZOOKEEPER-597-3.2.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597_2.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_4.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated ZOOKEEPER-597: Attachment: ZOOKEEPER-597-3.1.patch patch for 3.1 release. ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Benjamin Reed Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597-3.1.patch, ZOOKEEPER-597-3.2.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597_2.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_4.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt updated ZOOKEEPER-597: --- Status: Open (was: Patch Available) this is still happening, but in another area: http://hudson.zones.apache.org/hudson/view/ZooKeeper/job/ZooKeeper-trunk/577/testReport/org.apache.zookeeper.test/AsyncHammerTest/testObserversHammer/ It is good to have the handler here! 2009-12-04 13:46:13,493 - ERROR [CommitProcessor:0:commitproces...@146] - Unexpected exception causing CommitProcessor to exit java.nio.channels.CancelledKeyException at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55) at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:64) at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:378) at org.apache.zookeeper.server.NIOServerCnxn.sendCloseSession(NIOServerCnxn.java:349) at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:356) at org.apache.zookeeper.server.quorum.Leader$ToBeAppliedRequestProcessor.processRequest(Leader.java:532) at org.apache.zookeeper.server.quorum.CommitProcessor.run(CommitProcessor.java:73) ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Benjamin Reed Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597_2.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_3.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated ZOOKEEPER-597: Attachment: ZOOKEEPER-597_4.patch this patch fixes the 2 latest failuires we saw: - http://bugs.sun.com/view_bug.do?bug_id=6427854, a bug in the jvm which is fixed by a selector.open.close() call in a static block in NIOServerCnxn (thanks ben for the idea) - the other cancelled key exception is fixed by wrapping sendbuffer with try catch for exceptions. i looked for any other calls that can cause commitprocessor to fail in this way and could not find anything else. hopefully this is the last of such problems. ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Benjamin Reed Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597_2.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_4.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated ZOOKEEPER-597: Status: Patch Available (was: Open) ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Benjamin Reed Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597_2.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_4.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Reed updated ZOOKEEPER-597: Attachment: ZOOKEEPER-597_3.patch this installs an uncaught exception handler for all threads. ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Benjamin Reed Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597_2.patch, ZOOKEEPER-597_3.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Reed updated ZOOKEEPER-597: Attachment: ZOOKEEPER-597_3.patch this patch removes the deadlock and the useless flag that was causing the deadlock and installs a default uncaught exception handler. ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Benjamin Reed Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597_2.patch, ZOOKEEPER-597_3.patch, ZOOKEEPER-597_3.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Reed updated ZOOKEEPER-597: Status: Open (was: Patch Available) ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Patrick Hunt Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch, ZOOKEEPER-597.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Reed updated ZOOKEEPER-597: Status: Patch Available (was: Open) ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Patrick Hunt Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch, ZOOKEEPER-597.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Reed updated ZOOKEEPER-597: Attachment: ZOOKEEPER-597.patch changes to cache Exception not Throwable. ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Patrick Hunt Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Reed updated ZOOKEEPER-597: Assignee: Benjamin Reed (was: Patrick Hunt) Status: Patch Available (was: Open) ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Benjamin Reed Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt updated ZOOKEEPER-597: --- Attachment: ZOOKEEPER-597_2.patch log the throwable if commit rp exits ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Benjamin Reed Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597.patch, ZOOKEEPER-597_2.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Reed updated ZOOKEEPER-597: Status: Patch Available (was: Reopened) ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Patrick Hunt Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch, ZOOKEEPER-597.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Reed updated ZOOKEEPER-597: Attachment: ZOOKEEPER-597.patch A runtime exception was killing the CommitProcessor. ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Patrick Hunt Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch, ZOOKEEPER-597.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt updated ZOOKEEPER-597: --- Attachment: ZOOKEEPER-597.patch this patch updates the test to log the threads/stacks if an error occurrs during session est. ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated ZOOKEEPER-597: Status: Patch Available (was: Open) ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Patrick Hunt Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (ZOOKEEPER-597) ASyncHammerTest is failing intermittently on hudson trunk
[ https://issues.apache.org/jira/browse/ZOOKEEPER-597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated ZOOKEEPER-597: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) I just committed this. thanks pat. ASyncHammerTest is failing intermittently on hudson trunk - Key: ZOOKEEPER-597 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-597 Project: Zookeeper Issue Type: Bug Components: tests Reporter: Patrick Hunt Assignee: Patrick Hunt Priority: Critical Fix For: 3.3.0 Attachments: ZOOKEEPER-597.patch ASyncHammerTest is failing intermittently on hudson trunk. There is no clear reason why this is happening, but it seems from the logs that a session connection to a follower is failing during session establishment - the failure seems to be a problem either on the follower or leader. The server gets the session create request, but it stalls in the request processor pipeline. (we see it go in, but we do not see it com eout) unfortunately all efforts to reproduce this on non-hudson trunk have failed. Even trying to reproduce by running on hudson host itself (manually) has failed. We need to instrument the client session creation code in the test to dump the thread stack if the session creation fails. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.