[jira] [Commented] (ZOOKEEPER-1525) Plumb ZooKeeperServer object into auth plugins
[ https://issues.apache.org/jira/browse/ZOOKEEPER-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529642#comment-14529642 ] Tim Crowder commented on ZOOKEEPER-1525: Hi Michi- I finally managed to create https://reviews.apache.org/r/33874/ Please let me know if you have any questions. Thanks! .timrc Plumb ZooKeeperServer object into auth plugins -- Key: ZOOKEEPER-1525 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1525 Project: ZooKeeper Issue Type: Improvement Affects Versions: 3.5.0 Reporter: Warren Turkal Assignee: Warren Turkal Fix For: 3.5.2, 3.6.0 Attachments: ZOOKEEPER-1525.patch, ZOOKEEPER-1525.patch, ZOOKEEPER-1525.patch I want to plumb the ZooKeeperServer object into the auth plugins so that I can store authentication data in zookeeper itself. With access to the ZooKeeperServer object, I also have access to the ZKDatabase and can look up entries in the local copy of the zookeeper data. In order to implement this, I make sure that a ZooKeeperServer instance is passed in to the ProviderRegistry.initialize() method. Then initialize() will try to find a constructor for the AuthenticationProvider that takes a ZooKeeperServer instance. If the constructor is found, it will be used. Otherwise, initialize() will look for a constructor that takes no arguments and use that instead. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: making CI a more pleasant experience
That's a good idea. I would think that PortAssignment could be modified to give out truly unique ports (rather than starting from a given seed) in ways that some other projects do. Agree that our current mechanism is naive - the problem you mention (multiple jvms and running on the same host resulting port conflicts in the tests) is an annoying one that I've run into myself. Patrick On Mon, May 4, 2015 at 2:13 PM, Chris Nauroth cnaur...@hortonworks.com wrote: Another possibility for speeding up pre-commit runs might be to execute JUnit tests in parallel. In build.xml, we'd specify the threads attribute on the junit task to start multiple JUnit processes. This requires Ant 1.9.4. https://ant.apache.org/manual/Tasks/junit.html It's not as simple as just deploying Ant 1.9.4 and turning it on though. We'd need to make sure that test suites are capable of running concurrently. They'd need isolated working directories, port numbers, etc. Right now, the PortAssignment class hands out port numbers that are guaranteed to be unique within the same process, but not across multiple processes. I just tried it locally, and many tests failed on bind exceptions. (This is actually a potential problem already if multiple ZooKeeper pre-commit runs execute concurrently on the same Jenkins host.) I'll investigate if we can change tests to bind to ephemeral ports, which would give us uniqueness across multiple processes. --Chris Nauroth On 5/3/15, 10:10 PM, Patrick Hunt ph...@apache.org wrote: I've pushed back on use of sleep in non-deterministic ways in the past. I think we do a reasonable job there, just grepping for sleep doesn't tell the story. Where you run into issues is when you do x sleep(500) check x was success Most of our use of sleep has migrated to do x for (1 to 120) // or check elapsed time and cap at some large number sleep(500) // make sufficiently small that you don't waste time waiting unnecessarily, but also not too short that you spin check x was success unless we were able to make due without a time bound at all - sometimes we migrate to a latch or something. Now it's been a while since I reviewed the tests, new code might have added some bad checks again, it's a tough one to stamp out entirely. Re tests taking too long, I can't seem to find the jira, but iirc Henry had created a jira around reducing the tick time for tests - that significantly reduced the setup time for quorum based tests - a big part of overall overhead. We should probably categorize our tests and run a subset outside of a nightly full test run. Patrick On Sun, May 3, 2015 at 9:49 PM, Raúl Gutiérrez Segalés r...@itevenworks.net wrote: Hi, On 3 May 2015 at 12:53, Chris Nauroth cnaur...@hortonworks.com wrote: () 3. Tests are non-deterministic, such as by hard-coding a sleep time to wait for an asynchronous action to complete. The solutions usually involve providing hooks into lower-layer logic, such as to receive a callback from the asynchronous action, so that the test can be deterministic. Indeed: ~/src/zookeeper-svn/src/java/test/org/apache/zookeeper (master) ✔ git grep -i 'sleep(' | wc -l 91 Making runs shorter would be very helpful as well. Currently it just takes too long. Also, adding to what Patrick said, I'll take a closer look at the runs reported at: https://builds.apache.org/job/PreCommit-ZOOKEEPER-Build/ to have a better grasp of what's going on. Thanks! -rgs
[jira] [Commented] (ZOOKEEPER-2153) X509 Authentication Documentation
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528838#comment-14528838 ] Hongchao Deng commented on ZOOKEEPER-2153: -- I was busy for a talk before.. Let me do the delayed commit. Thanks [~rakeshr] for the review, [~iandi] for the work. X509 Authentication Documentation - Key: ZOOKEEPER-2153 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2153 Project: ZooKeeper Issue Type: Sub-task Affects Versions: 3.5.0 Reporter: Hongchao Deng Assignee: Ian Dimayuga Fix For: 3.5.1, 3.6.0 Attachments: ZOOKEEPER-2153.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (ZOOKEEPER-2153) X509 Authentication Documentation
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongchao Deng resolved ZOOKEEPER-2153. -- Resolution: Fixed Committed to: trunk: https://github.com/apache/zookeeper/commit/ea5abdb82d2e2bc4ed0559420b109da35b30bfca branch-3.5: https://github.com/apache/zookeeper/commit/da4d934b89fece39401230a6c26ce61715427960 X509 Authentication Documentation - Key: ZOOKEEPER-2153 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2153 Project: ZooKeeper Issue Type: Sub-task Affects Versions: 3.5.0 Reporter: Hongchao Deng Assignee: Ian Dimayuga Fix For: 3.5.1, 3.6.0 Attachments: ZOOKEEPER-2153.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ZOOKEEPER-2176) unclear error message should be info or warn
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528739#comment-14528739 ] Hongchao Deng commented on ZOOKEEPER-2176: -- The patch is trivial and LGTM. +1 I will commit this shortly. unclear error message should be info or warn Key: ZOOKEEPER-2176 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2176 Project: ZooKeeper Issue Type: Improvement Components: quorum Affects Versions: 3.5.0, 3.5.1, 3.5.2 Reporter: Raul Gutierrez Segales Assignee: Raul Gutierrez Segales Attachments: ZOOKEEPER-2176.patch Hi [~shralex], Looking at the CI output of ZOOKEEPER-2163 I see this: {noformat} [exec] [junit] 2015-04-17 17:36:23,750 [myid:] - ERROR [QuorumPeer[myid=4](plain=/0:0:0:0:0:0:0:0:11235)(secure=disabled):QuorumPeer@1394] - writeToDisk == true but configFilename == null {noformat} Though looking at QuorumPeer#setQuorumVerifier I see: {noformat} if (configFilename != null) { try { String dynamicConfigFilename = makeDynamicConfigFilename( qv.getVersion()); QuorumPeerConfig.writeDynamicConfig( dynamicConfigFilename, qv, false); QuorumPeerConfig.editStaticConfig(configFilename, dynamicConfigFilename, needEraseClientInfoFromStaticConfig()); } catch (IOException e) { LOG.error(Error closing file: , e.getMessage()); } } else { LOG.error(writeToDisk == true but configFilename == null); } {noformat} there's no proper error handling so I guess maybe we should just make it a warning? Thoughts? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ZOOKEEPER-2176) Unclear error message should be info not error
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongchao Deng updated ZOOKEEPER-2176: - Affects Version/s: (was: 3.5.2) (was: 3.5.1) Unclear error message should be info not error -- Key: ZOOKEEPER-2176 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2176 Project: ZooKeeper Issue Type: Improvement Components: quorum Affects Versions: 3.5.0 Reporter: Raul Gutierrez Segales Assignee: Raul Gutierrez Segales Fix For: 3.5.1, 3.6.0 Attachments: ZOOKEEPER-2176.patch Hi [~shralex], Looking at the CI output of ZOOKEEPER-2163 I see this: {noformat} [exec] [junit] 2015-04-17 17:36:23,750 [myid:] - ERROR [QuorumPeer[myid=4](plain=/0:0:0:0:0:0:0:0:11235)(secure=disabled):QuorumPeer@1394] - writeToDisk == true but configFilename == null {noformat} Though looking at QuorumPeer#setQuorumVerifier I see: {noformat} if (configFilename != null) { try { String dynamicConfigFilename = makeDynamicConfigFilename( qv.getVersion()); QuorumPeerConfig.writeDynamicConfig( dynamicConfigFilename, qv, false); QuorumPeerConfig.editStaticConfig(configFilename, dynamicConfigFilename, needEraseClientInfoFromStaticConfig()); } catch (IOException e) { LOG.error(Error closing file: , e.getMessage()); } } else { LOG.error(writeToDisk == true but configFilename == null); } {noformat} there's no proper error handling so I guess maybe we should just make it a warning? Thoughts? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ZOOKEEPER-2176) Unclear error message should be info not error
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongchao Deng updated ZOOKEEPER-2176: - Summary: Unclear error message should be info not error (was: unclear error message should be info or warn) Unclear error message should be info not error -- Key: ZOOKEEPER-2176 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2176 Project: ZooKeeper Issue Type: Improvement Components: quorum Affects Versions: 3.5.0 Reporter: Raul Gutierrez Segales Assignee: Raul Gutierrez Segales Fix For: 3.5.1, 3.6.0 Attachments: ZOOKEEPER-2176.patch Hi [~shralex], Looking at the CI output of ZOOKEEPER-2163 I see this: {noformat} [exec] [junit] 2015-04-17 17:36:23,750 [myid:] - ERROR [QuorumPeer[myid=4](plain=/0:0:0:0:0:0:0:0:11235)(secure=disabled):QuorumPeer@1394] - writeToDisk == true but configFilename == null {noformat} Though looking at QuorumPeer#setQuorumVerifier I see: {noformat} if (configFilename != null) { try { String dynamicConfigFilename = makeDynamicConfigFilename( qv.getVersion()); QuorumPeerConfig.writeDynamicConfig( dynamicConfigFilename, qv, false); QuorumPeerConfig.editStaticConfig(configFilename, dynamicConfigFilename, needEraseClientInfoFromStaticConfig()); } catch (IOException e) { LOG.error(Error closing file: , e.getMessage()); } } else { LOG.error(writeToDisk == true but configFilename == null); } {noformat} there's no proper error handling so I guess maybe we should just make it a warning? Thoughts? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ZOOKEEPER-2176) Unclear error message should be info not error
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongchao Deng updated ZOOKEEPER-2176: - Fix Version/s: 3.6.0 3.5.1 Unclear error message should be info not error -- Key: ZOOKEEPER-2176 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2176 Project: ZooKeeper Issue Type: Improvement Components: quorum Affects Versions: 3.5.0 Reporter: Raul Gutierrez Segales Assignee: Raul Gutierrez Segales Fix For: 3.5.1, 3.6.0 Attachments: ZOOKEEPER-2176.patch Hi [~shralex], Looking at the CI output of ZOOKEEPER-2163 I see this: {noformat} [exec] [junit] 2015-04-17 17:36:23,750 [myid:] - ERROR [QuorumPeer[myid=4](plain=/0:0:0:0:0:0:0:0:11235)(secure=disabled):QuorumPeer@1394] - writeToDisk == true but configFilename == null {noformat} Though looking at QuorumPeer#setQuorumVerifier I see: {noformat} if (configFilename != null) { try { String dynamicConfigFilename = makeDynamicConfigFilename( qv.getVersion()); QuorumPeerConfig.writeDynamicConfig( dynamicConfigFilename, qv, false); QuorumPeerConfig.editStaticConfig(configFilename, dynamicConfigFilename, needEraseClientInfoFromStaticConfig()); } catch (IOException e) { LOG.error(Error closing file: , e.getMessage()); } } else { LOG.error(writeToDisk == true but configFilename == null); } {noformat} there's no proper error handling so I guess maybe we should just make it a warning? Thoughts? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ZOOKEEPER-2153) X509 Authentication Documentation
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongchao Deng updated ZOOKEEPER-2153: - Fix Version/s: 3.6.0 3.5.1 X509 Authentication Documentation - Key: ZOOKEEPER-2153 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2153 Project: ZooKeeper Issue Type: Sub-task Affects Versions: 3.5.0 Reporter: Hongchao Deng Assignee: Ian Dimayuga Fix For: 3.5.1, 3.6.0 Attachments: ZOOKEEPER-2153.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ZOOKEEPER-2153) X509 Authentication Documentation
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongchao Deng updated ZOOKEEPER-2153: - Affects Version/s: 3.5.0 X509 Authentication Documentation - Key: ZOOKEEPER-2153 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2153 Project: ZooKeeper Issue Type: Sub-task Affects Versions: 3.5.0 Reporter: Hongchao Deng Assignee: Ian Dimayuga Fix For: 3.5.1, 3.6.0 Attachments: ZOOKEEPER-2153.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
ZooKeeper-trunk-WinVS2008 - Build # 1788 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-WinVS2008/1788/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 107 lines...] [javacc] File SimpleCharStream.java does not exist. Will create one. [javacc] Parser generated successfully. jute: [javac] Compiling 39 source files to f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\build\classes compile_jute_uptodate: compile_jute: [mkdir] Created dir: f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\java\generated [mkdir] Created dir: f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\generated [java] ../../zookeeper.jute Parsed Successfully [java] ../../zookeeper.jute Parsed Successfully [touch] Creating f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\java\generated\.generated BUILD SUCCESSFUL Total time: 8 seconds [ZooKeeper-trunk-WinVS2008] $ cmd /c call C:\Windows\TEMP\hudson8579981705659500275.bat f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008set ZOOKEEPER_HOME=f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008msbuild trunk/src/c/zookeeper.sln /p:Configuration=Release Microsoft (R) Build Engine version 4.0.30319.18408 [Microsoft .NET Framework, version 4.0.30319.18444] Copyright (C) Microsoft Corporation. All rights reserved. Building the projects in this solution one at a time. To enable parallel build, please add the /m switch. Build started 5/5/2015 9:23:32 AM. Project f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln on node 1 (default targets). ValidateSolutionConfiguration: Building solution configuration Release|Win32. zookeeper: C:\Program Files (x86)\Microsoft Visual Studio 9.0\Common7\IDE\..\..\vc\vcpackages\VCBuild.exe f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.vcproj Release|Win32 cl : Command line warning D9035: option 'Wp64' has been deprecated and will be removed in a future release [f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln] .\src\zookeeper.c(43): fatal error C1083: Cannot open include file: 'unistd.h': No such file or directory [f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln] Cli: C:\Program Files (x86)\Microsoft Visual Studio 9.0\Common7\IDE\..\..\vc\vcpackages\VCBuild.exe f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\Cli.vcproj Release|Win32 Done Building Project f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln (default targets) -- FAILED. Build FAILED. f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln (default target) (1) - (zookeeper target) - cl : Command line warning D9035: option 'Wp64' has been deprecated and will be removed in a future release [f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln] f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln (default target) (1) - (zookeeper target) - .\src\zookeeper.c(43): fatal error C1083: Cannot open include file: 'unistd.h': No such file or directory [f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln] 1 Warning(s) 1 Error(s) Time Elapsed 00:00:05.74 f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008exit 1 Build step 'Execute Windows batch command' marked build as failure Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
ZooKeeper-trunk-solaris - Build # 1022 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-solaris/1022/ ### ## LAST 60 LINES OF THE CONSOLE ### Started by timer Building remotely on solaris1 (Solaris) in workspace /export/home/hudson/hudson-slave/workspace/ZooKeeper-trunk-solaris Updating http://svn.apache.org/repos/asf/zookeeper/trunk at revision '2015-05-05T08:31:14.575 +' U src/java/test/org/apache/zookeeper/RemoveWatchesTest.java U CHANGES.txt At revision 1677751 Updating http://svn.apache.org/repos/asf/hadoop/nightly at revision '2015-05-05T08:31:14.575 +' At revision 1677751 no change for http://svn.apache.org/repos/asf/hadoop/nightly since the previous build No emails were triggered. [locks-and-latches] Checking to see if we really have the locks [locks-and-latches] Have all the locks, build can start [ZooKeeper-trunk-solaris] $ /bin/bash /var/tmp/hudson960256447024272297.sh /var/tmp/hudson960256447024272297.sh: line 12: ant: command not found Build step 'Execute shell' marked build as failure [locks-and-latches] Releasing all the locks [locks-and-latches] All the locks released Recording test results Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
ZooKeeper_branch34_solaris - Build # 996 - Failure
See https://builds.apache.org/job/ZooKeeper_branch34_solaris/996/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 172643 lines...] [junit] 2015-05-05 07:58:42,708 [myid:] - INFO [main:JMXEnv@246] - expect:StandaloneServer_port [junit] 2015-05-05 07:58:42,708 [myid:] - INFO [main:JMXEnv@250] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2015-05-05 07:58:42,708 [myid:] - INFO [main:ClientBase@490] - STOPPING server [junit] 2015-05-05 07:58:42,709 [myid:] - INFO [main:ZooKeeperServer@441] - shutting down [junit] 2015-05-05 07:58:42,709 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit] 2015-05-05 07:58:42,709 [myid:] - INFO [main:PrepRequestProcessor@760] - Shutting down [junit] 2015-05-05 07:58:42,709 [myid:] - INFO [main:SyncRequestProcessor@209] - Shutting down [junit] 2015-05-05 07:58:42,709 [myid:] - INFO [ProcessThread(sid:0 cport:11221)::PrepRequestProcessor@143] - PrepRequestProcessor exited loop! [junit] 2015-05-05 07:58:42,709 [myid:] - INFO [SyncThread:0:SyncRequestProcessor@187] - SyncRequestProcessor exited! [junit] 2015-05-05 07:58:42,710 [myid:] - INFO [main:FinalRequestProcessor@415] - shutdown of request processor complete [junit] 2015-05-05 07:58:42,710 [myid:] - INFO [main:FourLetterWordMain@43] - connecting to 127.0.0.1 11221 [junit] 2015-05-05 07:58:42,710 [myid:] - INFO [main:JMXEnv@146] - ensureOnly:[] [junit] 2015-05-05 07:58:42,711 [myid:] - INFO [main:ClientBase@443] - STARTING server [junit] 2015-05-05 07:58:42,712 [myid:] - INFO [main:ClientBase@364] - CREATING server instance 127.0.0.1:11221 [junit] 2015-05-05 07:58:42,712 [myid:] - INFO [main:NIOServerCnxnFactory@94] - binding to port 0.0.0.0/0.0.0.0:11221 [junit] 2015-05-05 07:58:42,712 [myid:] - INFO [main:ClientBase@339] - STARTING server instance 127.0.0.1:11221 [junit] 2015-05-05 07:58:42,713 [myid:] - INFO [main:ZooKeeperServer@162] - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 6 datadir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch34_solaris/trunk/build/test/tmp/test2336838341640504646.junit.dir/version-2 snapdir /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/ZooKeeper_branch34_solaris/trunk/build/test/tmp/test2336838341640504646.junit.dir/version-2 [junit] 2015-05-05 07:58:42,715 [myid:] - INFO [main:FourLetterWordMain@43] - connecting to 127.0.0.1 11221 [junit] 2015-05-05 07:58:42,715 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxnFactory@197] - Accepted socket connection from /127.0.0.1:47327 [junit] 2015-05-05 07:58:42,716 [myid:] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:11221:NIOServerCnxn@827] - Processing stat command from /127.0.0.1:47327 [junit] 2015-05-05 07:58:42,716 [myid:] - INFO [Thread-5:NIOServerCnxn$StatCommand@663] - Stat command output [junit] 2015-05-05 07:58:42,716 [myid:] - INFO [Thread-5:NIOServerCnxn@1007] - Closed socket connection for client /127.0.0.1:47327 (no session established for client) [junit] 2015-05-05 07:58:42,716 [myid:] - INFO [main:JMXEnv@229] - ensureParent:[InMemoryDataTree, StandaloneServer_port] [junit] 2015-05-05 07:58:42,718 [myid:] - INFO [main:JMXEnv@246] - expect:InMemoryDataTree [junit] 2015-05-05 07:58:42,718 [myid:] - INFO [main:JMXEnv@250] - found:InMemoryDataTree org.apache.ZooKeeperService:name0=StandaloneServer_port11221,name1=InMemoryDataTree [junit] 2015-05-05 07:58:42,718 [myid:] - INFO [main:JMXEnv@246] - expect:StandaloneServer_port [junit] 2015-05-05 07:58:42,718 [myid:] - INFO [main:JMXEnv@250] - found:StandaloneServer_port org.apache.ZooKeeperService:name0=StandaloneServer_port11221 [junit] 2015-05-05 07:58:42,718 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@58] - Memory used 8715 [junit] 2015-05-05 07:58:42,719 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@63] - Number of threads 20 [junit] 2015-05-05 07:58:42,719 [myid:] - INFO [main:JUnit4ZKTestRunner$LoggedInvokeMethod@78] - FINISHED TEST METHOD testQuota [junit] 2015-05-05 07:58:42,719 [myid:] - INFO [main:ClientBase@520] - tearDown starting [junit] 2015-05-05 07:58:42,799 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x14d231584c3 closed [junit] 2015-05-05 07:58:42,799 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@512] - EventThread shut down [junit] 2015-05-05 07:58:42,799 [myid:] - INFO [main:ClientBase@490] - STOPPING server [junit] 2015-05-05 07:58:42,800 [myid:] - INFO [main:ZooKeeperServer@441] - shutting down [junit] 2015-05-05 07:58:42,801 [myid:] - INFO [main:SessionTrackerImpl@225] - Shutting down [junit]
[jira] [Created] (ZOOKEEPER-2181) Slider-Zookeeper integration testcase fails with Zookeeper-3.5.0-alpha version
Ayappan created ZOOKEEPER-2181: -- Summary: Slider-Zookeeper integration testcase fails with Zookeeper-3.5.0-alpha version Key: ZOOKEEPER-2181 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2181 Project: ZooKeeper Issue Type: Bug Affects Versions: 3.5.0 Reporter: Ayappan TestZKIntegration testcase in slider fails with zookeeper-3.5.0-alpha version. From the logs, it came to know the state change went to LOST rather than CONNECTED while creating ZK path. The above testcase passes with zookeeper-3.4.6. A slider jira SLIDER-862 is already opened for this. But the problem seems to be with zookeeper-3.5.0-alpha. Running org.apache.slider.common.tools.TestZKIntegration 2015-04-24 06:56:52,118 [Thread-2] INFO services.MicroZookeeperService (MicroZookeeperService.java:serviceStart(235)) - Starting Local Zookeeper service 2015-04-24 06:56:52,299 [Thread-2] INFO services.MicroZookeeperService (MicroZookeeperService.java:serviceStart(241)) - In memory ZK started at localhost:50577 2015-04-24 06:56:52,300 [Thread-2] INFO test.MicroZKCluster (MicroZKCluster.groovy:createCluster(53)) - Created Micro ZK cluster as localhost:50577 2015-04-24 06:56:52,492 [Thread-2] INFO imps.CuratorFrameworkImpl (CuratorFrameworkImpl.java:start(223)) - Starting 2015-04-24 06:56:52,513 [Thread-2] DEBUG zk.ZKIntegration (ZKIntegration.java:init(96)) - Binding ZK client to localhost:50577 2015-04-24 06:56:52,513 [Thread-2] INFO zk.BlockingZKWatcher (BlockingZKWatcher.java:waitForZKConnection(57)) - waiting for ZK event 2015-04-24 06:56:52,543 [Thread-2-EventThread] DEBUG zk.ZKIntegration (ZKIntegration.java:process(178)) - WatchedEvent state:Expired type:None path:null 2015-04-24 06:56:52,544 [Thread-2-EventThread] DEBUG zk.ZKIntegration (ZKIntegration.java:maybeInit(191)) - initing 2015-04-24 06:56:52,544 [Thread-2-EventThread] DEBUG zk.ZKIntegration (ZKIntegration.java:createPath(222)) - Creating ZK path /services 2015-04-24 06:56:52,545 [Thread-2-EventThread] INFO state.ConnectionStateManager (ConnectionStateManager.java:postState(194)) - State change: LOST 2015-04-24 06:56:52,546 [Thread-2-EventThread] WARN curator.ConnectionState (ConnectionState.java:handleExpiredSession(289)) - Session expired event received 2015-04-24 06:56:52,548 [ConnectionStateManager-0] WARN state.ConnectionStateManager (ConnectionStateManager.java:processEvents(212)) - There are no ConnectionStateListeners registered. 2015-04-24 06:56:52,549 [NIOWorkerThread-1] WARN server.NIOServerCnxn (NIOServerCnxn.java:doIO(368)) - Unable to read additional data from client sessionid 0x14ceb499c75, likely client has closed socket 2015-04-24 06:56:52,550 [Thread-2-EventThread] ERROR zk.ZKIntegration (ZKIntegration.java:process(182)) - Failed to init org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /services at org.apache.zookeeper.KeeperException.create(KeeperException.java:131) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:1067) at org.apache.slider.core.zk.ZKIntegration.createPath(ZKIntegration.java:223) at org.apache.slider.core.zk.ZKIntegration.mkPath(ZKIntegration.java:242) at org.apache.slider.core.zk.ZKIntegration.maybeInit(ZKIntegration.java:193) at org.apache.slider.core.zk.ZKIntegration.process(ZKIntegration.java:180) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:539) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:515) 2015-04-24 06:56:52,550 [NIOWorkerThread-3] WARN server.NIOServerCnxn (NIOServerCnxn.java:doIO(368)) - Unable to read additional data from client sessionid 0x14ceb499c750001, likely client has closed socket 2015-04-24 06:56:52,551 [Thread-2-EventThread] INFO zk.BlockingZKWatcher (BlockingZKWatcher.java:process(37)) - ZK binding callback received -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (ZOOKEEPER-2062) RemoveWatchesTest takes forever to run
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528274#comment-14528274 ] Hudson commented on ZOOKEEPER-2062: --- SUCCESS: Integrated in ZooKeeper-trunk #2682 (See [https://builds.apache.org/job/ZooKeeper-trunk/2682/]) ZOOKEEPER-2062 RemoveWatchesTest takes forever to run (Chris Nauroth via rakeshr) (rakeshr: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1677724) * /zookeeper/trunk/CHANGES.txt * /zookeeper/trunk/src/java/test/org/apache/zookeeper/RemoveWatchesTest.java RemoveWatchesTest takes forever to run -- Key: ZOOKEEPER-2062 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2062 Project: ZooKeeper Issue Type: Bug Components: tests Affects Versions: 3.5.0 Reporter: Flavio Junqueira Assignee: Chris Nauroth Fix For: 3.5.1, 3.6.0 Attachments: ZOOKEEPER-2062.001.patch, ZOOKEEPER-2062.002.patch, ZOOKEEPER-2062.003.patch, ZOOKEEPER-2062.004.patch [junit] Running org.apache.zookeeper.RemoveWatchesTest [junit] Tests run: 46, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 306.188 sec -- This message was sent by Atlassian JIRA (v6.3.4#6332)
ZooKeeper-trunk-WinVS2008 - Build # 1789 - Still Failing
See https://builds.apache.org/job/ZooKeeper-trunk-WinVS2008/1789/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 110 lines...] [javacc] File SimpleCharStream.java does not exist. Will create one. [javacc] Parser generated successfully. jute: [javac] Compiling 39 source files to f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\build\classes compile_jute_uptodate: compile_jute: [mkdir] Created dir: f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\java\generated [mkdir] Created dir: f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\generated [java] ../../zookeeper.jute Parsed Successfully [java] ../../zookeeper.jute Parsed Successfully [touch] Creating f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\java\generated\.generated BUILD SUCCESSFUL Total time: 8 seconds [ZooKeeper-trunk-WinVS2008] $ cmd /c call C:\Windows\TEMP\hudson1658681340998033428.bat f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008set ZOOKEEPER_HOME=f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008msbuild trunk/src/c/zookeeper.sln /p:Configuration=Release Microsoft (R) Build Engine version 4.0.30319.18408 [Microsoft .NET Framework, version 4.0.30319.18444] Copyright (C) Microsoft Corporation. All rights reserved. Building the projects in this solution one at a time. To enable parallel build, please add the /m switch. Build started 5/5/2015 12:13:36 PM. Project f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln on node 1 (default targets). ValidateSolutionConfiguration: Building solution configuration Release|Win32. zookeeper: C:\Program Files (x86)\Microsoft Visual Studio 9.0\Common7\IDE\..\..\vc\vcpackages\VCBuild.exe f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.vcproj Release|Win32 cl : Command line warning D9035: option 'Wp64' has been deprecated and will be removed in a future release [f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln] .\src\zookeeper.c(43): fatal error C1083: Cannot open include file: 'unistd.h': No such file or directory [f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln] Cli: C:\Program Files (x86)\Microsoft Visual Studio 9.0\Common7\IDE\..\..\vc\vcpackages\VCBuild.exe f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\Cli.vcproj Release|Win32 Done Building Project f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln (default targets) -- FAILED. Build FAILED. f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln (default target) (1) - (zookeeper target) - cl : Command line warning D9035: option 'Wp64' has been deprecated and will be removed in a future release [f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln] f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln (default target) (1) - (zookeeper target) - .\src\zookeeper.c(43): fatal error C1083: Cannot open include file: 'unistd.h': No such file or directory [f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008\trunk\src\c\zookeeper.sln] 1 Warning(s) 1 Error(s) Time Elapsed 00:00:06.26 f:\hudson\hudson-slave\workspace\ZooKeeper-trunk-WinVS2008exit 1 Build step 'Execute Windows batch command' marked build as failure Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.