[ 
https://issues.apache.org/jira/browse/MESOS-977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13895264#comment-13895264
 ] 

Yan Xu commented on MESOS-977:
------------------------------

https://reviews.apache.org/r/17864/

> MasterZooKeeperTest.LostZooKeeperCluster is flaky
> -------------------------------------------------
>
>                 Key: MESOS-977
>                 URL: https://issues.apache.org/jira/browse/MESOS-977
>             Project: Mesos
>          Issue Type: Bug
>          Components: test
>            Reporter: Vinod Kone
>            Assignee: Yan Xu
>             Fix For: 0.18.0
>
>
> [ RUN      ] MasterZooKeeperTest.LostZooKeeperCluster
> I0207 04:03:44.037726 31418 master.cpp:285] Master started on 
> 67.195.138.60:56892
> I0207 04:03:44.037912 31418 master.cpp:300] Master ID: 
> 201402070403-1015726915-56892-31385
> 2014-02-07 04:03:44,037:31385(0x2b5faae74700):ZOO_INFO@log_env@712: Client 
> environment:zookeeper.version=zookeeper C client 3.4.5
> 2014-02-07 04:03:44,038:31385(0x2b5faae74700):ZOO_INFO@log_env@716: Client 
> environment:host.name=janus
> 2014-02-07 04:03:44,038:31385(0x2b5faae74700):ZOO_INFO@log_env@723: Client 
> environment:os.name=Linux
> 2014-02-07 04:03:44,038:31385(0x2b5faae74700):ZOO_INFO@log_env@724: Client 
> environment:os.arch=3.2.0-57-generic
> 2014-02-07 04:03:44,038:31385(0x2b5faae74700):ZOO_INFO@log_env@725: Client 
> environment:os.version=#87-Ubuntu SMP Tue Nov 12 21:35:10 UTC 2013
> 2014-02-07 04:03:44,038:31385(0x2b5fab477700):ZOO_INFO@log_env@712: Client 
> environment:zookeeper.version=zookeeper C client 3.4.5
> 2014-02-07 04:03:44,038:31385(0x2b5fab477700):ZOO_INFO@log_env@716: Client 
> environment:host.name=janus
> 2014-02-07 04:03:44,038:31385(0x2b5fab477700):ZOO_INFO@log_env@723: Client 
> environment:os.name=Linux
> 2014-02-07 04:03:44,038:31385(0x2b5fab477700):ZOO_INFO@log_env@724: Client 
> environment:os.arch=3.2.0-57-generic
> 2014-02-07 04:03:44,038:31385(0x2b5fab477700):ZOO_INFO@log_env@725: Client 
> environment:os.version=#87-Ubuntu SMP Tue Nov 12 21:35:10 UTC 2013
> I0207 04:03:44.037991 31418 master.cpp:303] Master only allowing 
> authenticated frameworks to register!
> 2014-02-07 04:03:44,038:31385(0x2b5faae74700):ZOO_INFO@log_env@733: Client 
> environment:user.name=(null)
> 2014-02-07 04:03:44,038:31385(0x2b5fab477700):ZOO_INFO@log_env@733: Client 
> environment:user.name=(null)
> 2014-02-07 04:03:44,039:31385(0x2b5faae74700):ZOO_INFO@log_env@741: Client 
> environment:user.home=/home/jenkins
> 2014-02-07 04:03:44,039:31385(0x2b5faae74700):ZOO_INFO@log_env@753: Client 
> environment:user.dir=/home/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-In-Src-Set-JAVA_HOME/src
> 2014-02-07 04:03:44,039:31385(0x2b5faae74700):ZOO_INFO@zookeeper_init@786: 
> Initiating client connection, host=127.0.0.1:37655 sessionTimeout=10000 
> watcher=0x2b5fa3711480 sessionId=0 sessionPasswd=<null> 
> context=0x2b5fc802c3b0 flags=0
> I0207 04:03:44.038790 31418 hierarchical_allocator_process.hpp:302] 
> Initializing hierarchical allocator process with master : 
> [email protected]:56892
> I0207 04:03:44.038812 31417 master.cpp:86] No whitelist given. Advertising 
> offers for all slaves
> 2014-02-07 04:03:44,039:31385(0x2b5fab477700):ZOO_INFO@log_env@741: Client 
> environment:user.home=/home/jenkins
> 2014-02-07 04:03:44,039:31385(0x2b5fab477700):ZOO_INFO@log_env@753: Client 
> environment:user.dir=/home/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-In-Src-Set-JAVA_HOME/src
> 2014-02-07 04:03:44,039:31385(0x2b5fab477700):ZOO_INFO@zookeeper_init@786: 
> Initiating client connection, host=127.0.0.1:37655 sessionTimeout=10000 
> watcher=0x2b5fa3711480 sessionId=0 sessionPasswd=<null> 
> context=0x2b5fd801bb80 flags=0
> I0207 04:03:44.039053 31423 contender.cpp:127] Joining the ZK group
> 2014-02-07 04:03:44,039:31385(0x2b6139b6f700):ZOO_INFO@check_events@1703: 
> initiated connection to server [127.0.0.1:37655]
> 2014-02-07 04:03:44,039:31385(0x2b613996e700):ZOO_INFO@check_events@1703: 
> initiated connection to server [127.0.0.1:37655]
> 2014-02-07 04:03:44,131:31385(0x2b6139b6f700):ZOO_INFO@check_events@1750: 
> session establishment complete on server [127.0.0.1:37655], 
> sessionId=0x1440a83f5230000, negotiated timeout=10000
> I0207 04:03:44.131654 31417 group.cpp:310] Group process 
> ((1437)@67.195.138.60:56892) connected to ZooKeeper
> I0207 04:03:44.131678 31417 group.cpp:752] Syncing group operations: queue 
> size (joins, cancels, datas) = (0, 0, 0)
> I0207 04:03:44.131688 31417 group.cpp:367] Trying to create path '/znode' in 
> ZooKeeper
> 2014-02-07 04:03:44,132:31385(0x2b613996e700):ZOO_INFO@check_events@1750: 
> session establishment complete on server [127.0.0.1:37655], 
> sessionId=0x1440a83f5230001, negotiated timeout=10000
> I0207 04:03:44.132189 31418 group.cpp:310] Group process 
> ((1435)@67.195.138.60:56892) connected to ZooKeeper
> I0207 04:03:44.132205 31418 group.cpp:752] Syncing group operations: queue 
> size (joins, cancels, datas) = (1, 0, 0)
> I0207 04:03:44.132217 31418 group.cpp:367] Trying to create path '/znode' in 
> ZooKeeper
> I0207 04:03:44.216795 31420 contender.cpp:243] New candidate (id='0') has 
> entered the contest for leadership
> I0207 04:03:44.217401 31419 detector.cpp:134] Detected a new leader: (id='0')
> I0207 04:03:44.217545 31419 group.cpp:629] Trying to get 
> '/znode/info_0000000000' in ZooKeeper
> I0207 04:03:44.218291 31419 detector.cpp:351] A new leading master 
> ([email protected]:56892) is detected
> I0207 04:03:44.218370 31419 master.cpp:735] The newly elected leader is 
> [email protected]:56892
> I0207 04:03:44.218380 31419 master.cpp:743] Elected as the leading master!
> 2014-02-07 04:03:44,219:31385(0x2b5faa871700):ZOO_INFO@log_env@712: Client 
> environment:zookeeper.version=zookeeper C client 3.4.5
> 2014-02-07 04:03:44,219:31385(0x2b5faa871700):ZOO_INFO@log_env@716: Client 
> environment:host.name=janus
> I0207 04:03:44.219331 31419 slave.cpp:112] Slave started on 
> 74)@67.195.138.60:56892
> 2014-02-07 04:03:44,219:31385(0x2b5faa871700):ZOO_INFO@log_env@723: Client 
> environment:os.name=Linux
> 2014-02-07 04:03:44,219:31385(0x2b5faa871700):ZOO_INFO@log_env@724: Client 
> environment:os.arch=3.2.0-57-generic
> 2014-02-07 04:03:44,219:31385(0x2b5faa871700):ZOO_INFO@log_env@725: Client 
> environment:os.version=#87-Ubuntu SMP Tue Nov 12 21:35:10 UTC 2013
> I0207 04:03:44.219475 31419 slave.cpp:212] Slave resources: cpus(*):2; 
> mem(*):1024; disk(*):1024; ports(*):[31000-32000]
> 2014-02-07 04:03:44,219:31385(0x2b5faa871700):ZOO_INFO@log_env@733: Client 
> environment:user.name=(null)
> 2014-02-07 04:03:44,219:31385(0x2b5faa871700):ZOO_INFO@log_env@741: Client 
> environment:user.home=/home/jenkins
> 2014-02-07 04:03:44,219:31385(0x2b5faa871700):ZOO_INFO@log_env@753: Client 
> environment:user.dir=/home/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-In-Src-Set-JAVA_HOME/src
> 2014-02-07 04:03:44,219:31385(0x2b5faa871700):ZOO_INFO@zookeeper_init@786: 
> Initiating client connection, host=127.0.0.1:37655 sessionTimeout=10000 
> watcher=0x2b5fa3711480 sessionId=0 sessionPasswd=<null> 
> context=0x2b5fb801b8f0 flags=0
> 2014-02-07 04:03:44,219:31385(0x2b613976d700):ZOO_INFO@check_events@1703: 
> initiated connection to server [127.0.0.1:37655]
> 2014-02-07 04:03:44,220:31385(0x2b5fab075700):ZOO_INFO@log_env@712: Client 
> environment:zookeeper.version=zookeeper C client 3.4.5
> 2014-02-07 04:03:44,220:31385(0x2b5fab075700):ZOO_INFO@log_env@716: Client 
> environment:host.name=janus
> 2014-02-07 04:03:44,220:31385(0x2b5fab075700):ZOO_INFO@log_env@723: Client 
> environment:os.name=Linux
> 2014-02-07 04:03:44,220:31385(0x2b5fab075700):ZOO_INFO@log_env@724: Client 
> environment:os.arch=3.2.0-57-generic
> 2014-02-07 04:03:44,220:31385(0x2b5fab075700):ZOO_INFO@log_env@725: Client 
> environment:os.version=#87-Ubuntu SMP Tue Nov 12 21:35:10 UTC 2013
> 2014-02-07 04:03:44,220:31385(0x2b5fab075700):ZOO_INFO@log_env@733: Client 
> environment:user.name=(null)
> 2014-02-07 04:03:44,220:31385(0x2b5fab075700):ZOO_INFO@log_env@741: Client 
> environment:user.home=/home/jenkins
> 2014-02-07 04:03:44,220:31385(0x2b5fab075700):ZOO_INFO@log_env@753: Client 
> environment:user.dir=/home/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-In-Src-Set-JAVA_HOME/src
> 2014-02-07 04:03:44,220:31385(0x2b5fab075700):ZOO_INFO@zookeeper_init@786: 
> Initiating client connection, host=127.0.0.1:37655 sessionTimeout=10000 
> watcher=0x2b5fa3711480 sessionId=0 sessionPasswd=<null> 
> context=0x2b5fc00510f0 flags=0
> I0207 04:03:44.221117 31423 state.cpp:33] Recovering state from 
> '/tmp/MasterZooKeeperTest_LostZooKeeperCluster_d2mxw5/meta'
> 2014-02-07 04:03:44,221:31385(0x2b6139f71700):ZOO_INFO@check_events@1703: 
> initiated connection to server [127.0.0.1:37655]
> I0207 04:03:44.221294 31421 status_update_manager.cpp:188] Recovering status 
> update manager
> I0207 04:03:44.221492 31421 slave.cpp:2753] Finished recovery
> 2014-02-07 04:03:44,225:31385(0x2b613976d700):ZOO_INFO@check_events@1750: 
> session establishment complete on server [127.0.0.1:37655], 
> sessionId=0x1440a83f5230002, negotiated timeout=10000
> I0207 04:03:44.225141 31421 group.cpp:310] Group process 
> ((1444)@67.195.138.60:56892) connected to ZooKeeper
> I0207 04:03:44.225162 31421 group.cpp:752] Syncing group operations: queue 
> size (joins, cancels, datas) = (0, 0, 0)
> I0207 04:03:44.225172 31421 group.cpp:367] Trying to create path '/znode' in 
> ZooKeeper
> 2014-02-07 04:03:44,233:31385(0x2b6139f71700):ZOO_INFO@check_events@1750: 
> session establishment complete on server [127.0.0.1:37655], 
> sessionId=0x1440a83f5230003, negotiated timeout=10000
> I0207 04:03:44.234204 31420 group.cpp:310] Group process 
> ((1451)@67.195.138.60:56892) connected to ZooKeeper
> I0207 04:03:44.234294 31420 group.cpp:752] Syncing group operations: queue 
> size (joins, cancels, datas) = (0, 0, 0)
> I0207 04:03:44.234364 31420 group.cpp:367] Trying to create path '/znode' in 
> ZooKeeper
> I0207 04:03:44.234812 31423 detector.cpp:134] Detected a new leader: (id='0')
> I0207 04:03:44.234997 31422 group.cpp:629] Trying to get 
> '/znode/info_0000000000' in ZooKeeper
> I0207 04:03:44.235676 31424 detector.cpp:134] Detected a new leader: (id='0')
> I0207 04:03:44.235826 31417 group.cpp:629] Trying to get 
> '/znode/info_0000000000' in ZooKeeper
> I0207 04:03:44.235976 31422 detector.cpp:351] A new leading master 
> ([email protected]:56892) is detected
> I0207 04:03:44.236101 31423 slave.cpp:501] New master detected at 
> [email protected]:56892
> I0207 04:03:44.236166 31423 slave.cpp:526] Detecting new master
> I0207 04:03:44.236188 31418 status_update_manager.cpp:162] New master 
> detected at [email protected]:56892
> I0207 04:03:44.236316 31419 master.cpp:1813] Attempting to register slave on 
> janus.apache.org at slave(74)@67.195.138.60:56892
> I0207 04:03:44.236335 31419 master.cpp:2783] Adding slave 
> 201402070403-1015726915-56892-31385-0 at janus.apache.org with cpus(*):2; 
> mem(*):1024; disk(*):1024; ports(*):[31000-32000]
> I0207 04:03:44.236438 31418 slave.cpp:544] Registered with master 
> [email protected]:56892; given slave ID 
> 201402070403-1015726915-56892-31385-0
> I0207 04:03:44.236541 31422 hierarchical_allocator_process.hpp:445] Added 
> slave 201402070403-1015726915-56892-31385-0 (janus.apache.org) with 
> cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (and cpus(*):2; 
> mem(*):1024; disk(*):1024; ports(*):[31000-32000] available)
> I0207 04:03:44.236605 31422 hierarchical_allocator_process.hpp:708] Performed 
> allocation for slave 201402070403-1015726915-56892-31385-0 in 10896ns
> I0207 04:03:44.236877 31417 detector.cpp:351] A new leading master 
> ([email protected]:56892) is detected
> I0207 04:03:44.236948 31420 sched.cpp:210] New master detected at 
> [email protected]:56892
> I0207 04:03:44.236968 31420 sched.cpp:261] Authenticating with master 
> [email protected]:56892
> I0207 04:03:44.237031 31420 sched.cpp:230] Detecting new master
> I0207 04:03:44.237048 31417 authenticatee.hpp:124] Creating new client SASL 
> connection
> I0207 04:03:44.237252 31420 master.cpp:2296] Authenticating framework at 
> scheduler(90)@67.195.138.60:56892
> I0207 04:03:44.237329 31417 authenticator.hpp:140] Creating new server SASL 
> connection
> I0207 04:03:44.237431 31417 authenticatee.hpp:212] Received SASL 
> authentication mechanisms: CRAM-MD5
> I0207 04:03:44.237448 31417 authenticatee.hpp:238] Attempting to authenticate 
> with mechanism 'CRAM-MD5'
> I0207 04:03:44.237480 31417 authenticator.hpp:243] Received SASL 
> authentication start
> I0207 04:03:44.237551 31417 authenticator.hpp:325] Authentication requires 
> more steps
> I0207 04:03:44.237582 31417 authenticatee.hpp:258] Received SASL 
> authentication step
> I0207 04:03:44.237622 31417 authenticator.hpp:271] Received SASL 
> authentication step
> I0207 04:03:44.237639 31417 auxprop.cpp:81] Request to lookup properties for 
> user: 'test-principal' realm: 'janus.apache.org' server FQDN: 
> 'janus.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false 
> SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 
> I0207 04:03:44.237648 31417 auxprop.cpp:153] Looking up auxiliary property 
> '*userPassword'
> I0207 04:03:44.237663 31417 auxprop.cpp:153] Looking up auxiliary property 
> '*cmusaslsecretCRAM-MD5'
> I0207 04:03:44.237673 31417 auxprop.cpp:81] Request to lookup properties for 
> user: 'test-principal' realm: 'janus.apache.org' server FQDN: 
> 'janus.apache.org' SASL_AUXPROP_VERIFY_AGAINST_HASH: false 
> SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 
> I0207 04:03:44.237680 31417 auxprop.cpp:103] Skipping auxiliary property 
> '*userPassword' since SASL_AUXPROP_AUTHZID == true
> I0207 04:03:44.237686 31417 auxprop.cpp:103] Skipping auxiliary property 
> '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
> I0207 04:03:44.237697 31417 authenticator.hpp:317] Authentication success
> I0207 04:03:44.237725 31417 authenticatee.hpp:298] Authentication success
> I0207 04:03:44.237750 31417 master.cpp:2336] Successfully authenticated 
> framework at scheduler(90)@67.195.138.60:56892
> I0207 04:03:44.237826 31417 sched.cpp:335] Successfully authenticated with 
> master [email protected]:56892
> I0207 04:03:44.237880 31417 master.cpp:791] Received registration request 
> from scheduler(90)@67.195.138.60:56892
> I0207 04:03:44.237922 31417 master.cpp:809] Registering framework 
> 201402070403-1015726915-56892-31385-0000 at scheduler(90)@67.195.138.60:56892
> I0207 04:03:44.237987 31417 sched.cpp:384] Framework registered with 
> 201402070403-1015726915-56892-31385-0000
> I0207 04:03:44.238008 31417 sched.cpp:398] Scheduler::registered took 9078ns
> I0207 04:03:44.238035 31417 hierarchical_allocator_process.hpp:332] Added 
> framework 201402070403-1015726915-56892-31385-0000
> I0207 04:03:44.238075 31417 hierarchical_allocator_process.hpp:752] Offering 
> cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave 
> 201402070403-1015726915-56892-31385-0 to framework 
> 201402070403-1015726915-56892-31385-0000
> I0207 04:03:44.238184 31417 hierarchical_allocator_process.hpp:688] Performed 
> allocation for 1 slaves in 136437ns
> I0207 04:03:44.238248 31417 master.hpp:431] Adding offer 
> 201402070403-1015726915-56892-31385-0 with resources cpus(*):2; mem(*):1024; 
> disk(*):1024; ports(*):[31000-32000] on slave 
> 201402070403-1015726915-56892-31385-0 (janus.apache.org)
> I0207 04:03:44.238291 31417 master.cpp:2251] Sending 1 offers to framework 
> 201402070403-1015726915-56892-31385-0000
> I0207 04:03:44.238468 31417 sched.cpp:518] Scheduler::resourceOffers took 
> 11549ns
> 2014-02-07 
> 04:03:44,239:31385(0x2b613976d700):ZOO_ERROR@handle_socket_error_msg@1721: 
> Socket [127.0.0.1:37655] zk retcode=-4, errno=112(Host is down): failed while 
> receiving a server response
> I0207 04:03:44.239831 31422 group.cpp:400] Lost connection to ZooKeeper, 
> attempting to reconnect ...
> 2014-02-07 
> 04:03:44,239:31385(0x2b6139f71700):ZOO_ERROR@handle_socket_error_msg@1721: 
> Socket [127.0.0.1:37655] zk retcode=-4, errno=112(Host is down): failed while 
> receiving a server response
> I0207 04:03:44.240121 31417 group.cpp:400] Lost connection to ZooKeeper, 
> attempting to reconnect ...
> 2014-02-07 
> 04:03:44,240:31385(0x2b613996e700):ZOO_ERROR@handle_socket_error_msg@1721: 
> Socket [127.0.0.1:37655] zk retcode=-4, errno=112(Host is down): failed while 
> receiving a server response
> 2014-02-07 
> 04:03:44,240:31385(0x2b6139b6f700):ZOO_ERROR@handle_socket_error_msg@1721: 
> Socket [127.0.0.1:37655] zk retcode=-4, errno=112(Host is down): failed while 
> receiving a server response
> I0207 04:03:44.241864 31421 group.cpp:400] Lost connection to ZooKeeper, 
> attempting to reconnect ...
> I0207 04:03:44.242094 31385 zookeeper_test_server.cpp:122] Shutdown 
> ZooKeeperTestServer on port 37655
> I0207 04:03:44.242528 31422 hierarchical_allocator_process.hpp:688] Performed 
> allocation for 1 slaves in 22796ns
> I0207 04:03:44.242571 31424 master.cpp:86] No whitelist given. Advertising 
> offers for all slaves
> W0207 04:03:44.242588 31422 group.cpp:435] Timed out waiting to reconnect to 
> ZooKeeper (sessionId=1440a83f5230002)
> W0207 04:03:44.242625 31424 group.cpp:435] Timed out waiting to reconnect to 
> ZooKeeper (sessionId=1440a83f5230000)
> I0207 04:03:44.242729 31423 detector.cpp:122] The current leader (id=0) is 
> lost
> I0207 04:03:44.242746 31423 detector.cpp:134] Detected a new leader: None
> 2014-02-07 04:03:44,242:31385(0x2b5fab477700):ZOO_INFO@zookeeper_close@2522: 
> Freeing zookeeper resources for sessionId=0x1440a83f5230000
> I0207 04:03:44.242826 31419 detector.cpp:122] The current leader (id=0) is 
> lost
> I0207 04:03:44.242843 31419 detector.cpp:134] Detected a new leader: None
> I0207 04:03:44.242877 31423 slave.cpp:522] Lost leading master
> I0207 04:03:44.242888 31423 slave.cpp:526] Detecting new master
> W0207 04:03:44.242995 31421 group.cpp:435] Timed out waiting to reconnect to 
> ZooKeeper (sessionId=1440a83f5230003)
> 2014-02-07 04:03:44,243:31385(0x2b5faae74700):ZOO_INFO@zookeeper_close@2522: 
> Freeing zookeeper resources for sessionId=0x1440a83f5230003
> I0207 04:03:44.243145 31419 detector.cpp:122] The current leader (id=0) is 
> lost
> I0207 04:03:44.243165 31419 detector.cpp:134] Detected a new leader: None
> I0207 04:03:44.243407 31423 sched.cpp:204] Scheduler::disconnected took 
> 11073ns
> I0207 04:03:44.243422 31423 sched.cpp:226] No master detected
> I0207 04:03:44.243428 31423 sched.cpp:230] Detecting new master
> I0207 04:03:44.243525 31417 group.cpp:400] Lost connection to ZooKeeper, 
> attempting to reconnect ...
> 2014-02-07 04:03:44,244:31385(0x2b5faae74700):ZOO_INFO@log_env@712: Client 
> environment:zookeeper.version=zookeeper C client 3.4.5
> 2014-02-07 04:03:44,244:31385(0x2b5faae74700):ZOO_INFO@log_env@716: Client 
> environment:host.name=janus
> 2014-02-07 04:03:44,244:31385(0x2b5faae74700):ZOO_INFO@log_env@723: Client 
> environment:os.name=Linux
> 2014-02-07 04:03:44,244:31385(0x2b5faae74700):ZOO_INFO@log_env@724: Client 
> environment:os.arch=3.2.0-57-generic
> 2014-02-07 04:03:44,244:31385(0x2b5faae74700):ZOO_INFO@log_env@725: Client 
> environment:os.version=#87-Ubuntu SMP Tue Nov 12 21:35:10 UTC 2013
> 2014-02-07 04:03:44,244:31385(0x2b5fab075700):ZOO_INFO@zookeeper_close@2522: 
> Freeing zookeeper resources for sessionId=0x1440a83f5230002
> 2014-02-07 04:03:44,244:31385(0x2b5fab477700):ZOO_INFO@log_env@712: Client 
> environment:zookeeper.version=zookeeper C client 3.4.5
> 2014-02-07 04:03:44,244:31385(0x2b5faae74700):ZOO_INFO@log_env@733: Client 
> environment:user.name=(null)
> 2014-02-07 04:03:44,244:31385(0x2b5fab477700):ZOO_INFO@log_env@716: Client 
> environment:host.name=janus
> 2014-02-07 04:03:44,244:31385(0x2b5fab477700):ZOO_INFO@log_env@723: Client 
> environment:os.name=Linux
> 2014-02-07 04:03:44,244:31385(0x2b5fab477700):ZOO_INFO@log_env@724: Client 
> environment:os.arch=3.2.0-57-generic
> 2014-02-07 04:03:44,244:31385(0x2b5fab477700):ZOO_INFO@log_env@725: Client 
> environment:os.version=#87-Ubuntu SMP Tue Nov 12 21:35:10 UTC 2013
> 2014-02-07 04:03:44,244:31385(0x2b5fab477700):ZOO_INFO@log_env@733: Client 
> environment:user.name=(null)
> 2014-02-07 04:03:44,244:31385(0x2b5fab477700):ZOO_INFO@log_env@741: Client 
> environment:user.home=/home/jenkins
> 2014-02-07 04:03:44,244:31385(0x2b5fab477700):ZOO_INFO@log_env@753: Client 
> environment:user.dir=/home/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-In-Src-Set-JAVA_HOME/src
> 2014-02-07 04:03:44,244:31385(0x2b5fab477700):ZOO_INFO@zookeeper_init@786: 
> Initiating client connection, host=127.0.0.1:37655 sessionTimeout=10000 
> watcher=0x2b5fa3711480 sessionId=0 sessionPasswd=<null> 
> context=0x2b5fd80133e0 flags=0
> 2014-02-07 
> 04:03:44,244:31385(0x2b6138f59700):ZOO_ERROR@handle_socket_error_msg@1697: 
> Socket [127.0.0.1:37655] zk retcode=-4, errno=111(Connection refused): server 
> refused to accept the client
> 2014-02-07 04:03:44,244:31385(0x2b5faae74700):ZOO_INFO@log_env@741: Client 
> environment:user.home=/home/jenkins
> 2014-02-07 04:03:44,246:31385(0x2b5faae74700):ZOO_INFO@log_env@753: Client 
> environment:user.dir=/home/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-In-Src-Set-JAVA_HOME/src
> 2014-02-07 04:03:44,248:31385(0x2b5faae74700):ZOO_INFO@zookeeper_init@786: 
> Initiating client connection, host=127.0.0.1:37655 sessionTimeout=10000 
> watcher=0x2b5fa3711480 sessionId=0 sessionPasswd=<null> 
> context=0x2b5fc8013dc0 flags=0
> 2014-02-07 04:03:44,245:31385(0x2b5fab075700):ZOO_INFO@log_env@712: Client 
> environment:zookeeper.version=zookeeper C client 3.4.5
> 2014-02-07 04:03:44,250:31385(0x2b5fab075700):ZOO_INFO@log_env@716: Client 
> environment:host.name=janus
> 2014-02-07 04:03:44,250:31385(0x2b5fab075700):ZOO_INFO@log_env@723: Client 
> environment:os.name=Linux
> 2014-02-07 04:03:44,250:31385(0x2b5fab075700):ZOO_INFO@log_env@724: Client 
> environment:os.arch=3.2.0-57-generic
> 2014-02-07 04:03:44,250:31385(0x2b5fab075700):ZOO_INFO@log_env@725: Client 
> environment:os.version=#87-Ubuntu SMP Tue Nov 12 21:35:10 UTC 2013
> 2014-02-07 04:03:44,250:31385(0x2b5fab075700):ZOO_INFO@log_env@733: Client 
> environment:user.name=(null)
> 2014-02-07 04:03:44,250:31385(0x2b5fab075700):ZOO_INFO@log_env@741: Client 
> environment:user.home=/home/jenkins
> 2014-02-07 04:03:44,250:31385(0x2b5fab075700):ZOO_INFO@log_env@753: Client 
> environment:user.dir=/home/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-In-Src-Set-JAVA_HOME/src
> 2014-02-07 04:03:44,250:31385(0x2b5fab075700):ZOO_INFO@zookeeper_init@786: 
> Initiating client connection, host=127.0.0.1:37655 sessionTimeout=10000 
> watcher=0x2b5fa3711480 sessionId=0 sessionPasswd=<null> 
> context=0x2b5fc0043f20 flags=0
> 2014-02-07 
> 04:03:44,250:31385(0x2b6139f71700):ZOO_ERROR@handle_socket_error_msg@1697: 
> Socket [127.0.0.1:37655] zk retcode=-4, errno=111(Connection refused): server 
> refused to accept the client
> 2014-02-07 
> 04:03:44,251:31385(0x2b6139b6f700):ZOO_ERROR@handle_socket_error_msg@1697: 
> Socket [127.0.0.1:37655] zk retcode=-4, errno=111(Connection refused): server 
> refused to accept the client
> I0207 04:03:44.252269 31419 sched.cpp:720] Stopping framework 
> '201402070403-1015726915-56892-31385-0000'
> I0207 04:03:44.252332 31385 master.cpp:562] Master terminating
> I0207 04:03:44.252370 31385 master.cpp:210] Shutting down master
> I0207 04:03:44.252429 31423 slave.cpp:1958] [email protected]:56892 exited
> I0207 04:03:44.252436 31385 master.hpp:441] Removing offer 
> 201402070403-1015726915-56892-31385-0 with resources cpus(*):2; mem(*):1024; 
> disk(*):1024; ports(*):[31000-32000] on slave 
> 201402070403-1015726915-56892-31385-0 (janus.apache.org)
> W0207 04:03:44.252488 31423 slave.cpp:1961] Master disconnected! Waiting for 
> a new master to be elected
> I0207 04:03:44.252545 31385 master.cpp:253] Removing slave 
> 201402070403-1015726915-56892-31385-0 (janus.apache.org)
> I0207 04:03:44.252995 31385 contender.cpp:182] Now cancelling the membership: > 0
> 2014-02-07 04:03:44,253:31385(0x2b5faa46ab00):ZOO_INFO@zookeeper_close@2522: 
> Freeing zookeeper resources for sessionId=0x1440a83f5230001
> 2014-02-07 04:03:44,253:31385(0x2b5faa46ab00):ZOO_INFO@zookeeper_close@2522: 
> Freeing zookeeper resources for sessionId=0
> I0207 04:03:44.253787 31385 slave.cpp:391] Slave terminating
> 2014-02-07 04:03:44,254:31385(0x2b5faa46ab00):ZOO_INFO@zookeeper_close@2522: 
> Freeing zookeeper resources for sessionId=0
> 2014-02-07 04:03:44,254:31385(0x2b5faa46ab00):ZOO_INFO@zookeeper_close@2522: 
> Freeing zookeeper resources for sessionId=0
> ../3rdparty/libprocess/include/process/gmock.hpp:295: Failure
> Actual function call count doesn't match EXPECT_CALL(filter->mock, 
> filter(testing::A<const DispatchEvent&>()))...
>     Expected args: dispatch matcher (1-byte object <B0>, 16-byte object 
> <60-45 4A-00 00-00 00-00 00-00 00-00 00-00 00-00>)
>          Expected: to be called once
>            Actual: never called - unsatisfied and active
> [  FAILED  ] MasterZooKeeperTest.LostZooKeeperCluster (217 ms)



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Reply via email to