Joseph Wu created MESOS-4574: -------------------------------- Summary: SlaveTest.CancelSlaveShutdown is flaky. Key: MESOS-4574 URL: https://issues.apache.org/jira/browse/MESOS-4574 Project: Mesos Issue Type: Bug Components: test Reporter: Joseph Wu
Encountered on ASF CI: {code} [ RUN ] SlaveTest.CancelSlaveShutdown I0201 06:33:07.370364 964 leveldb.cpp:174] Opened db in 131.848764ms I0201 06:33:07.398713 964 leveldb.cpp:181] Compacted db in 28.264162ms I0201 06:33:07.398818 964 leveldb.cpp:196] Created db iterator in 32675ns I0201 06:33:07.398839 964 leveldb.cpp:202] Seeked to beginning of db in 3633ns I0201 06:33:07.398852 964 leveldb.cpp:271] Iterated through 0 keys in the db in 290ns I0201 06:33:07.398906 964 replica.cpp:779] Replica recovered with log positions 0 -> 0 with 1 holes and 0 unlearned I0201 06:33:07.399566 991 recover.cpp:447] Starting replica recovery I0201 06:33:07.399865 991 recover.cpp:473] Replica is in EMPTY status I0201 06:33:07.401912 991 replica.cpp:673] Replica in EMPTY status received a broadcasted recover request from (10664)@172.17.0.3:40620 I0201 06:33:07.402279 996 recover.cpp:193] Received a recover response from a replica in EMPTY status I0201 06:33:07.402819 996 recover.cpp:564] Updating replica status to STARTING I0201 06:33:07.405892 991 master.cpp:374] Master 74ef59cf-3514-4e45-8bbe-79fc39e8d3ac (55c8beaba995) started on 172.17.0.3:40620 I0201 06:33:07.405938 991 master.cpp:376] Flags at startup: --acls="" --allocation_interval="1secs" --allocator="HierarchicalDRF" --authenticate="true" --authenticate_http="true" --authenticate_slaves="true" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/jfM4uK/credentials" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_slave_ping_timeouts="5" --quiet="false" --recovery_slave_removal_limit="100%" --registry="replicated_log" --registry_fetch_timeout="1mins" --registry_store_timeout="100secs" --registry_strict="true" --root_submissions="true" --slave_ping_timeout="15secs" --slave_reregister_timeout="10mins" --user_sorter="drf" --version="false" --webui_dir="/mesos/mesos-0.28.0/_inst/share/mesos/webui" --work_dir="/tmp/jfM4uK/master" --zk_session_timeout="10secs" I0201 06:33:07.406396 991 master.cpp:421] Master only allowing authenticated frameworks to register I0201 06:33:07.406411 991 master.cpp:426] Master only allowing authenticated slaves to register I0201 06:33:07.406421 991 credentials.hpp:35] Loading credentials for authentication from '/tmp/jfM4uK/credentials' I0201 06:33:07.406847 991 master.cpp:466] Using default 'crammd5' authenticator I0201 06:33:07.407320 991 master.cpp:535] Using default 'basic' HTTP authenticator I0201 06:33:07.407503 991 master.cpp:569] Authorization enabled I0201 06:33:07.408398 990 hierarchical.cpp:144] Initialized hierarchical allocator process I0201 06:33:07.408473 990 whitelist_watcher.cpp:77] No whitelist given I0201 06:33:07.410835 991 master.cpp:1710] The newly elected leader is master@172.17.0.3:40620 with id 74ef59cf-3514-4e45-8bbe-79fc39e8d3ac I0201 06:33:07.410941 991 master.cpp:1723] Elected as the leading master! I0201 06:33:07.411080 991 master.cpp:1468] Recovering from registrar I0201 06:33:07.411320 995 registrar.cpp:307] Recovering registrar I0201 06:33:07.429308 996 leveldb.cpp:304] Persisting metadata (8 bytes) to leveldb took 26.214639ms I0201 06:33:07.429399 996 replica.cpp:320] Persisted replica status to STARTING I0201 06:33:07.429750 996 recover.cpp:473] Replica is in STARTING status I0201 06:33:07.431449 997 replica.cpp:673] Replica in STARTING status received a broadcasted recover request from (10666)@172.17.0.3:40620 I0201 06:33:07.432131 996 recover.cpp:193] Received a recover response from a replica in STARTING status I0201 06:33:07.432736 996 recover.cpp:564] Updating replica status to VOTING I0201 06:33:07.707383 990 leveldb.cpp:304] Persisting metadata (8 bytes) to leveldb took 274.401797ms I0201 06:33:07.707468 990 replica.cpp:320] Persisted replica status to VOTING I0201 06:33:07.707758 997 recover.cpp:578] Successfully joined the Paxos group I0201 06:33:07.708313 997 recover.cpp:462] Recover process terminated I0201 06:33:07.709205 997 log.cpp:659] Attempting to start the writer I0201 06:33:07.710706 990 replica.cpp:493] Replica received implicit promise request from (10667)@172.17.0.3:40620 with proposal 1 I0201 06:33:07.746018 990 leveldb.cpp:304] Persisting metadata (8 bytes) to leveldb took 35.240236ms I0201 06:33:07.746315 990 replica.cpp:342] Persisted promised to 1 I0201 06:33:07.747651 997 coordinator.cpp:238] Coordinator attempting to fill missing positions I0201 06:33:07.749287 997 replica.cpp:388] Replica received explicit promise request from (10668)@172.17.0.3:40620 for position 0 with proposal 2 I0201 06:33:07.787835 997 leveldb.cpp:341] Persisting action (8 bytes) to leveldb took 38.469397ms I0201 06:33:07.787935 997 replica.cpp:712] Persisted action at 0 I0201 06:33:07.789468 989 replica.cpp:537] Replica received write request for position 0 from (10669)@172.17.0.3:40620 I0201 06:33:07.789561 989 leveldb.cpp:436] Reading position from leveldb took 48279ns I0201 06:33:07.829591 989 leveldb.cpp:341] Persisting action (14 bytes) to leveldb took 39.951666ms I0201 06:33:07.829692 989 replica.cpp:712] Persisted action at 0 I0201 06:33:07.830931 989 replica.cpp:691] Replica received learned notice for position 0 from @0.0.0.0:0 I0201 06:33:07.871561 989 leveldb.cpp:341] Persisting action (16 bytes) to leveldb took 40.517379ms I0201 06:33:07.871814 989 replica.cpp:712] Persisted action at 0 I0201 06:33:07.871997 989 replica.cpp:697] Replica learned NOP action at position 0 I0201 06:33:07.873497 989 log.cpp:675] Writer started with ending position 0 I0201 06:33:07.875773 989 leveldb.cpp:436] Reading position from leveldb took 77179ns I0201 06:33:07.877591 987 registrar.cpp:340] Successfully fetched the registry (0B) in 466.212864ms I0201 06:33:07.878067 987 registrar.cpp:439] Applied 1 operations in 108406ns; attempting to update the 'registry' I0201 06:33:07.879789 987 log.cpp:683] Attempting to append 170 bytes to the log I0201 06:33:07.880082 989 coordinator.cpp:348] Coordinator attempting to write APPEND action at position 1 I0201 06:33:07.881151 987 replica.cpp:537] Replica received write request for position 1 from (10670)@172.17.0.3:40620 I0201 06:33:07.921674 987 leveldb.cpp:341] Persisting action (189 bytes) to leveldb took 40.355865ms I0201 06:33:07.921777 987 replica.cpp:712] Persisted action at 1 I0201 06:33:07.924100 985 replica.cpp:691] Replica received learned notice for position 1 from @0.0.0.0:0 I0201 06:33:07.964328 985 leveldb.cpp:341] Persisting action (191 bytes) to leveldb took 40.147039ms I0201 06:33:07.964424 985 replica.cpp:712] Persisted action at 1 I0201 06:33:07.964462 985 replica.cpp:697] Replica learned APPEND action at position 1 I0201 06:33:07.966755 985 registrar.cpp:484] Successfully updated the 'registry' in 88.54784ms I0201 06:33:07.966995 985 registrar.cpp:370] Successfully recovered registrar I0201 06:33:07.967340 985 log.cpp:702] Attempting to truncate the log to 1 I0201 06:33:07.967902 985 master.cpp:1520] Recovered 0 slaves from the Registry (131B) ; allowing 10mins for slaves to re-register I0201 06:33:07.968072 985 coordinator.cpp:348] Coordinator attempting to write TRUNCATE action at position 2 I0201 06:33:07.968637 985 hierarchical.cpp:171] Skipping recovery of hierarchical allocator: nothing to recover I0201 06:33:07.969669 985 replica.cpp:537] Replica received write request for position 2 from (10671)@172.17.0.3:40620 I0201 06:33:08.005317 985 leveldb.cpp:341] Persisting action (16 bytes) to leveldb took 35.57315ms I0201 06:33:08.005414 985 replica.cpp:712] Persisted action at 2 I0201 06:33:08.006830 985 replica.cpp:691] Replica received learned notice for position 2 from @0.0.0.0:0 I0201 06:33:08.047320 985 leveldb.cpp:341] Persisting action (18 bytes) to leveldb took 40.433692ms I0201 06:33:08.047461 985 leveldb.cpp:399] Deleting ~1 keys from leveldb took 62326ns I0201 06:33:08.047487 985 replica.cpp:712] Persisted action at 2 I0201 06:33:08.047520 985 replica.cpp:697] Replica learned TRUNCATE action at position 2 I0201 06:33:08.058626 964 containerizer.cpp:143] Using isolation: posix/cpu,posix/mem,filesystem/posix W0201 06:33:08.059469 964 backend.cpp:48] Failed to create 'bind' backend: BindBackend requires root privileges I0201 06:33:08.068466 988 slave.cpp:192] Slave started on 343)@172.17.0.3:40620 I0201 06:33:08.068516 988 slave.cpp:193] Flags at startup: --appc_store_dir="/tmp/mesos/store/appc" --authenticatee="crammd5" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/SlaveTest_CancelSlaveShutdown_UXpMkx/credential" --default_role="*" --disk_watch_interval="1mins" --docker="docker" --docker_auth_server="https://auth.docker.io" --docker_kill_orphans="true" --docker_puller_timeout="60" --docker_registry="https://registry-1.docker.io" --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/SlaveTest_CancelSlaveShutdown_UXpMkx/fetch" --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks" --gc_disk_headroom="0.1" --hadoop_home="" --help="false" --hostname_lookup="true" --image_provisioner_backend="copy" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher_dir="/mesos/mesos-0.28.0/_build/src" --logbufsecs="0" --logging_level="INFO" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --qos_correction_interval_min="0ns" --quiet="false" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resources="cpus:2;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/SlaveTest_CancelSlaveShutdown_UXpMkx" I0201 06:33:08.069001 988 credentials.hpp:83] Loading credential for authentication from '/tmp/SlaveTest_CancelSlaveShutdown_UXpMkx/credential' I0201 06:33:08.073431 988 slave.cpp:323] Slave using credential for: test-principal I0201 06:33:08.073621 988 resources.cpp:564] Parsing resources as JSON failed: cpus:2;mem:1024;disk:1024;ports:[31000-32000] Trying semicolon-delimited string format instead I0201 06:33:08.074139 988 slave.cpp:463] Slave resources: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] I0201 06:33:08.074218 988 slave.cpp:471] Slave attributes: [ ] I0201 06:33:08.074244 988 slave.cpp:476] Slave hostname: 55c8beaba995 I0201 06:33:08.075776 995 state.cpp:58] Recovering state from '/tmp/SlaveTest_CancelSlaveShutdown_UXpMkx/meta' I0201 06:33:08.076215 995 status_update_manager.cpp:200] Recovering status update manager I0201 06:33:08.076412 995 containerizer.cpp:390] Recovering containerizer I0201 06:33:08.078109 995 provisioner.cpp:245] Provisioner recovery complete I0201 06:33:08.078578 995 slave.cpp:4495] Finished recovery I0201 06:33:08.079115 995 slave.cpp:4667] Querying resource estimator for oversubscribable resources I0201 06:33:08.079704 995 slave.cpp:795] New master detected at master@172.17.0.3:40620 I0201 06:33:08.079785 995 slave.cpp:858] Authenticating with master master@172.17.0.3:40620 I0201 06:33:08.079809 995 slave.cpp:863] Using default CRAM-MD5 authenticatee I0201 06:33:08.079954 995 slave.cpp:831] Detecting new master I0201 06:33:08.080065 995 slave.cpp:4681] Received oversubscribable resources from the resource estimator I0201 06:33:08.080148 995 status_update_manager.cpp:174] Pausing sending status updates I0201 06:33:08.080426 995 authenticatee.cpp:121] Creating new client SASL connection I0201 06:33:08.080741 995 master.cpp:5521] Authenticating slave(343)@172.17.0.3:40620 I0201 06:33:08.080916 995 authenticator.cpp:413] Starting authentication session for crammd5_authenticatee(741)@172.17.0.3:40620 I0201 06:33:08.081352 988 authenticator.cpp:98] Creating new server SASL connection I0201 06:33:08.081575 988 authenticatee.cpp:212] Received SASL authentication mechanisms: CRAM-MD5 I0201 06:33:08.081607 988 authenticatee.cpp:238] Attempting to authenticate with mechanism 'CRAM-MD5' I0201 06:33:08.081709 988 authenticator.cpp:203] Received SASL authentication start I0201 06:33:08.081785 988 authenticator.cpp:325] Authentication requires more steps I0201 06:33:08.081882 988 authenticatee.cpp:258] Received SASL authentication step I0201 06:33:08.081990 988 authenticator.cpp:231] Received SASL authentication step I0201 06:33:08.082026 988 auxprop.cpp:107] Request to lookup properties for user: 'test-principal' realm: '55c8beaba995' server FQDN: '55c8beaba995' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0201 06:33:08.082044 988 auxprop.cpp:179] Looking up auxiliary property '*userPassword' I0201 06:33:08.082101 988 auxprop.cpp:179] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0201 06:33:08.082145 988 auxprop.cpp:107] Request to lookup properties for user: 'test-principal' realm: '55c8beaba995' server FQDN: '55c8beaba995' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0201 06:33:08.082164 988 auxprop.cpp:129] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0201 06:33:08.082175 988 auxprop.cpp:129] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0201 06:33:08.082197 988 authenticator.cpp:317] Authentication success I0201 06:33:08.082437 983 authenticatee.cpp:298] Authentication success I0201 06:33:08.082535 983 master.cpp:5551] Successfully authenticated principal 'test-principal' at slave(343)@172.17.0.3:40620 I0201 06:33:08.082758 983 slave.cpp:926] Successfully authenticated with master master@172.17.0.3:40620 I0201 06:33:08.082902 983 slave.cpp:1320] Will retry registration in 10.396297ms if necessary I0201 06:33:08.083246 983 master.cpp:4235] Registering slave at slave(343)@172.17.0.3:40620 (55c8beaba995) with id 74ef59cf-3514-4e45-8bbe-79fc39e8d3ac-S0 I0201 06:33:08.083780 983 registrar.cpp:439] Applied 1 operations in 71603ns; attempting to update the 'registry' I0201 06:33:08.085283 990 log.cpp:683] Attempting to append 339 bytes to the log I0201 06:33:08.085536 990 coordinator.cpp:348] Coordinator attempting to write APPEND action at position 3 I0201 06:33:08.086370 984 replica.cpp:537] Replica received write request for position 3 from (10685)@172.17.0.3:40620 I0201 06:33:08.086997 988 authenticator.cpp:431] Authentication session cleanup for crammd5_authenticatee(741)@172.17.0.3:40620 I0201 06:33:08.095494 988 slave.cpp:1320] Will retry registration in 38.116377ms if necessary I0201 06:33:08.095909 988 master.cpp:4223] Ignoring register slave message from slave(343)@172.17.0.3:40620 (55c8beaba995) as admission is already in progress I0201 06:33:08.105320 984 leveldb.cpp:341] Persisting action (358 bytes) to leveldb took 18.886533ms I0201 06:33:08.105402 984 replica.cpp:712] Persisted action at 3 I0201 06:33:08.106744 991 replica.cpp:691] Replica received learned notice for position 3 from @0.0.0.0:0 I0201 06:33:08.134937 997 slave.cpp:1320] Will retry registration in 70.800772ms if necessary I0201 06:33:08.135280 997 master.cpp:4223] Ignoring register slave message from slave(343)@172.17.0.3:40620 (55c8beaba995) as admission is already in progress I0201 06:33:08.164325 991 leveldb.cpp:341] Persisting action (360 bytes) to leveldb took 57.515291ms I0201 06:33:08.164420 991 replica.cpp:712] Persisted action at 3 I0201 06:33:08.164458 991 replica.cpp:697] Replica learned APPEND action at position 3 I0201 06:33:08.166947 997 registrar.cpp:484] Successfully updated the 'registry' in 83.08096ms I0201 06:33:08.167078 991 log.cpp:702] Attempting to truncate the log to 3 I0201 06:33:08.167246 994 coordinator.cpp:348] Coordinator attempting to write TRUNCATE action at position 4 I0201 06:33:08.168393 994 replica.cpp:537] Replica received write request for position 4 from (10686)@172.17.0.3:40620 I0201 06:33:08.169641 997 master.cpp:4303] Registered slave 74ef59cf-3514-4e45-8bbe-79fc39e8d3ac-S0 at slave(343)@172.17.0.3:40620 (55c8beaba995) with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] I0201 06:33:08.169998 998 slave.cpp:970] Registered with master master@172.17.0.3:40620; given slave ID 74ef59cf-3514-4e45-8bbe-79fc39e8d3ac-S0 I0201 06:33:08.170027 998 fetcher.cpp:81] Clearing fetcher cache I0201 06:33:08.170070 993 hierarchical.cpp:473] Added slave 74ef59cf-3514-4e45-8bbe-79fc39e8d3ac-S0 (55c8beaba995) with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (allocated: ) I0201 06:33:08.170258 993 hierarchical.cpp:1403] No resources available to allocate! I0201 06:33:08.170292 993 hierarchical.cpp:1116] Performed allocation for slave 74ef59cf-3514-4e45-8bbe-79fc39e8d3ac-S0 in 181078ns I0201 06:33:08.170351 993 status_update_manager.cpp:181] Resuming sending status updates I0201 06:33:08.170698 998 slave.cpp:993] Checkpointing SlaveInfo to '/tmp/SlaveTest_CancelSlaveShutdown_UXpMkx/meta/slaves/74ef59cf-3514-4e45-8bbe-79fc39e8d3ac-S0/slave.info' I0201 06:33:08.171166 998 slave.cpp:1029] Forwarding total oversubscribed resources I0201 06:33:08.171370 998 slave.cpp:3435] Received ping from slave-observer(313)@172.17.0.3:40620 I0201 06:33:08.171466 991 master.cpp:4644] Received update of slave 74ef59cf-3514-4e45-8bbe-79fc39e8d3ac-S0 at slave(343)@172.17.0.3:40620 (55c8beaba995) with total oversubscribed resources I0201 06:33:08.172067 991 hierarchical.cpp:531] Slave 74ef59cf-3514-4e45-8bbe-79fc39e8d3ac-S0 (55c8beaba995) updated with oversubscribed resources (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: ) I0201 06:33:08.172216 991 hierarchical.cpp:1403] No resources available to allocate! I0201 06:33:08.172262 991 hierarchical.cpp:1116] Performed allocation for slave 74ef59cf-3514-4e45-8bbe-79fc39e8d3ac-S0 in 149404ns I0201 06:33:08.209316 994 leveldb.cpp:341] Persisting action (16 bytes) to leveldb took 40.852444ms I0201 06:33:08.209408 994 replica.cpp:712] Persisted action at 4 I0201 06:33:08.211027 996 replica.cpp:691] Replica received learned notice for position 4 from @0.0.0.0:0 I0201 06:33:08.247815 996 leveldb.cpp:341] Persisting action (18 bytes) to leveldb took 36.611483ms I0201 06:33:08.248014 996 leveldb.cpp:399] Deleting ~2 keys from leveldb took 97901ns I0201 06:33:08.248049 996 replica.cpp:712] Persisted action at 4 I0201 06:33:08.248093 996 replica.cpp:697] Replica learned TRUNCATE action at position 4 I0201 06:33:08.257622 983 hierarchical.cpp:1403] No resources available to allocate! I0201 06:33:08.257694 983 hierarchical.cpp:1096] Performed allocation for 1 slaves in 300582ns I0201 06:33:08.257796 983 slave.cpp:4667] Querying resource estimator for oversubscribable resources I0201 06:33:08.258589 994 slave.cpp:4681] Received oversubscribable resources from the resource estimator W0201 06:33:08.258882 983 group.cpp:503] Timed out waiting to connect to ZooKeeper. Forcing ZooKeeper session (sessionId=0) expiration I0201 06:33:08.259625 983 group.cpp:519] ZooKeeper session expired 2016-02-01 06:33:08,261:964(0x7f9b28422700):ZOO_INFO@zookeeper_close@2522: Freeing zookeeper resources for sessionId=0 2016-02-01 06:33:08,261:964(0x7f9b22c17700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5 2016-02-01 06:33:08,261:964(0x7f9b22c17700):ZOO_INFO@log_env@716: Client environment:host.name=55c8beaba995 2016-02-01 06:33:08,261:964(0x7f9b22c17700):ZOO_INFO@log_env@723: Client environment:os.name=Linux 2016-02-01 06:33:08,261:964(0x7f9b22c17700):ZOO_INFO@log_env@724: Client environment:os.arch=3.13.0-36-lowlatency 2016-02-01 06:33:08,261:964(0x7f9b22c17700):ZOO_INFO@log_env@725: Client environment:os.version=#63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 2016-02-01 06:33:08,261:964(0x7f9b22c17700):ZOO_INFO@log_env@733: Client environment:user.name=(null) 2016-02-01 06:33:08,261:964(0x7f9b22c17700):ZOO_INFO@log_env@741: Client environment:user.home=/home/mesos 2016-02-01 06:33:08,261:964(0x7f9b22c17700):ZOO_INFO@log_env@753: Client environment:user.dir=/tmp/jfM4uK 2016-02-01 06:33:08,261:964(0x7f9b22c17700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=127.0.0.1:53290 sessionTimeout=10000 watcher=0x7f9b344608dc sessionId=0 sessionPasswd=<null> context=0x7f9af402e040 flags=0 2016-02-01 06:33:08,263:964(0x7f9a7cffe700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:53290] zk retcode=-4, errno=111(Connection refused): server refused to accept the client 2016-02-01 06:33:11,599:964(0x7f9a7cffe700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:53290] zk retcode=-4, errno=111(Connection refused): server refused to accept the client 2016-02-01 06:33:14,935:964(0x7f9a7cffe700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:53290] zk retcode=-4, errno=111(Connection refused): server refused to accept the client 2016-02-01 06:33:18,271:964(0x7f9a7cffe700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:53290] zk retcode=-4, errno=111(Connection refused): server refused to accept the client 2016-02-01 06:33:21,607:964(0x7f9a7cffe700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:53290] zk retcode=-4, errno=111(Connection refused): server refused to accept the client ../../src/tests/slave_tests.cpp:1848: Failure Failed to wait 15secs for ping I0201 06:33:23.260924 964 master.cpp:1025] Master terminating I0201 06:33:23.263113 983 hierarchical.cpp:505] Removed slave 74ef59cf-3514-4e45-8bbe-79fc39e8d3ac-S0 I0201 06:33:23.263417 983 slave.cpp:3481] master@172.17.0.3:40620 exited W0201 06:33:23.263453 983 slave.cpp:3484] Master disconnected! Waiting for a new master to be elected ../../src/tests/slave_tests.cpp:1840: Failure Actual function call count doesn't match EXPECT_CALL(*slaveRemovalLimiter, acquire())... Expected: to be called once Actual: never called - unsatisfied and active I0201 06:33:23.320228 990 slave.cpp:667] Slave terminating ../../3rdparty/libprocess/include/process/gmock.hpp:444: Failure Actual function call count doesn't match EXPECT_CALL(filter->mock, filter(testing::A<const MessageEvent&>()))... Expected args: message matcher (8-byte object <88-4F 04-0C 9B-7F 00-00>, 1-byte object <4F>, 1-byte object <88>) Expected: to be called once Actual: never called - unsatisfied and active [ FAILED ] SlaveTest.CancelSlaveShutdown (16094 ms) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)