See <https://builds.apache.org/job/Mesos-Buildbot/BUILDTOOL=cmake,COMPILER=gcc,CONFIGURATION=--verbose%20--disable-libtool-wrappers,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1,OS=centos%3A7,label_exp=(ubuntu)&&(!ubuntu-us1)&&(!ubuntu-eu2)&&(!qnode3)&&(!H23)/4469/display/redirect?page=changes>
Changes: [xujyan] Downgraded the logging level of socket shutdown failures. ------------------------------------------ [...truncated 2.99 MB...] 3: I1117 20:08:19.117955 15996 authenticator.cpp:326] Authentication requires more steps 3: I1117 20:08:19.118046 15984 authenticatee.cpp:259] Received SASL authentication step 3: I1117 20:08:19.118144 15984 authenticator.cpp:232] Received SASL authentication step 3: I1117 20:08:19.118166 15984 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c88e1826282d' server FQDN: 'c88e1826282d' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 3: I1117 20:08:19.118175 15984 auxprop.cpp:181] Looking up auxiliary property '*userPassword' 3: I1117 20:08:19.118196 15984 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' 3: I1117 20:08:19.118214 15984 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c88e1826282d' server FQDN: 'c88e1826282d' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 3: I1117 20:08:19.118223 15984 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true 3: I1117 20:08:19.118229 15984 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true 3: I1117 20:08:19.118240 15984 authenticator.cpp:318] Authentication success 3: I1117 20:08:19.118324 15994 authenticatee.cpp:299] Authentication success 3: I1117 20:08:19.118358 15993 master.cpp:8315] Successfully authenticated principal 'test-principal' at [email protected]:34231 3: I1117 20:08:19.118388 15987 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(86)@172.17.0.5:34231 3: I1117 20:08:19.118623 15999 sched.cpp:502] Successfully authenticated with master [email protected]:34231 3: I1117 20:08:19.118645 15999 sched.cpp:824] Sending SUBSCRIBE call to [email protected]:34231 3: I1117 20:08:19.118734 15999 sched.cpp:857] Will retry registration in 178.68403ms if necessary 3: I1117 20:08:19.118863 16000 master.cpp:2961] Received SUBSCRIBE call for framework 'default' at [email protected]:34231 3: I1117 20:08:19.118923 16000 master.cpp:2278] Authorizing framework principal 'test-principal' to receive offers for roles '{ * }' 3: I1117 20:08:19.119289 16005 master.cpp:3041] Subscribing framework default with checkpointing disabled and capabilities [ RESERVATION_REFINEMENT ] 3: I1117 20:08:19.119870 15988 sched.cpp:751] Framework registered with 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 3: I1117 20:08:19.119925 15992 hierarchical.cpp:303] Added framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 3: I1117 20:08:19.119951 15988 sched.cpp:765] Scheduler::registered took 58288ns 3: I1117 20:08:19.120096 15992 hierarchical.cpp:1450] Performed allocation for 0 agents in 51900ns 3: I1117 20:08:19.120311 15996 master.cpp:1423] Framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 (default) at [email protected]:34231 disconnected 3: I1117 20:08:19.120342 15996 master.cpp:3331] Deactivating framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 (default) at [email protected]:34231 3: I1117 20:08:19.120380 15996 master.cpp:3308] Disconnecting framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 (default) at [email protected]:34231 3: I1117 20:08:19.120394 15984 sched.cpp:1175] Got error 'Framework disconnected' 3: I1117 20:08:19.120409 15984 sched.cpp:2043] Asked to abort the driver 3: I1117 20:08:19.120416 15996 master.cpp:1438] Giving framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 (default) at [email protected]:34231 0ns to failover 3: I1117 20:08:19.120452 15984 sched.cpp:1186] Scheduler::error took 22334ns 3: I1117 20:08:19.120486 15989 hierarchical.cpp:412] Deactivated framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 3: I1117 20:08:19.120512 15984 sched.cpp:1221] Aborting framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 3: I1117 20:08:19.120784 15987 master.cpp:3287] Ignoring deactivate framework message for framework54616ee6-b365-48c9-b52c-4d83f0426b70-0000 (default) at [email protected]:34231 because it is disconnected 3: I1117 20:08:19.121839 16005 master.cpp:7947] Framework failover timeout, removing framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 (default) at [email protected]:34231 3: I1117 20:08:19.121870 16005 master.cpp:8804] Removing framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 (default) at [email protected]:34231 3: I1117 20:08:19.122342 16001 hierarchical.cpp:355] Removed framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 3: W1117 20:08:19.122848 15983 process.cpp:3185] Attempted to spawn already running process [email protected]:34231 3: I1117 20:08:19.123541 15983 sched.cpp:232] Version: 1.5.0 3: I1117 20:08:19.123963 15990 sched.cpp:336] New master detected at [email protected]:34231 3: I1117 20:08:19.124071 15990 sched.cpp:396] Authenticating with master [email protected]:34231 3: I1117 20:08:19.124089 15990 sched.cpp:403] Using default CRAM-MD5 authenticatee 3: I1117 20:08:19.124363 15992 authenticatee.cpp:121] Creating new client SASL connection 3: I1117 20:08:19.124620 15991 master.cpp:8285] Authenticating [email protected]:34231 3: I1117 20:08:19.124745 15986 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(87)@172.17.0.5:34231 3: I1117 20:08:19.125020 15994 authenticator.cpp:98] Creating new server SASL connection 3: I1117 20:08:19.125284 15989 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 3: I1117 20:08:19.125308 15989 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' 3: I1117 20:08:19.125406 15989 authenticator.cpp:204] Received SASL authentication start 3: I1117 20:08:19.125452 15989 authenticator.cpp:326] Authentication requires more steps 3: I1117 20:08:19.125542 15989 authenticatee.cpp:259] Received SASL authentication step 3: I1117 20:08:19.125663 16004 authenticator.cpp:232] Received SASL authentication step 3: I1117 20:08:19.125689 16004 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c88e1826282d' server FQDN: 'c88e1826282d' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 3: I1117 20:08:19.125700 16004 auxprop.cpp:181] Looking up auxiliary property '*userPassword' 3: I1117 20:08:19.125725 16004 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' 3: I1117 20:08:19.125741 16004 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c88e1826282d' server FQDN: 'c88e1826282d' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 3: I1117 20:08:19.125751 16004 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true 3: I1117 20:08:19.125756 16004 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true 3: I1117 20:08:19.125767 16004 authenticator.cpp:318] Authentication success 3: I1117 20:08:19.125843 15999 authenticatee.cpp:299] Authentication success 3: I1117 20:08:19.125893 16000 master.cpp:8315] Successfully authenticated principal 'test-principal' at [email protected]:34231 3: I1117 20:08:19.125939 16002 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(87)@172.17.0.5:34231 3: I1117 20:08:19.126093 15999 sched.cpp:502] Successfully authenticated with master [email protected]:34231 3: I1117 20:08:19.126109 15999 sched.cpp:824] Sending SUBSCRIBE call to [email protected]:34231 3: I1117 20:08:19.126206 15999 sched.cpp:857] Will retry registration in 301.554486ms if necessary 3: I1117 20:08:19.126348 15985 master.cpp:2951] Refusing subscription of framework 'default' at [email protected]:34231: Framework has been removed 3: I1117 20:08:19.126474 15985 sched.cpp:1175] Got error 'Framework has been removed' 3: I1117 20:08:19.126489 15985 sched.cpp:2043] Asked to abort the driver 3: I1117 20:08:19.126533 15985 sched.cpp:1186] Scheduler::error took 19164ns 3: I1117 20:08:19.126567 15985 sched.cpp:1221] Aborting framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 3: I1117 20:08:19.126579 15985 sched.cpp:1226] Not sending a deactivate message as master is disconnected 3: I1117 20:08:19.126713 15983 sched.cpp:2009] Asked to stop the driver 3: I1117 20:08:19.126760 15983 sched.cpp:2009] Asked to stop the driver 3: I1117 20:08:19.126830 16007 sched.cpp:1191] Stopping framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 3: I1117 20:08:19.126849 15988 sched.cpp:1191] Stopping framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 3: W1117 20:08:19.127037 15990 master.cpp:2344] Dropping TEARDOWN call from framework 54616ee6-b365-48c9-b52c-4d83f0426b70-0000 at [email protected]:34231: Framework cannot be found 3: I1117 20:08:19.127634 15983 master.cpp:1151] Master terminating 3: [ OK ] FaultToleranceTest.SchedulerReregisterAfterFailoverTimeout (28 ms) 3: [ RUN ] FaultToleranceTest.SchedulerReregisterAfterUnregistration 3: I1117 20:08:19.134013 15983 cluster.cpp:162] Creating default 'local' authorizer 3: I1117 20:08:19.137060 15998 master.cpp:448] Master 00f9e9f7-32e1-4bd4-b41f-88f8d0518186 (c88e1826282d) started on 172.17.0.5:34231 3: I1117 20:08:19.137078 15998 master.cpp:450] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="1secs" --allocator="HierarchicalDRF" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/717UNU/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_unreachable_tasks_per_framework="1000" --port="5050" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --root_submissions="true" --user_sorter="drf" --version="false" --webui_dir="/usr/local/share/mesos/webui" --work_dir="/tmp/717UNU/master" --zk_session_timeout="10secs" 3: I1117 20:08:19.137370 15998 master.cpp:499] Master only allowing authenticated frameworks to register 3: I1117 20:08:19.137377 15998 master.cpp:505] Master only allowing authenticated agents to register 3: I1117 20:08:19.137388 15998 master.cpp:511] Master only allowing authenticated HTTP frameworks to register 3: I1117 20:08:19.137393 15998 credentials.hpp:37] Loading credentials for authentication from '/tmp/717UNU/credentials' 3: I1117 20:08:19.137645 15998 master.cpp:555] Using default 'crammd5' authenticator 3: I1117 20:08:19.137769 15998 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' 3: I1117 20:08:19.137895 15998 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' 3: I1117 20:08:19.138006 15998 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' 3: I1117 20:08:19.138118 15998 master.cpp:634] Authorization enabled 3: I1117 20:08:19.138262 16002 hierarchical.cpp:171] Initialized hierarchical allocator process 3: I1117 20:08:19.138278 15991 whitelist_watcher.cpp:77] No whitelist given 3: I1117 20:08:19.140933 15984 master.cpp:2213] Elected as the leading master! 3: I1117 20:08:19.140954 15984 master.cpp:1693] Recovering from registrar 3: I1117 20:08:19.141060 15997 registrar.cpp:347] Recovering registrar 3: I1117 20:08:19.141655 15997 registrar.cpp:391] Successfully fetched the registry (0B) in 559872ns 3: I1117 20:08:19.141767 15997 registrar.cpp:495] Applied 1 operations in 23531ns; attempting to update the registry 3: I1117 20:08:19.142381 15997 registrar.cpp:552] Successfully updated the registry in 566016ns 3: I1117 20:08:19.142520 15997 registrar.cpp:424] Successfully recovered registrar 3: I1117 20:08:19.143002 16001 master.cpp:1806] Recovered 0 agents from the registry (129B); allowing 10mins for agents to re-register 3: I1117 20:08:19.143074 16007 hierarchical.cpp:209] Skipping recovery of hierarchical allocator: nothing to recover 3: W1117 20:08:19.143666 15983 process.cpp:3185] Attempted to spawn already running process [email protected]:34231 3: I1117 20:08:19.144474 15983 sched.cpp:232] Version: 1.5.0 3: I1117 20:08:19.144953 15994 sched.cpp:336] New master detected at [email protected]:34231 3: I1117 20:08:19.145068 15994 sched.cpp:396] Authenticating with master [email protected]:34231 3: I1117 20:08:19.145083 15994 sched.cpp:403] Using default CRAM-MD5 authenticatee 3: I1117 20:08:19.145407 15987 authenticatee.cpp:121] Creating new client SASL connection 3: I1117 20:08:19.145689 16000 master.cpp:8285] Authenticating [email protected]:34231 3: I1117 20:08:19.145798 16005 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(88)@172.17.0.5:34231 3: I1117 20:08:19.146018 15993 authenticator.cpp:98] Creating new server SASL connection 3: I1117 20:08:19.146225 16003 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 3: I1117 20:08:19.146250 16003 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' 3: I1117 20:08:19.146351 15999 authenticator.cpp:204] Received SASL authentication start 3: I1117 20:08:19.146392 15999 authenticator.cpp:326] Authentication requires more steps 3: I1117 20:08:19.146514 16006 authenticatee.cpp:259] Received SASL authentication step 3: I1117 20:08:19.146621 16006 authenticator.cpp:232] Received SASL authentication step 3: I1117 20:08:19.146646 16006 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c88e1826282d' server FQDN: 'c88e1826282d' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 3: I1117 20:08:19.146654 16006 auxprop.cpp:181] Looking up auxiliary property '*userPassword' 3: I1117 20:08:19.146677 16006 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' 3: I1117 20:08:19.146693 16006 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c88e1826282d' server FQDN: 'c88e1826282d' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 3: I1117 20:08:19.146703 16006 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true 3: I1117 20:08:19.146709 16006 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true 3: I1117 20:08:19.146720 16006 authenticator.cpp:318] Authentication success 3: I1117 20:08:19.146791 15997 authenticatee.cpp:299] Authentication success 3: I1117 20:08:19.146870 15988 master.cpp:8315] Successfully authenticated principal 'test-principal' at [email protected]:34231 3: I1117 20:08:19.146929 16006 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(88)@172.17.0.5:34231 3: I1117 20:08:19.147068 15985 sched.cpp:502] Successfully authenticated with master [email protected]:34231 3: I1117 20:08:19.147090 15985 sched.cpp:824] Sending SUBSCRIBE call to [email protected]:34231 3: I1117 20:08:19.147192 15985 sched.cpp:857] Will retry registration in 1.264692701secs if necessary 3: I1117 20:08:19.147403 15986 master.cpp:2961] Received SUBSCRIBE call for framework 'default' at [email protected]:34231 3: I1117 20:08:19.147536 15986 master.cpp:2278] Authorizing framework principal 'test-principal' to receive offers for roles '{ * }' 3: I1117 20:08:19.148035 15991 master.cpp:3041] Subscribing framework default with checkpointing disabled and capabilities [ RESERVATION_REFINEMENT ] 3: I1117 20:08:19.148628 15991 sched.cpp:751] Framework registered with 00f9e9f7-32e1-4bd4-b41f-88f8d0518186-0000 3: I1117 20:08:19.148672 16002 hierarchical.cpp:303] Added framework 00f9e9f7-32e1-4bd4-b41f-88f8d0518186-0000 3: I1117 20:08:19.148677 15991 sched.cpp:765] Scheduler::registered took 27288ns 3: I1117 20:08:19.148818 15983 sched.cpp:2009] Asked to stop the driver 3: I1117 20:08:19.148844 16002 hierarchical.cpp:1450] Performed allocation for 0 agents in 61851ns 3: I1117 20:08:19.148895 15999 sched.cpp:1191] Stopping framework 00f9e9f7-32e1-4bd4-b41f-88f8d0518186-0000 3: I1117 20:08:19.149114 15995 master.cpp:8792] Processing TEARDOWN call for framework 00f9e9f7-32e1-4bd4-b41f-88f8d0518186-0000 (default) at [email protected]:34231 3: I1117 20:08:19.149142 15995 master.cpp:8804] Removing framework 00f9e9f7-32e1-4bd4-b41f-88f8d0518186-0000 (default) at [email protected]:34231 3: I1117 20:08:19.149154 15995 master.cpp:3331] Deactivating framework 00f9e9f7-32e1-4bd4-b41f-88f8d0518186-0000 (default) at [email protected]:34231 3: I1117 20:08:19.149394 16001 hierarchical.cpp:412] Deactivated framework 00f9e9f7-32e1-4bd4-b41f-88f8d0518186-0000 3: I1117 20:08:19.149782 16001 hierarchical.cpp:355] Removed framework 00f9e9f7-32e1-4bd4-b41f-88f8d0518186-0000 3: W1117 20:08:19.150187 15983 process.cpp:3185] Attempted to spawn already running process [email protected]:34231 3: I1117 20:08:19.150831 15983 sched.cpp:232] Version: 1.5.0 3: I1117 20:08:19.151309 15991 sched.cpp:336] New master detected at [email protected]:34231 3: I1117 20:08:19.151402 15991 sched.cpp:396] Authenticating with master [email protected]:34231 3: I1117 20:08:19.151417 15991 sched.cpp:403] Using default CRAM-MD5 authenticatee 3: I1117 20:08:19.151676 16003 authenticatee.cpp:121] Creating new client SASL connection 3: I1117 20:08:19.151929 16003 master.cpp:8285] Authenticating [email protected]:34231 3: I1117 20:08:19.152024 15999 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(89)@172.17.0.5:34231 3: I1117 20:08:19.152225 15988 authenticator.cpp:98] Creating new server SASL connection 3: I1117 20:08:19.152412 15992 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 3: I1117 20:08:19.152463 15992 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' 3: I1117 20:08:19.152623 15997 authenticator.cpp:204] Received SASL authentication start 3: I1117 20:08:19.152680 15997 authenticator.cpp:326] Authentication requires more steps 3: I1117 20:08:19.152827 16007 authenticatee.cpp:259] Received SASL authentication step 3: I1117 20:08:19.152981 16007 authenticator.cpp:232] Received SASL authentication step 3: I1117 20:08:19.153023 16007 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c88e1826282d' server FQDN: 'c88e1826282d' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 3: I1117 20:08:19.153038 16007 auxprop.cpp:181] Looking up auxiliary property '*userPassword' 3: I1117 20:08:19.153066 16007 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' 3: I1117 20:08:19.153096 16007 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c88e1826282d' server FQDN: 'c88e1826282d' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 3: I1117 20:08:19.153108 16007 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true 3: I1117 20:08:19.153118 16007 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true 3: I1117 20:08:19.153136 16007 authenticator.cpp:318] Authentication success 3: I1117 20:08:19.153216 15995 authenticatee.cpp:299] Authentication success 3: I1117 20:08:19.153282 16006 master.cpp:8315] Successfully authenticated principal 'test-principal' at [email protected]:34231 3: I1117 20:08:19.153302 15995 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(89)@172.17.0.5:34231 3: I1117 20:08:19.153499 15990 sched.cpp:502] Successfully authenticated with master [email protected]:34231 3: I1117 20:08:19.153519 15990 sched.cpp:824] Sending SUBSCRIBE call to [email protected]:34231 3: I1117 20:08:19.153640 15990 sched.cpp:857] Will retry registration in 203.24585ms if necessary 3: I1117 20:08:19.153767 15989 master.cpp:2951] Refusing subscription of framework 'default' at [email protected]:34231: Framework has been removed 3: I1117 20:08:19.153897 15984 sched.cpp:1175] Got error 'Framework has been removed' 3: I1117 20:08:19.153915 15984 sched.cpp:2043] Asked to abort the driver 3: I1117 20:08:19.153971 15984 sched.cpp:1186] Scheduler::error took 34751ns 3: I1117 20:08:19.154007 15984 sched.cpp:1221] Aborting framework 00f9e9f7-32e1-4bd4-b41f-88f8d0518186-0000 3: I1117 20:08:19.154018 15984 sched.cpp:1226] Not sending a deactivate message as master is disconnected 3: I1117 20:08:19.154202 15983 sched.cpp:2009] Asked to stop the driver 3: I1117 20:08:19.154981 15983 master.cpp:1151] Master terminating 3: [ OK ] FaultToleranceTest.SchedulerReregisterAfterUnregistration (27 ms) 3: [ RUN ] FaultToleranceTest.SchedulerFailoverRetriedReregistration 3: I1117 20:08:19.160249 15983 cluster.cpp:162] Creating default 'local' authorizer 3: I1117 20:08:19.163316 15994 master.cpp:448] Master ffd3bef6-f11f-4416-8019-1fd8f6552e88 (c88e1826282d) started on 172.17.0.5:34231 3: I1117 20:08:19.163338 15994 master.cpp:450] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="1secs" --allocator="HierarchicalDRF" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/ygBT5u/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_unreachable_tasks_per_framework="1000" --port="5050" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --root_submissions="true" --user_sorter="drf" --version="false" --webui_dir="/usr/local/share/mesos/webui" --work_dir="/tmp/ygBT5u/master" --zk_session_timeout="10secs" 3: I1117 20:08:19.163718 15994 master.cpp:499] Master only allowing authenticated frameworks to register 3: I1117 20:08:19.163725 15994 master.cpp:505] Master only allowing authenticated agents to register 3: I1117 20:08:19.163733 15994 master.cpp:511] Master only allowing authenticated HTTP frameworks to register 3: I1117 20:08:19.163741 15994 credentials.hpp:37] Loading credentials for authentication from '/tmp/ygBT5u/credentials' 3: I1117 20:08:19.164060 15994 master.cpp:555] Using default 'crammd5' authenticator 3: I1117 20:08:19.164206 15994 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' 3: I1117 20:08:19.164338 15994 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' 3: I1117 20:08:19.164466 15994 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' 3: I1117 20:08:19.164585 15994 master.cpp:634] Authorization enabled 3: I1117 20:08:19.164729 16003 hierarchical.cpp:171] Initialized hierarchical allocator process 3: I1117 20:08:19.164757 15985 whitelist_watcher.cpp:77] No whitelist given 3: I1117 20:08:19.167225 15986 master.cpp:2213] Elected as the leading master! 3: I1117 20:08:19.167250 15986 master.cpp:1693] Recovering from registrar 3: I1117 20:08:19.167398 15998 registrar.cpp:347] Recovering registrar 3: I1117 20:08:19.167840 15998 registrar.cpp:391] Successfully fetched the registry (0B) in 410112ns 3: I1117 20:08:19.167919 15998 registrar.cpp:495] Applied 1 operations in 17883ns; attempting to update the registry 3: I1117 20:08:19.168352 15998 registrar.cpp:552] Successfully updated the registry in 391936ns 3: I1117 20:08:19.168449 15998 registrar.cpp:424] Successfully recovered registrar 3: I1117 20:08:19.168774 16000 master.cpp:1806] Recovered 0 agents from the registry (129B); allowing 10mins for agents to re-register 3: I1117 20:08:19.168862 16004 hierarchical.cpp:209] Skipping recovery of hierarchical allocator: nothing to recover 3: W1117 20:08:19.169553 15983 process.cpp:3185] Attempted to spawn already running process [email protected]:34231 3: I1117 20:08:19.170328 15983 sched.cpp:232] Version: 1.5.0 3: I1117 20:08:19.170774 15995 sched.cpp:336] New master detected at [email protected]:34231 3: I1117 20:08:19.170862 15995 sched.cpp:396] Authenticating with master [email protected]:34231 3: I1117 20:08:19.170877 15995 sched.cpp:403] Using default CRAM-MD5 authenticatee 3: I1117 20:08:19.171094 15986 authenticatee.cpp:121] Creating new client SASL connection 3: I1117 20:08:19.171365 15990 master.cpp:8285] Authenticating [email protected]:34231 3: I1117 20:08:19.171464 16001 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(90)@172.17.0.5:34231 3: I1117 20:08:19.171682 15993 authenticator.cpp:98] Creating new server SASL connection 3: I1117 20:08:19.171900 15989 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 3: I1117 20:08:19.171926 15989 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' 3: I1117 20:08:19.172021 16005 authenticator.cpp:204] Received SASL authentication start 3: I1117 20:08:19.172065 16005 authenticator.cpp:326] Authentication requires more steps 3: I1117 20:08:19.172152 16005 authenticatee.cpp:259] Received SASL authentication step 3: I1117 20:08:19.172240 16005 authenticator.cpp:232] Received SASL authentication step 3: I1117 20:08:19.172269 16005 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c88e1826282d' server FQDN: 'c88e1826282d' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 3: I1117 20:08:19.172277 16005 auxprop.cpp:181] Looking up auxiliary property '*userPassword' 3: I1117 20:08:19.172298 16005 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' 3: I1117 20:08:19.172312 16005 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'c88e1826282d' server FQDN: 'c88e1826282d' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 3: I1117 20:08:19.172320 16005 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true 3: I1117 20:08:19.172325 16005 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true 3: I1117 20:08:19.172343 16005 authenticator.cpp:318] Authentication success 3: I1117 20:08:19.172441 16002 authenticatee.cpp:299] Authentication success 3: I1117 20:08:19.172447 15998 master.cpp:8315] Successfully authenticated principal 'test-principal' at [email protected]:34231 3: I1117 20:08:19.172518 15991 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(90)@172.17.0.5:34231 3: I1117 20:08:19.172662 15998 sched.cpp:502] Successfully authenticated with master [email protected]:34231 3: I1117 20:08:19.172682 15998 sched.cpp:824] Sending SUBSCRIBE call to [email protected]:34231 3: I1117 20:08:19.172765 15998 sched.cpp:857] Will retry registration in 1.188184532secs if necessary 3: I1117 20:08:19.172937 15997 master.cpp:2961] Received SUBSCRIBE call for framework 'default' at [email protected]:34231 3: I1117 20:08:19.173007 15997 master.cpp:2278] Authorizing framework principal 'test-principal' to receive offers for roles '{ * }' 3: I1117 20:08:19.173420 15994 master.cpp:3041] Subscribing framework default with checkpointing disabled and capabilities [ RESERVATION_REFINEMENT ] 3: I1117 20:08:19.173895 15985 sched.cpp:751] Framework registered with ffd3bef6-f11f-4416-8019-1fd8f6552e88-0000 3: I1117 20:08:19.173984 15985 sched.cpp:765] Scheduler::registered took 61378ns 3: I1117 20:08:19.173996 15988 hierarchical.cpp:303] Added framework ffd3bef6-f11f-4416-8019-1fd8f6552e88-0000 3: I1117 20:08:19.174159 15988 hierarchical.cpp:1450] Performed allocation for 0 agents in 53728ns 3: W1117 20:08:19.174538 15983 process.cpp:3185] Attempted to spawn already running process [email protected]:34231 3: I1117 20:08:19.175251 15983 sched.cpp:232] Version: 1.5.0 3: I1117 20:08:19.175679 15989 sched.cpp:336] New master detected at [email protected]:34231 3: I1117 20:08:19.175782 15989 sched.cpp:396] Authenticating with master [email protected]:34231 3: I1117 20:08:19.175797 15989 sched.cpp:403] Using default CRAM-MD5 authenticatee 3: I1117 20:08:19.176009 16000 authenticatee.cpp:121] Creating new client SASL connection 3: I1117 20:08:19.176241 15989 master.cpp:8285] Authenticating [email protected]:34231 write /dev/stdout: resource temporarily unavailable Build step 'Execute shell' marked build as failure Not sending mail to unregistered user [email protected]
