See <https://builds.apache.org/job/Mesos-Buildbot/BUILDTOOL=cmake,COMPILER=clang,CONFIGURATION=--verbose%20--disable-libtool-wrappers,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1,OS=ubuntu%3A14.04,label_exp=(ubuntu)&&(!ubuntu-us1)&&(!ubuntu-eu2)&&(!qnode3)&&(!H23)/4664/display/redirect?page=changes>
Changes: [yujie.jay] Set container info from executor by default if available. [yujie.jay] Cleaned up ContainerInfo generation logic in the slave. ------------------------------------------ [...truncated 3.44 MB...] 3: I1222 21:51:24.935214 15998 authenticatee.cpp:121] Creating new client SASL connection 3: I1222 21:51:24.935500 16005 master.cpp:8928] Authenticating slave(55)@172.17.0.5:41279 3: I1222 21:51:24.935595 15999 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(122)@172.17.0.5:41279 3: I1222 21:51:24.935890 15996 authenticator.cpp:98] Creating new server SASL connection 3: I1222 21:51:24.936208 16003 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 3: I1222 21:51:24.936236 16003 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' 3: I1222 21:51:24.936343 16003 authenticator.cpp:204] Received SASL authentication start 3: I1222 21:51:24.936390 16003 authenticator.cpp:326] Authentication requires more steps 3: I1222 21:51:24.936517 16000 authenticatee.cpp:259] Received SASL authentication step 3: I1222 21:51:24.936668 16002 authenticator.cpp:232] Received SASL authentication step 3: I1222 21:51:24.936689 16002 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '0f34bc323f81' server FQDN: '0f34bc323f81' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 3: I1222 21:51:24.936699 16002 auxprop.cpp:181] Looking up auxiliary property '*userPassword' 3: I1222 21:51:24.936728 16002 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' 3: I1222 21:51:24.936754 16002 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '0f34bc323f81' server FQDN: '0f34bc323f81' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 3: I1222 21:51:24.936767 16002 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true 3: I1222 21:51:24.936775 16002 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true 3: I1222 21:51:24.936792 16002 authenticator.cpp:318] Authentication success 3: I1222 21:51:24.936875 16007 authenticatee.cpp:299] Authentication success 3: I1222 21:51:24.936913 16006 master.cpp:8958] Successfully authenticated principal 'test-principal' at slave(55)@172.17.0.5:41279 3: I1222 21:51:24.936959 16004 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(122)@172.17.0.5:41279 3: I1222 21:51:24.937157 16008 slave.cpp:1229] Successfully authenticated with master [email protected]:41279 3: I1222 21:51:24.937347 16008 slave.cpp:1708] Will retry registration in 11.41389ms if necessary 3: I1222 21:51:24.937480 16010 master.cpp:6078] Received register agent message from slave(55)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:24.937520 16010 master.cpp:3867] Authorizing agent with principal 'test-principal' 3: I1222 21:51:24.937844 16005 master.cpp:6148] Authorized registration of agent at slave(55)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:24.937922 16005 master.cpp:6241] Registering agent at slave(55)@172.17.0.5:41279 (0f34bc323f81) with id 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 3: I1222 21:51:24.938350 15999 registrar.cpp:495] Applied 1 operations in 91813ns; attempting to update the registry 3: I1222 21:51:24.938892 15999 registrar.cpp:552] Successfully updated the registry in 495104ns 3: I1222 21:51:24.939016 16002 master.cpp:6289] Admitted agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 at slave(55)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:24.939555 16002 master.cpp:6338] Registered agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 at slave(55)@172.17.0.5:41279 (0f34bc323f81) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] 3: I1222 21:51:24.939666 16006 slave.cpp:1275] Registered with master [email protected]:41279; given agent ID 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 3: I1222 21:51:24.939761 15997 task_status_update_manager.cpp:188] Resuming sending task status updates 3: I1222 21:51:24.939909 16001 hierarchical.cpp:574] Added agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 (0f34bc323f81) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (allocated: {}) 3: I1222 21:51:24.939985 16006 slave.cpp:1295] Checkpointing SlaveInfo to '/tmp/FaultToleranceTest_SchedulerExit_c3A3L0/meta/slaves/47c79df2-d3d9-4b77-b2a1-37113475afef-S0/slave.info' 3: I1222 21:51:24.940392 16006 slave.cpp:1352] Forwarding agent update {"operations":{},"resource_version_uuid":{"value":"ufpCEaoYSg2+jxbnOOFBNw=="},"slave_id":{"value":"47c79df2-d3d9-4b77-b2a1-37113475afef-S0"},"update_oversubscribed_resources":true} 3: I1222 21:51:24.940619 16008 master.cpp:7268] Received update of agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 at slave(55)@172.17.0.5:41279 (0f34bc323f81) with total oversubscribed resources {} 3: I1222 21:51:24.940865 16008 master.cpp:7362] Ignoring update on agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 at slave(55)@172.17.0.5:41279 (0f34bc323f81) as it reports no changes 3: I1222 21:51:24.941110 16001 hierarchical.cpp:1517] Performed allocation for 1 agents in 1.082455ms 3: I1222 21:51:24.941659 16010 master.cpp:8758] Sending 1 offers to framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 (default) at [email protected]:41279 3: I1222 21:51:24.942281 15998 sched.cpp:921] Scheduler::resourceOffers took 162894ns 3: I1222 21:51:24.944108 15997 master.cpp:10671] Removing offer 47c79df2-d3d9-4b77-b2a1-37113475afef-O0 3: I1222 21:51:24.944243 15997 master.cpp:4274] Processing ACCEPT call for offers: [ 47c79df2-d3d9-4b77-b2a1-37113475afef-O0 ] on agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 at slave(55)@172.17.0.5:41279 (0f34bc323f81) for framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 (default) at [email protected]:41279 3: I1222 21:51:24.944346 15997 master.cpp:3594] Authorizing framework principal 'test-principal' to launch task 1 3: W1222 21:51:24.946522 16001 validation.cpp:1386] Executor 'default' for task '1' uses less CPUs (None) than the minimum required (0.01). Please update your executor, as this will be mandatory in future releases. 3: W1222 21:51:24.946557 16001 validation.cpp:1398] Executor 'default' for task '1' uses less memory (None) than the minimum required (32MB). Please update your executor, as this will be mandatory in future releases. 3: I1222 21:51:24.947219 16001 master.cpp:11426] Adding task 1 with resources cpus(allocated: *):2; mem(allocated: *):1024; disk(allocated: *):1024; ports(allocated: *):[31000-32000] on agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 at slave(55)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:24.947679 16001 master.cpp:5025] Launching task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 (default) at [email protected]:41279 with resources [{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] on agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 at slave(55)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:24.948505 16009 slave.cpp:1831] Got assigned task '1' for framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.949265 16009 slave.cpp:2101] Authorizing task '1' for framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.949344 16009 slave.cpp:7889] Authorizing framework principal 'test-principal' to launch task 1 3: I1222 21:51:24.950484 16003 slave.cpp:2494] Launching task '1' for framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.951162 16003 paths.cpp:756] Trying to chown '/tmp/FaultToleranceTest_SchedulerExit_c3A3L0/slaves/47c79df2-d3d9-4b77-b2a1-37113475afef-S0/frameworks/47c79df2-d3d9-4b77-b2a1-37113475afef-0000/executors/default/runs/c11a9f86-1274-4b88-85fe-f011a23d23ee' to user 'mesos' 3: I1222 21:51:24.951454 16003 slave.cpp:8363] Launching executor 'default' of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 with resources [] in work directory '/tmp/FaultToleranceTest_SchedulerExit_c3A3L0/slaves/47c79df2-d3d9-4b77-b2a1-37113475afef-S0/frameworks/47c79df2-d3d9-4b77-b2a1-37113475afef-0000/executors/default/runs/c11a9f86-1274-4b88-85fe-f011a23d23ee' 3: I1222 21:51:24.952308 16003 slave.cpp:3054] Launching container c11a9f86-1274-4b88-85fe-f011a23d23ee for executor 'default' of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.952952 16003 slave.cpp:2580] Queued task '1' for executor 'default' of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.953060 16003 slave.cpp:1006] Successfully attached '/tmp/FaultToleranceTest_SchedulerExit_c3A3L0/slaves/47c79df2-d3d9-4b77-b2a1-37113475afef-S0/frameworks/47c79df2-d3d9-4b77-b2a1-37113475afef-0000/executors/default/runs/c11a9f86-1274-4b88-85fe-f011a23d23ee' to virtual path '/tmp/FaultToleranceTest_SchedulerExit_c3A3L0/slaves/47c79df2-d3d9-4b77-b2a1-37113475afef-S0/frameworks/47c79df2-d3d9-4b77-b2a1-37113475afef-0000/executors/default/runs/latest' 3: I1222 21:51:24.953110 16003 slave.cpp:1006] Successfully attached '/tmp/FaultToleranceTest_SchedulerExit_c3A3L0/slaves/47c79df2-d3d9-4b77-b2a1-37113475afef-S0/frameworks/47c79df2-d3d9-4b77-b2a1-37113475afef-0000/executors/default/runs/c11a9f86-1274-4b88-85fe-f011a23d23ee' to virtual path '/frameworks/47c79df2-d3d9-4b77-b2a1-37113475afef-0000/executors/default/runs/latest' 3: I1222 21:51:24.953155 16003 slave.cpp:1006] Successfully attached '/tmp/FaultToleranceTest_SchedulerExit_c3A3L0/slaves/47c79df2-d3d9-4b77-b2a1-37113475afef-S0/frameworks/47c79df2-d3d9-4b77-b2a1-37113475afef-0000/executors/default/runs/c11a9f86-1274-4b88-85fe-f011a23d23ee' to virtual path '/tmp/FaultToleranceTest_SchedulerExit_c3A3L0/slaves/47c79df2-d3d9-4b77-b2a1-37113475afef-S0/frameworks/47c79df2-d3d9-4b77-b2a1-37113475afef-0000/executors/default/runs/c11a9f86-1274-4b88-85fe-f011a23d23ee' 3: W1222 21:51:24.956179 15995 process.cpp:2756] Attempted to spawn already running process [email protected]:41279 3: I1222 21:51:24.956398 15995 exec.cpp:162] Version: 1.5.0 3: I1222 21:51:24.956682 16006 exec.cpp:212] Executor started at: executor(9)@172.17.0.5:41279 with pid 15994 3: I1222 21:51:24.956856 16004 slave.cpp:4321] Got registration for executor 'default' of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 from executor(9)@172.17.0.5:41279 3: I1222 21:51:24.957192 15997 exec.cpp:236] Executor registered on agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 3: I1222 21:51:24.957228 15997 exec.cpp:248] Executor::registered took 24421ns 3: I1222 21:51:24.958051 16005 slave.cpp:2785] Sending queued task '1' to executor 'default' of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 at executor(9)@172.17.0.5:41279 3: I1222 21:51:24.958467 16009 exec.cpp:330] Executor asked to run task '1' 3: I1222 21:51:24.958575 16009 exec.cpp:339] Executor::launchTask took 94845ns 3: I1222 21:51:24.958712 16009 exec.cpp:581] Executor sending status update TASK_RUNNING (Status UUID: 98e7d656-cfb3-4cc9-827b-ad648c63a053) for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.959045 16009 slave.cpp:4778] Handling status update TASK_RUNNING (Status UUID: 98e7d656-cfb3-4cc9-827b-ad648c63a053) for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 from executor(9)@172.17.0.5:41279 3: I1222 21:51:24.959697 16000 task_status_update_manager.cpp:328] Received task status update TASK_RUNNING (Status UUID: 98e7d656-cfb3-4cc9-827b-ad648c63a053) for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.959748 16000 task_status_update_manager.cpp:507] Creating StatusUpdate stream for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.960240 16000 task_status_update_manager.cpp:383] Forwarding task status update TASK_RUNNING (Status UUID: 98e7d656-cfb3-4cc9-827b-ad648c63a053) for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 to the agent 3: I1222 21:51:24.960494 16002 slave.cpp:5261] Forwarding the update TASK_RUNNING (Status UUID: 98e7d656-cfb3-4cc9-827b-ad648c63a053) for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 to [email protected]:41279 3: I1222 21:51:24.960760 16002 slave.cpp:5154] Task status update manager successfully handled status update TASK_RUNNING (Status UUID: 98e7d656-cfb3-4cc9-827b-ad648c63a053) for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.960819 16002 slave.cpp:5170] Sending acknowledgement for status update TASK_RUNNING (Status UUID: 98e7d656-cfb3-4cc9-827b-ad648c63a053) for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 to executor(9)@172.17.0.5:41279 3: I1222 21:51:24.960923 16003 master.cpp:7850] Status update TASK_RUNNING (Status UUID: 98e7d656-cfb3-4cc9-827b-ad648c63a053) for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 from agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 at slave(55)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:24.960980 16003 master.cpp:7906] Forwarding status update TASK_RUNNING (Status UUID: 98e7d656-cfb3-4cc9-827b-ad648c63a053) for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.961009 16007 exec.cpp:398] Executor received status update acknowledgement 98e7d656-cfb3-4cc9-827b-ad648c63a053 for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.961199 16003 master.cpp:10153] Updating the state of task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 (latest state: TASK_RUNNING, status update state: TASK_RUNNING) 3: I1222 21:51:24.961511 16006 sched.cpp:1029] Scheduler::statusUpdate took 109555ns 3: I1222 21:51:24.961853 15997 master.cpp:5843] Processing ACKNOWLEDGE call 98e7d656-cfb3-4cc9-827b-ad648c63a053 for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 (default) at [email protected]:41279 on agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 3: I1222 21:51:24.961971 15994 sched.cpp:2009] Asked to stop the driver 3: I1222 21:51:24.962087 16005 sched.cpp:1191] Stopping framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.962177 15998 task_status_update_manager.cpp:401] Received task status update acknowledgement (UUID: 98e7d656-cfb3-4cc9-827b-ad648c63a053) for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.962389 16009 master.cpp:9438] Processing TEARDOWN call for framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 (default) at [email protected]:41279 3: I1222 21:51:24.962421 16009 master.cpp:9450] Removing framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 (default) at [email protected]:41279 3: I1222 21:51:24.962436 16009 master.cpp:3328] Deactivating framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 (default) at [email protected]:41279 3: I1222 21:51:24.962594 16002 hierarchical.cpp:405] Deactivated framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.962623 16009 master.cpp:10153] Updating the state of task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED) 3: I1222 21:51:24.962658 15996 slave.cpp:4026] Task status update manager successfully handled status update acknowledgement (UUID: 98e7d656-cfb3-4cc9-827b-ad648c63a053) for task 1 of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.962781 15996 slave.cpp:3406] Asked to shut down framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 by [email protected]:41279 3: I1222 21:51:24.962808 15996 slave.cpp:3431] Shutting down framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.962851 15996 slave.cpp:6126] Shutting down executor 'default' of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 at executor(9)@172.17.0.5:41279 3: I1222 21:51:24.962996 16008 exec.cpp:445] Executor asked to shutdown 3: I1222 21:51:24.963078 16008 exec.cpp:460] Executor::shutdown took 69045ns 3: I1222 21:51:24.963354 15997 slave.cpp:5393] Got exited event for executor(9)@172.17.0.5:41279 3: I1222 21:51:24.963500 16009 master.cpp:10259] Removing task 1 with resources cpus(allocated: *):2; mem(allocated: *):1024; disk(allocated: *):1024; ports(allocated: *):[31000-32000] of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 on agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 at slave(55)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:24.963801 16009 master.cpp:10288] Removing executor 'default' with resources [] of framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 on agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 at slave(55)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:24.964287 16000 slave.cpp:931] Agent terminating 3: I1222 21:51:24.964346 16000 slave.cpp:3406] Asked to shut down framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 by @0.0.0.0:0 3: I1222 21:51:24.964315 16010 hierarchical.cpp:1192] Recovered cpus(allocated: *):2; mem(allocated: *):1024; disk(allocated: *):1024; ports(allocated: *):[31000-32000] (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000], allocated: {}) on agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 from framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: W1222 21:51:24.964382 16000 slave.cpp:3427] Ignoring shutdown framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 because it is terminating 3: I1222 21:51:24.964607 16008 master.cpp:1305] Agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 at slave(55)@172.17.0.5:41279 (0f34bc323f81) disconnected 3: I1222 21:51:24.964634 16008 master.cpp:3365] Disconnecting agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 at slave(55)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:24.964799 16008 master.cpp:3384] Deactivating agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 at slave(55)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:24.964910 16010 hierarchical.cpp:344] Removed framework 47c79df2-d3d9-4b77-b2a1-37113475afef-0000 3: I1222 21:51:24.965028 16010 hierarchical.cpp:766] Agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 deactivated 3: I1222 21:51:24.971422 15994 master.cpp:1147] Master terminating 3: I1222 21:51:24.972241 16008 hierarchical.cpp:609] Removed agent 47c79df2-d3d9-4b77-b2a1-37113475afef-S0 3: [ OK ] FaultToleranceTest.SchedulerExit (73 ms) 3: [ RUN ] FaultToleranceTest.SlaveReliableRegistration 3: I1222 21:51:24.979935 15994 cluster.cpp:172] Creating default 'local' authorizer 3: I1222 21:51:24.982892 16009 master.cpp:456] Master ad77c7e4-56b8-4089-9eff-6b8ccce50894 (0f34bc323f81) started on 172.17.0.5:41279 3: I1222 21:51:24.982939 16009 master.cpp:458] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="1secs" --allocator="HierarchicalDRF" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/4kQTz7/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_unreachable_tasks_per_framework="1000" --port="5050" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --root_submissions="true" --user_sorter="drf" --version="false" --webui_dir="/usr/local/share/mesos/webui" --work_dir="/tmp/4kQTz7/master" --zk_session_timeout="10secs" 3: I1222 21:51:24.983321 16009 master.cpp:507] Master only allowing authenticated frameworks to register 3: I1222 21:51:24.983331 16009 master.cpp:513] Master only allowing authenticated agents to register 3: I1222 21:51:24.983336 16009 master.cpp:519] Master only allowing authenticated HTTP frameworks to register 3: I1222 21:51:24.983342 16009 credentials.hpp:37] Loading credentials for authentication from '/tmp/4kQTz7/credentials' 3: I1222 21:51:24.983666 16009 master.cpp:563] Using default 'crammd5' authenticator 3: I1222 21:51:24.983825 16009 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' 3: I1222 21:51:24.984019 16009 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' 3: I1222 21:51:24.984184 16009 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' 3: I1222 21:51:24.984344 16009 master.cpp:642] Authorization enabled 3: I1222 21:51:24.984568 16008 hierarchical.cpp:175] Initialized hierarchical allocator process 3: I1222 21:51:24.984612 16003 whitelist_watcher.cpp:77] No whitelist given 3: I1222 21:51:24.987722 16007 master.cpp:2210] Elected as the leading master! 3: I1222 21:51:24.987749 16007 master.cpp:1689] Recovering from registrar 3: I1222 21:51:24.987932 15999 registrar.cpp:347] Recovering registrar 3: I1222 21:51:24.988848 15999 registrar.cpp:391] Successfully fetched the registry (0B) in 873216ns 3: I1222 21:51:24.988976 15999 registrar.cpp:495] Applied 1 operations in 48962ns; attempting to update the registry 3: I1222 21:51:24.989585 15999 registrar.cpp:552] Successfully updated the registry in 548608ns 3: I1222 21:51:24.989722 15999 registrar.cpp:424] Successfully recovered registrar 3: I1222 21:51:24.990113 16005 master.cpp:1803] Recovered 0 agents from the registry (135B); allowing 10mins for agents to re-register 3: I1222 21:51:24.990170 16002 hierarchical.cpp:213] Skipping recovery of hierarchical allocator: nothing to recover 3: W1222 21:51:24.994335 15994 process.cpp:2756] Attempted to spawn already running process [email protected]:41279 3: I1222 21:51:24.995514 15994 containerizer.cpp:304] Using isolation { environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni } 3: W1222 21:51:24.996152 15994 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges 3: W1222 21:51:24.996286 15994 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges 3: I1222 21:51:24.996326 15994 provisioner.cpp:299] Using default backend 'copy' 3: I1222 21:51:24.998613 15994 cluster.cpp:460] Creating default 'local' authorizer 3: I1222 21:51:25.001523 16001 slave.cpp:262] Mesos agent started on (56)@172.17.0.5:41279 3: W1222 21:51:25.001940 15994 process.cpp:2756] Attempted to spawn already running process [email protected]:41279 3: I1222 21:51:25.001562 16001 slave.cpp:263] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/FaultToleranceTest_SlaveReliableRegistration_qErgfG/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/FaultToleranceTest_SlaveReliableRegistration_qErgfG/credential" --default_role="*" --disallow_sharing_agent_pid_namespace="false" --disk_watch_interval="1mins" --docker="docker" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io" --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/FaultToleranceTest_SlaveReliableRegistration_qErgfG/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/FaultToleranceTest_SlaveReliableRegistration_qErgfG/fetch" --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks" --gc_disk_headroom="0.1" --hadoop_home="" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/FaultToleranceTest_SlaveReliableRegistration_qErgfG/http_credentials" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posix" --launcher_dir="/mesos/build/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/FaultToleranceTest_SlaveReliableRegistration_qErgfG" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/FaultToleranceTest_SlaveReliableRegistration_qhFzUo" --zk_session_timeout="10secs" 3: I1222 21:51:25.002087 16001 credentials.hpp:86] Loading credential for authentication from '/tmp/FaultToleranceTest_SlaveReliableRegistration_qErgfG/credential' 3: I1222 21:51:25.002306 16001 slave.cpp:295] Agent using credential for: test-principal 3: I1222 21:51:25.002326 16001 credentials.hpp:37] Loading credentials for authentication from '/tmp/FaultToleranceTest_SlaveReliableRegistration_qErgfG/http_credentials' 3: I1222 21:51:25.002543 16001 http.cpp:1045] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' 3: I1222 21:51:25.002884 15994 sched.cpp:232] Version: 1.5.0 3: I1222 21:51:25.003522 16010 sched.cpp:336] New master detected at [email protected]:41279 3: I1222 21:51:25.003639 16010 sched.cpp:396] Authenticating with master [email protected]:41279 3: I1222 21:51:25.003664 16010 sched.cpp:403] Using default CRAM-MD5 authenticatee 3: I1222 21:51:25.003981 15997 authenticatee.cpp:121] Creating new client SASL connection 3: I1222 21:51:25.004351 16000 master.cpp:8928] Authenticating [email protected]:41279 3: I1222 21:51:25.004266 16001 slave.cpp:612] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] 3: I1222 21:51:25.004496 16008 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(123)@172.17.0.5:41279 3: I1222 21:51:25.004536 16001 slave.cpp:620] Agent attributes: [ ] 3: I1222 21:51:25.004576 16001 slave.cpp:629] Agent hostname: 0f34bc323f81 3: I1222 21:51:25.004840 16005 authenticator.cpp:98] Creating new server SASL connection 3: I1222 21:51:25.004869 15995 task_status_update_manager.cpp:181] Pausing sending task status updates 3: I1222 21:51:25.005110 15999 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 3: I1222 21:51:25.005146 15999 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' 3: I1222 21:51:25.005303 16004 authenticator.cpp:204] Received SASL authentication start 3: I1222 21:51:25.005388 16004 authenticator.cpp:326] Authentication requires more steps 3: I1222 21:51:25.005548 15996 authenticatee.cpp:259] Received SASL authentication step 3: I1222 21:51:25.005750 15996 authenticator.cpp:232] Received SASL authentication step 3: I1222 21:51:25.005784 15996 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '0f34bc323f81' server FQDN: '0f34bc323f81' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 3: I1222 21:51:25.005796 15996 auxprop.cpp:181] Looking up auxiliary property '*userPassword' 3: I1222 21:51:25.005836 15996 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' 3: I1222 21:51:25.005879 15996 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '0f34bc323f81' server FQDN: '0f34bc323f81' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 3: I1222 21:51:25.005903 15996 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true 3: I1222 21:51:25.005911 15996 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true 3: I1222 21:51:25.005929 15996 authenticator.cpp:318] Authentication success 3: I1222 21:51:25.006062 16002 authenticatee.cpp:299] Authentication success 3: I1222 21:51:25.006155 16006 master.cpp:8958] Successfully authenticated principal 'test-principal' at [email protected]:41279 3: I1222 21:51:25.006242 16010 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(123)@172.17.0.5:41279 3: I1222 21:51:25.006315 15996 state.cpp:66] Recovering state from '/tmp/FaultToleranceTest_SlaveReliableRegistration_qhFzUo/meta' 3: I1222 21:51:25.006491 15998 sched.cpp:502] Successfully authenticated with master [email protected]:41279 3: I1222 21:51:25.006518 15998 sched.cpp:824] Sending SUBSCRIBE call to [email protected]:41279 3: I1222 21:51:25.006650 15995 task_status_update_manager.cpp:207] Recovering task status update manager 3: I1222 21:51:25.006702 15998 sched.cpp:857] Will retry registration in 1.679699366secs if necessary 3: I1222 21:51:25.006924 16005 master.cpp:2958] Received SUBSCRIBE call for framework 'default' at [email protected]:41279 3: I1222 21:51:25.006947 16005 master.cpp:2275] Authorizing framework principal 'test-principal' to receive offers for roles '{ * }' 3: I1222 21:51:25.007577 16004 master.cpp:3038] Subscribing framework default with checkpointing disabled and capabilities [ MULTI_ROLE, RESERVATION_REFINEMENT ] 3: I1222 21:51:25.007724 16007 containerizer.cpp:674] Recovering containerizer 3: I1222 21:51:25.007786 16004 master.cpp:9149] Adding framework ad77c7e4-56b8-4089-9eff-6b8ccce50894-0000 (default) at [email protected]:41279 with roles { } suppressed 3: I1222 21:51:25.008399 15996 sched.cpp:751] Framework registered with ad77c7e4-56b8-4089-9eff-6b8ccce50894-0000 3: I1222 21:51:25.008437 16006 hierarchical.cpp:297] Added framework ad77c7e4-56b8-4089-9eff-6b8ccce50894-0000 3: I1222 21:51:25.008545 15996 sched.cpp:765] Scheduler::registered took 125317ns 3: I1222 21:51:25.008802 16006 hierarchical.cpp:1517] Performed allocation for 0 agents in 111680ns 3: I1222 21:51:25.009759 16007 provisioner.cpp:495] Provisioner recovery complete 3: I1222 21:51:25.010123 16000 slave.cpp:6772] Finished recovery 3: I1222 21:51:25.011091 16006 task_status_update_manager.cpp:181] Pausing sending task status updates 3: I1222 21:51:25.011113 15996 slave.cpp:1055] New master detected at [email protected]:41279 3: I1222 21:51:25.011247 15996 slave.cpp:1110] Detecting new master 3: I1222 21:51:25.014669 16003 slave.cpp:1137] Authenticating with master [email protected]:41279 3: I1222 21:51:25.014741 16003 slave.cpp:1146] Using default CRAM-MD5 authenticatee 3: I1222 21:51:25.015017 15997 authenticatee.cpp:121] Creating new client SASL connection 3: I1222 21:51:25.015319 16005 master.cpp:8928] Authenticating slave(56)@172.17.0.5:41279 3: I1222 21:51:25.015508 16008 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(124)@172.17.0.5:41279 3: I1222 21:51:25.015756 16001 authenticator.cpp:98] Creating new server SASL connection 3: I1222 21:51:25.016013 16004 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 3: I1222 21:51:25.016043 16004 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' 3: I1222 21:51:25.016191 16010 authenticator.cpp:204] Received SASL authentication start 3: I1222 21:51:25.016261 16010 authenticator.cpp:326] Authentication requires more steps 3: I1222 21:51:25.016449 16010 authenticatee.cpp:259] Received SASL authentication step 3: I1222 21:51:25.016607 16010 authenticator.cpp:232] Received SASL authentication step 3: I1222 21:51:25.016644 16010 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '0f34bc323f81' server FQDN: '0f34bc323f81' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 3: I1222 21:51:25.016662 16010 auxprop.cpp:181] Looking up auxiliary property '*userPassword' 3: I1222 21:51:25.016705 16010 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' 3: I1222 21:51:25.016739 16010 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '0f34bc323f81' server FQDN: '0f34bc323f81' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 3: I1222 21:51:25.016758 16010 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true 3: I1222 21:51:25.016772 16010 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true 3: I1222 21:51:25.016795 16010 authenticator.cpp:318] Authentication success 3: I1222 21:51:25.016921 16000 authenticatee.cpp:299] Authentication success 3: I1222 21:51:25.016971 15999 master.cpp:8958] Successfully authenticated principal 'test-principal' at slave(56)@172.17.0.5:41279 3: I1222 21:51:25.017050 16002 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(124)@172.17.0.5:41279 3: I1222 21:51:25.017242 16010 slave.cpp:1229] Successfully authenticated with master [email protected]:41279 3: I1222 21:51:25.017503 16010 slave.cpp:1708] Will retry registration in 3.543693ms if necessary 3: I1222 21:51:25.017760 16005 master.cpp:6078] Received register agent message from slave(56)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:25.017829 16005 master.cpp:3867] Authorizing agent with principal 'test-principal' 3: I1222 21:51:25.018288 16008 master.cpp:6148] Authorized registration of agent at slave(56)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:25.018399 16008 master.cpp:6241] Registering agent at slave(56)@172.17.0.5:41279 (0f34bc323f81) with id ad77c7e4-56b8-4089-9eff-6b8ccce50894-S0 3: I1222 21:51:25.018940 16001 registrar.cpp:495] Applied 1 operations in 100460ns; attempting to update the registry 3: I1222 21:51:25.019486 16000 registrar.cpp:552] Successfully updated the registry in 486912ns 3: I1222 21:51:25.019670 15999 master.cpp:6289] Admitted agent ad77c7e4-56b8-4089-9eff-6b8ccce50894-S0 at slave(56)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:25.020377 15999 master.cpp:6338] Registered agent ad77c7e4-56b8-4089-9eff-6b8ccce50894-S0 at slave(56)@172.17.0.5:41279 (0f34bc323f81) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] 3: I1222 21:51:25.020910 15996 hierarchical.cpp:574] Added agent ad77c7e4-56b8-4089-9eff-6b8ccce50894-S0 (0f34bc323f81) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (allocated: {}) 3: I1222 21:51:25.022644 16008 slave.cpp:1708] Will retry registration in 15.319742ms if necessary 3: I1222 21:51:25.022760 15996 hierarchical.cpp:1517] Performed allocation for 1 agents in 1.619663ms 3: I1222 21:51:25.022872 16001 master.cpp:6078] Received register agent message from slave(56)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:25.022940 16001 master.cpp:3867] Authorizing agent with principal 'test-principal' 3: I1222 21:51:25.023771 16001 master.cpp:8758] Sending 1 offers to framework ad77c7e4-56b8-4089-9eff-6b8ccce50894-0000 (default) at [email protected]:41279 3: I1222 21:51:25.023991 16001 master.cpp:6148] Authorized registration of agent at slave(56)@172.17.0.5:41279 (0f34bc323f81) 3: I1222 21:51:25.024078 16001 master.cpp:6220] Agent ad77c7e4-56b8-4089-9eff-6b8ccce50894-S0 at slave(56)@172.17.0.5:41279 (0f34bc323f81) already registered, resending acknowledgement 3: I1222 21:51:25.024272 16003 slave.cpp:1275] Registered with master [email protected]:41279; given agent ID ad77c7e4-56b8-4089-9eff-6b8ccce50894-S0 3: I1222 21:51:25.024374 16000 sched.cpp:921] Scheduler::resourceOffers took 37534ns 3: I1222 21:51:25.024453 15999 task_status_update_manager.cpp:188] Resuming sending task status updates 3: I1222 21:51:25.024471 16006 hierarchical.cpp:1517] Performed allocation for 1 agents in 561382ns 3: I1222 21:51:25.024672 16003 slave.cpp:1295] Checkpointing SlaveInfo to '/tmp/FaultToleranceTest_SlaveReliableRegistration_qhFzUo/meta/slaves/ad77c7e4-56b8-4089-9eff-6b8ccce50894-S0/slave.info' 3: I1222 21:51:25.025230 16003 slave.cpp:1352] Forwarding agent update {"operations":{},"resource_version_uuid":{"value":"ohLTO4t0QTWTi7pCuEo2eQ=="},"slave_id":{"value":"ad77c7e4-56b8-4089-9eff-6b8ccce50894-S0"},"update_oversubscribed_resources":true} 3: I1222 21:51:25.025539 16003 master.cpp:7268] Received update of agent ad77c7e4-56b8-4089-9eff-6b8ccce50894-S0 at slave(56)@172.17.0.5:41279 (0f34bc323f81) with total oversubscribed resources {} 3: I1222 21:51:25.025861 16003 master.cpp:7362] Ignoring update on agent ad77c7e4-56b8-4089-9eff-6b8ccce50894-S0 at slave(56)@172.17.0.5:41279 (0f34bc323f81) as it reports no changes 3: I1222 21:51:25.025951 15994 sched.cpp:2009] Asked to stop the driver 3: I1222 21:51:25.026144 16010 sched.cpp:1191] Stopping framework ad77c7e4-56b8-4089-9eff-6b8ccce50894-0000 write /dev/stdout: resource temporarily unavailable + docker rmi mesos-1513977377-24856 Error response from daemon: conflict: unable to remove repository reference "mesos-1513977377-24856" (must force) - container 0f34bc323f81 is using its referenced image 5233e0d32273 Build step 'Execute shell' marked build as failure Not sending mail to unregistered user [email protected]
