Hi, @wayne Could you provide the stderr and stdout log files under /data/mesos/slaves/5404b500-c733-4ad8-aaf9-c20247bbe4a2- S4/frameworks/23a1421e-4981-40ae-9e51-2110b8a800ad-0000/ executors/alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_ 1806_0_1_250_app/runs/46c36870-c96c-452d-bcfe-edc02a3c34ab
I think the task may print the error details about failed to launch containers there. On Fri, Feb 17, 2017 at 11:25 AM, wayne <wangwei....@gmail.com> wrote: > *centos7.3.1611* > > *kernel-3.10.0-514.6.1.el7.x86_64* > *mesos1.2.0* > *Docker version 1.13.1, build 092cba3* > > *taskid* > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app > > *master log* > mesos-master.adca-mesos-1.vm.invalid-user.log.INFO. > 20170215-162534.3430663:I0216 > 19:18:15.687566 3430683 master.cpp:3352] Authorizing framework principal > 'test' to launch task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app > mesos-master.adca-mesos-1.vm.invalid-user.log.INFO. > 20170215-162534.3430663:I0216 > 19:18:15.691611 3430686 master.cpp:9063] Adding task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app with > resources cpus(*)(allocated: test):1; mem(*)(allocated: test):1024 on agent > 5404b500-c733-4ad8-aaf9-c20247bbe4a2-S4 at slave(1)@10.101.90.84:5051 ( > adca-mesos-6.vm.elenet.me) > mesos-master.adca-mesos-1.vm.invalid-user.log.INFO. > 20170215-162534.3430663:I0216 > 19:18:15.691784 3430686 master.cpp:4426] Launching task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 (appos-scheduler) with > resources cpus(*)(allocated: test):1; mem(*)(allocated: test):1024 on agent > 5404b500-c733-4ad8-aaf9-c20247bbe4a2-S4 at slave(1)@10.101.90.84:5051 ( > adca-mesos-6.vm.elenet.me) > mesos-master.adca-mesos-1.vm.invalid-user.log.INFO. > 20170215-162534.3430663:I0217 > 02:40:07.723784 3430697 master.cpp:6164] Status update TASK_FAILED (UUID: > 75f91aff-a307-4e46-a396-23dfc3877722) for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 from agent > 5404b500-c733-4ad8-aaf9-c20247bbe4a2-S4 at slave(1)@10.101.90.84:5051 ( > adca-mesos-6.vm.elenet.me) > mesos-master.adca-mesos-1.vm.invalid-user.log.INFO. > 20170215-162534.3430663:I0217 > 02:40:07.723908 3430697 master.cpp:6232] Forwarding status update > TASK_FAILED (UUID: 75f91aff-a307-4e46-a396-23dfc3877722) for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-master.adca-mesos-1.vm.invalid-user.log.INFO. > 20170215-162534.3430663:I0217 > 02:40:07.724366 3430697 master.cpp:8312] Updating the state of task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 (latest state: > TASK_FAILED, status update state: TASK_FAILED) > mesos-master.adca-mesos-1.vm.invalid-user.log.INFO. > 20170215-162534.3430663:I0217 > 02:40:07.727289 3430695 master.cpp:5102] Processing ACKNOWLEDGE call > 75f91aff-a307-4e46-a396-23dfc3877722 for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 (appos-scheduler) on > agent 5404b500-c733-4ad8-aaf9-c20247bbe4a2-S4 > mesos-master.adca-mesos-1.vm.invalid-user.log.INFO. > 20170215-162534.3430663:I0217 > 02:40:07.727365 3430695 master.cpp:8406] Removing task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app with > resources cpus(*)(allocated: test):1; mem(*)(allocated: test):1024 of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 on agent > 5404b500-c733-4ad8-aaf9-c20247bbe4a2-S4 at slave(1)@10.101.90.84:5051 ( > adca-mesos-6.vm.elenet.me) > mesos-master.INFO:I0216 19:18:15.687566 3430683 master.cpp:3352] > Authorizing framework principal 'test' to launch task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app > mesos-master.INFO:I0216 19:18:15.691611 3430686 master.cpp:9063] Adding > task alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app > with > resources cpus(*)(allocated: test):1; mem(*)(allocated: test):1024 on agent > 5404b500-c733-4ad8-aaf9-c20247bbe4a2-S4 at slave(1)@10.101.90.84:5051 ( > adca-mesos-6.vm.elenet.me) > mesos-master.INFO:I0216 *19:18:15.691784* 3430686 master.cpp:4426] > Launching task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 (appos-scheduler) with > resources cpus(*)(allocated: test):1; mem(*)(allocated: test):1024 on agent > 5404b500-c733-4ad8-aaf9-c20247bbe4a2-S4 at slave(1)@10.101.90.84:5051 ( > adca-mesos-6.vm.elenet.me) > mesos-master.INFO:I0217 02:40:07.723784 3430697 master.cpp:6164] Status > update TASK_FAILED (UUID: 75f91aff-a307-4e46-a396-23dfc3877722) for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 from agent > 5404b500-c733-4ad8-aaf9-c20247bbe4a2-S4 at slave(1)@10.101.90.84:5051 ( > adca-mesos-6.vm.elenet.me) > mesos-master.INFO:I0217 02:40:07.723908 3430697 master.cpp:6232] Forwarding > status update TASK_FAILED (UUID: 75f91aff-a307-4e46-a396-23dfc3877722) for > task alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-master.INFO:I0217* 02:40:07.724366* 3430697 master.cpp:8312] Updating > the state of task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 (latest state: > TASK_FAILED, status update state: TASK_FAILED) > mesos-master.INFO:I0217 02:40:07.727289 3430695 master.cpp:5102] Processing > ACKNOWLEDGE call 75f91aff-a307-4e46-a396-23dfc3877722 for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 (appos-scheduler) on > agent 5404b500-c733-4ad8-aaf9-c20247bbe4a2-S4 > mesos-master.INFO:I0217 02:40:07.727365 3430695 master.cpp:8406] Removing > task alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app > with > resources cpus(*)(allocated: test):1; mem(*)(allocated: test):1024 of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 on agent > 5404b500-c733-4ad8-aaf9-c20247bbe4a2-S4 at slave(1)@10.101.90.84:5051 ( > adca-mesos-6.vm.elenet.me) > > > *slave log* > mesos-slave.adca-mesos-6.vm.root.log.ERROR.20170217-024007.2171:E0217 > 02:40:07.713376 2451 slave.cpp:4647] Container > '46c36870-c96c-452d-bcfe-edc02a3c34ab' for executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 failed to start: > future discarded > mesos-slave.adca-mesos-6.vm.root.log.ERROR.20170217-024007.2171:E0217 > 02:40:07.715334 2451 slave.cpp:4753] Termination of executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 failed: unknown > container > mesos-slave.adca-mesos-6.vm.root.log.ERROR.20170217-024007.2171:E0217 > 02:40:07.719329 2465 slave.cpp:4094] Failed to update resources for > container 46c36870-c96c-452d-bcfe-edc02a3c34ab of executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' > running > task alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app on > status update for terminal task, destroying container: Container not found > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0216 > 19:18:15.694006 2452 slave.cpp:1625] Got assigned task > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' for > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0216 > 19:18:15.696161 2452 slave.cpp:1785] Launching task > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' for > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0216 > 19:18:15.698235 2452 paths.cpp:547] Trying to chown > '/data/mesos/slaves/5404b500-c733-4ad8-aaf9-c20247bbe4a2- > S4/frameworks/23a1421e-4981-40ae-9e51-2110b8a800ad-0000/ > executors/alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_ > 1806_0_1_250_app/runs/46c36870-c96c-452d-bcfe-edc02a3c34ab' > to user 'root' > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0216 > 19:18:15.699046 2452 slave.cpp:6477] Launching executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 with resources > cpus(*)(allocated: test):0.1; mem(*)(allocated: test):32 in work directory > '/data/mesos/slaves/5404b500-c733-4ad8-aaf9-c20247bbe4a2- > S4/frameworks/23a1421e-4981-40ae-9e51-2110b8a800ad-0000/ > executors/alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_ > 1806_0_1_250_app/runs/46c36870-c96c-452d-bcfe-edc02a3c34ab' > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0216 > 19:18:15.700660 2452 slave.cpp:2115] Queued task > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' for > executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0216 > 19:18:15.701813 2464 docker.cpp:1126] Starting container > '46c36870-c96c-452d-bcfe-edc02a3c34ab' for task > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' (and > executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app') of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0216 > 19:23:15.701246 2458 slave.cpp:5212] Terminating executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 because it did not > register within 5mins > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:E0217 > 02:40:07.713376 2451 slave.cpp:4647] Container > '46c36870-c96c-452d-bcfe-edc02a3c34ab' for executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 failed to start: > future discarded > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:E0217 > 02:40:07.715334 2451 slave.cpp:4753] Termination of executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 failed: unknown > container > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0217 > 02:40:07.717267 2451 slave.cpp:3813] Handling status update TASK_FAILED > (UUID: 75f91aff-a307-4e46-a396-23dfc3877722) for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 from @0.0.0.0:0 > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:E0217 > 02:40:07.719329 2465 slave.cpp:4094] Failed to update resources for > container 46c36870-c96c-452d-bcfe-edc02a3c34ab of executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' > running > task alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app on > status update for terminal task, destroying container: Container not found > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0217 > 02:40:07.719849 2437 status_update_manager.cpp:323] Received status update > TASK_FAILED (UUID: 75f91aff-a307-4e46-a396-23dfc3877722) for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0217 > 02:40:07.720671 2437 status_update_manager.cpp:832] Checkpointing UPDATE > for status update TASK_FAILED (UUID: 75f91aff-a307-4e46-a396-23dfc3877722) > for task alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app > of framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0217 > 02:40:07.721263 2462 slave.cpp:4253] Forwarding the update TASK_FAILED > (UUID: 75f91aff-a307-4e46-a396-23dfc3877722) for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 to > master@10.101.90.79:5050 > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0217 > 02:40:07.728440 2438 status_update_manager.cpp:395] Received status update > acknowledgement (UUID: 75f91aff-a307-4e46-a396-23dfc3877722) for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0217 > 02:40:07.728615 2438 status_update_manager.cpp:832] Checkpointing ACK for > status update TASK_FAILED (UUID: 75f91aff-a307-4e46-a396-23dfc3877722) for > task alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0217 > 02:40:07.729259 2442 slave.cpp:4866] Cleaning up executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0217 > 02:40:07.729653 2456 gc.cpp:55] Scheduling > '/data/mesos/slaves/5404b500-c733-4ad8-aaf9-c20247bbe4a2- > S4/frameworks/23a1421e-4981-40ae-9e51-2110b8a800ad-0000/ > executors/alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_ > 1806_0_1_250_app/runs/46c36870-c96c-452d-bcfe-edc02a3c34ab' > for gc 23.9997973527467hrs in the future > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0217 > 02:40:07.729789 2456 gc.cpp:55] Scheduling > '/data/mesos/slaves/5404b500-c733-4ad8-aaf9-c20247bbe4a2- > S4/frameworks/23a1421e-4981-40ae-9e51-2110b8a800ad-0000/ > executors/alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_ > 1806_0_1_250_app' > for gc 23.9997972961422hrs in the future > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0217 > 02:40:07.729883 2456 gc.cpp:55] Scheduling > '/data/mesos/meta/slaves/5404b500-c733-4ad8-aaf9- > c20247bbe4a2-S4/frameworks/23a1421e-4981-40ae-9e51- > 2110b8a800ad-0000/executors/alpha-common_lpt_qc_16_1_pc.1. > 20170216180430.251_1806_0_1_250_app/runs/46c36870-c96c- > 452d-bcfe-edc02a3c34ab' > for gc 23.9997972705422hrs in the future > mesos-slave.adca-mesos-6.vm.root.log.INFO.20170217-022055.2171:I0217 > 02:40:07.729969 2456 gc.cpp:55] Scheduling > '/data/mesos/meta/slaves/5404b500-c733-4ad8-aaf9- > c20247bbe4a2-S4/frameworks/23a1421e-4981-40ae-9e51- > 2110b8a800ad-0000/executors/alpha-common_lpt_qc_16_1_pc.1. > 20170216180430.251_1806_0_1_250_app' > for gc 23.9997972541156hrs in the future > mesos-slave.adca-mesos-6.vm.root.log.WARNING.20170217-024007.2171:E0217 > 02:40:07.713376 2451 slave.cpp:4647] Container > '46c36870-c96c-452d-bcfe-edc02a3c34ab' for executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 failed to start: > future discarded > mesos-slave.adca-mesos-6.vm.root.log.WARNING.20170217-024007.2171:E0217 > 02:40:07.715334 2451 slave.cpp:4753] Termination of executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 failed: unknown > container > mesos-slave.adca-mesos-6.vm.root.log.WARNING.20170217-024007.2171:E0217 > 02:40:07.719329 2465 slave.cpp:4094] Failed to update resources for > container 46c36870-c96c-452d-bcfe-edc02a3c34ab of executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' > running > task alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app on > status update for terminal task, destroying container: Container not found > mesos-slave.ERROR:E0217 02:40:07.713376 2451 slave.cpp:4647] Container > '46c36870-c96c-452d-bcfe-edc02a3c34ab' for executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 failed to start: > future discarded > mesos-slave.ERROR:E0217 02:40:07.715334 2451 slave.cpp:4753] Termination > of executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 failed: unknown > container > mesos-slave.ERROR:E0217 02:40:07.719329 2465 slave.cpp:4094] Failed to > update resources for container 46c36870-c96c-452d-bcfe-edc02a3c34ab of > executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' > running > task alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app on > status update for terminal task, destroying container: Container not found > mesos-slave.INFO:I0216 19:18:15.694006 2452 slave.cpp:1625] Got assigned > task 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' > for framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.INFO:I0216 19:18:15.696161 2452 slave.cpp:1785] Launching task > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' for > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.INFO:I0216 19:18:15.698235 2452 paths.cpp:547] Trying to chown > '/data/mesos/slaves/5404b500-c733-4ad8-aaf9-c20247bbe4a2- > S4/frameworks/23a1421e-4981-40ae-9e51-2110b8a800ad-0000/ > executors/alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_ > 1806_0_1_250_app/runs/46c36870-c96c-452d-bcfe-edc02a3c34ab' > to user 'root' > mesos-slave.INFO:I0216 19:18:15.699046 2452 slave.cpp:6477] Launching > executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 with resources > cpus(*)(allocated: test):0.1; mem(*)(allocated: test):32 in work directory > '/data/mesos/slaves/5404b500-c733-4ad8-aaf9-c20247bbe4a2- > S4/frameworks/23a1421e-4981-40ae-9e51-2110b8a800ad-0000/ > executors/alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_ > 1806_0_1_250_app/runs/46c36870-c96c-452d-bcfe-edc02a3c34ab' > mesos-slave.INFO:I0216 19:18:15.700660 2452 slave.cpp:2115] Queued task > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' for > executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.INFO:I0216 19:18:15.701813 2464 docker.cpp:1126] Starting > container '46c36870-c96c-452d-bcfe-edc02a3c34ab' for task > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' (and > executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app') of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.INFO:I0216 *19:23:15.701246 * 2458 slave.cpp:5212] Terminating > executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 because it did not > register within 5mins > mesos-slave.INFO:E0217 *02:40:07.713376* 2451 slave.cpp:4647] Container > '46c36870-c96c-452d-bcfe-edc02a3c34ab' for executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 failed to start: > future discarded > mesos-slave.INFO:E0217 02:40:07.715334 2451 slave.cpp:4753] Termination of > executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 failed: unknown > container > mesos-slave.INFO:I0217 02:40:07.717267 2451 slave.cpp:3813] Handling > status update TASK_FAILED (UUID: 75f91aff-a307-4e46-a396-23dfc3877722) for > task alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 from @0.0.0.0:0 > mesos-slave.INFO:E0217 02:40:07.719329 2465 slave.cpp:4094] Failed to > update resources for container 46c36870-c96c-452d-bcfe-edc02a3c34ab of > executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' > running > task alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app on > status update for terminal task, destroying container: Container not found > mesos-slave.INFO:I0217 02:40:07.719849 2437 status_update_manager.cpp:323] > Received status update TASK_FAILED (UUID: > 75f91aff-a307-4e46-a396-23dfc3877722) for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.INFO:I0217 02:40:07.720671 2437 status_update_manager.cpp:832] > Checkpointing UPDATE for status update TASK_FAILED (UUID: > 75f91aff-a307-4e46-a396-23dfc3877722) for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.INFO:I0217 02:40:07.721263 2462 slave.cpp:4253] Forwarding the > update TASK_FAILED (UUID: 75f91aff-a307-4e46-a396-23dfc3877722) for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 to > master@10.101.90.79:5050 > mesos-slave.INFO:I0217 02:40:07.728440 2438 status_update_manager.cpp:395] > Received status update acknowledgement (UUID: > 75f91aff-a307-4e46-a396-23dfc3877722) for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.INFO:I0217 02:40:07.728615 2438 status_update_manager.cpp:832] > Checkpointing ACK for status update TASK_FAILED (UUID: > 75f91aff-a307-4e46-a396-23dfc3877722) for task > alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.INFO:I0217 02:40:07.729259 2442 slave.cpp:4866] Cleaning up > executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 > mesos-slave.INFO:I0217 02:40:07.729653 2456 gc.cpp:55] Scheduling > '/data/mesos/slaves/5404b500-c733-4ad8-aaf9-c20247bbe4a2- > S4/frameworks/23a1421e-4981-40ae-9e51-2110b8a800ad-0000/ > executors/alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_ > 1806_0_1_250_app/runs/46c36870-c96c-452d-bcfe-edc02a3c34ab' > for gc 23.9997973527467hrs in the future > mesos-slave.INFO:I0217 02:40:07.729789 2456 gc.cpp:55] Scheduling > '/data/mesos/slaves/5404b500-c733-4ad8-aaf9-c20247bbe4a2- > S4/frameworks/23a1421e-4981-40ae-9e51-2110b8a800ad-0000/ > executors/alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_ > 1806_0_1_250_app' > for gc 23.9997972961422hrs in the future > mesos-slave.INFO:I0217 02:40:07.729883 2456 gc.cpp:55] Scheduling > '/data/mesos/meta/slaves/5404b500-c733-4ad8-aaf9- > c20247bbe4a2-S4/frameworks/23a1421e-4981-40ae-9e51- > 2110b8a800ad-0000/executors/alpha-common_lpt_qc_16_1_pc.1. > 20170216180430.251_1806_0_1_250_app/runs/46c36870-c96c- > 452d-bcfe-edc02a3c34ab' > for gc 23.9997972705422hrs in the future > mesos-slave.INFO:I0217 02:40:07.729969 2456 gc.cpp:55] Scheduling > '/data/mesos/meta/slaves/5404b500-c733-4ad8-aaf9- > c20247bbe4a2-S4/frameworks/23a1421e-4981-40ae-9e51- > 2110b8a800ad-0000/executors/alpha-common_lpt_qc_16_1_pc.1. > 20170216180430.251_1806_0_1_250_app' > for gc 23.9997972541156hrs in the future > mesos-slave.WARNING:E0217 02:40:07.713376 2451 slave.cpp:4647] Container > '46c36870-c96c-452d-bcfe-edc02a3c34ab' for executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 failed to start: > future discarded > mesos-slave.WARNING:E0217 02:40:07.715334 2451 slave.cpp:4753] Termination > of executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' of > framework 23a1421e-4981-40ae-9e51-2110b8a800ad-0000 failed: unknown > container > mesos-slave.WARNING:E0217 02:40:07.719329 2465 slave.cpp:4094] Failed to > update resources for container 46c36870-c96c-452d-bcfe-edc02a3c34ab of > executor > 'alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app' > running > task alpha-common_lpt_qc_16_1_pc.1.20170216180430.251_1806_0_1_250_app on > status update for terminal task, destroying container: Container not found > > > > *if **framework **can do the remove task( or make to give up）, or what > timeout config it is about this thing* > > > best regards > > wayne > wangwei....@gmail.com > -- Best Regards, Haosdent Huang
