See <https://builds.apache.org/job/Mesos-Reviewbot/22590/display/redirect?page=changes>
Changes: [yujie.jay] Added MESOS-8945 to 1.6.1 CHANGELOG. [yujie.jay] Added MESOS-8945 to 1.5.2 CHANGELOG. [yujie.jay] Added MESOS-8945 to 1.4.2 CHANGELOG. [yujie.jay] Fixed a compile warning regarding signed and unsigned integers. ------------------------------------------ [...truncated 20.93 MB...] I0531 03:03:16.638344 6957 sched.cpp:501] Successfully authenticated with master [email protected]:37420 I0531 03:03:16.638991 6957 sched.cpp:822] Sending SUBSCRIBE call to [email protected]:37420 I0531 03:03:16.639396 6957 sched.cpp:855] Will retry registration in 801.482868ms if necessary I0531 03:03:16.637398 6961 master.cpp:9620] Successfully authenticated principal 'test-principal' at [email protected]:37420 I0531 03:03:16.640362 6961 master.cpp:2890] Received SUBSCRIBE call for framework 'default' at [email protected]:37420 I0531 03:03:16.640697 6961 master.cpp:2197] Authorizing framework principal 'test-principal' to receive offers for roles '{ * }' I0531 03:03:16.641774 6961 master.cpp:2971] Subscribing framework default with checkpointing enabled and capabilities [ MULTI_ROLE, RESERVATION_REFINEMENT ] I0531 03:03:16.642320 6961 master.cpp:9811] Adding framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 (default) at [email protected]:37420 with roles { } suppressed I0531 03:03:16.643707 6949 sched.cpp:749] Framework registered with edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:16.644006 6949 sched.cpp:763] Scheduler::registered took 81149ns I0531 03:03:16.637432 6943 slave.cpp:622] Agent attributes: [ ] I0531 03:03:16.643790 6966 hierarchical.cpp:297] Added framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:16.645902 6966 hierarchical.cpp:1519] Performed allocation for 0 agents in 123247ns I0531 03:03:16.644969 6943 slave.cpp:631] Agent hostname: 2807eb76679d I0531 03:03:16.649443 6948 task_status_update_manager.cpp:181] Pausing sending task status updates I0531 03:03:16.651738 6956 state.cpp:66] Recovering state from '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/meta' I0531 03:03:16.665110 6943 slave.cpp:6925] Finished recovering checkpointed state from '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/meta', beginning agent recovery I0531 03:03:16.666074 6960 task_status_update_manager.cpp:207] Recovering task status update manager I0531 03:03:16.666987 6964 containerizer.cpp:718] Recovering Mesos containers I0531 03:03:16.667824 6964 containerizer.cpp:1025] Recovering isolators I0531 03:03:16.669337 6957 containerizer.cpp:1064] Recovering provisioner I0531 03:03:16.670943 6957 provisioner.cpp:495] Provisioner recovery complete I0531 03:03:16.672431 6948 composing.cpp:341] Finished recovering all containerizers I0531 03:03:16.672849 6952 slave.cpp:7154] Recovering executors I0531 03:03:16.673668 6952 slave.cpp:7307] Finished recovery I0531 03:03:16.676023 6961 task_status_update_manager.cpp:181] Pausing sending task status updates I0531 03:03:16.676054 6952 slave.cpp:1274] New master detected at [email protected]:37420 I0531 03:03:16.681174 6952 slave.cpp:1329] Detecting new master I0531 03:03:16.692185 6945 slave.cpp:1356] Authenticating with master [email protected]:37420 I0531 03:03:16.693102 6945 slave.cpp:1365] Using default CRAM-MD5 authenticatee I0531 03:03:16.694152 6945 authenticatee.cpp:121] Creating new client SASL connection I0531 03:03:16.695128 6966 master.cpp:9590] Authenticating [email protected]:37420 I0531 03:03:16.696499 6966 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(998)@172.17.0.2:37420 I0531 03:03:16.697803 6966 authenticator.cpp:98] Creating new server SASL connection I0531 03:03:16.698633 6960 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I0531 03:03:16.699110 6960 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I0531 03:03:16.699658 6960 authenticator.cpp:204] Received SASL authentication start I0531 03:03:16.700157 6960 authenticator.cpp:326] Authentication requires more steps I0531 03:03:16.700700 6960 authenticatee.cpp:259] Received SASL authentication step I0531 03:03:16.701246 6960 authenticator.cpp:232] Received SASL authentication step I0531 03:03:16.701674 6960 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '2807eb76679d' server FQDN: '2807eb76679d' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0531 03:03:16.702064 6960 auxprop.cpp:181] Looking up auxiliary property '*userPassword' I0531 03:03:16.702538 6960 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0531 03:03:16.702992 6960 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '2807eb76679d' server FQDN: '2807eb76679d' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0531 03:03:16.703418 6960 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0531 03:03:16.703830 6960 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0531 03:03:16.704268 6960 authenticator.cpp:318] Authentication success I0531 03:03:16.705168 6960 authenticatee.cpp:299] Authentication success I0531 03:03:16.705951 6948 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(998)@172.17.0.2:37420 I0531 03:03:16.706943 6960 master.cpp:9620] Successfully authenticated principal 'test-principal' at [email protected]:37420 I0531 03:03:16.707336 6948 slave.cpp:1448] Successfully authenticated with master [email protected]:37420 I0531 03:03:16.708969 6948 slave.cpp:1893] Will retry registration in 9.143058ms if necessary I0531 03:03:16.709885 6948 master.cpp:6563] Received register agent message from [email protected]:37420 (2807eb76679d) I0531 03:03:16.710839 6948 master.cpp:3859] Authorizing agent providing resources 'cpus:2; mem:1024; disk:1024; ports:[31000-32000]' with principal 'test-principal' I0531 03:03:16.712669 6961 master.cpp:6634] Authorized registration of agent at [email protected]:37420 (2807eb76679d) I0531 03:03:16.713142 6961 master.cpp:6749] Registering agent at [email protected]:37420 (2807eb76679d) with id edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 I0531 03:03:16.714520 6961 registrar.cpp:487] Applied 1 operations in 478065ns; attempting to update the registry I0531 03:03:16.721864 6957 slave.cpp:1893] Will retry registration in 36.857499ms if necessary I0531 03:03:16.722426 6958 master.cpp:6556] Ignoring register agent message from [email protected]:37420 (2807eb76679d) as registration is already in progress I0531 03:03:16.733389 6961 registrar.cpp:544] Successfully updated the registry in 18.626816ms I0531 03:03:16.733876 6961 master.cpp:6797] Admitted agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 at [email protected]:37420 (2807eb76679d) I0531 03:03:16.735431 6961 master.cpp:6842] Registered agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 at [email protected]:37420 (2807eb76679d) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0531 03:03:16.735913 6955 slave.cpp:1495] Registered with master [email protected]:37420; given agent ID edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 I0531 03:03:16.736469 6961 hierarchical.cpp:574] Added agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 (2807eb76679d) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (allocated: {}) I0531 03:03:16.736816 6953 task_status_update_manager.cpp:188] Resuming sending task status updates I0531 03:03:16.737036 6955 slave.cpp:1515] Checkpointing SlaveInfo to '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/meta/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/slave.info' I0531 03:03:16.739315 6955 slave.cpp:1564] Forwarding agent update {"operations":{},"resource_version_uuid":{"value":"IQmmbzUbTk6b8ZZYY7\/vFQ=="},"slave_id":{"value":"edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0"},"update_oversubscribed_resources":true} I0531 03:03:16.739706 6961 hierarchical.cpp:1519] Performed allocation for 1 agents in 2.746258ms I0531 03:03:16.745975 6954 master.cpp:9418] Sending 1 offers to framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 (default) at [email protected]:37420 I0531 03:03:16.748106 6951 sched.cpp:919] Scheduler::resourceOffers took 260675ns I0531 03:03:16.749589 6954 master.cpp:7800] Received update of agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 at [email protected]:37420 (2807eb76679d) with total oversubscribed resources {} I0531 03:03:16.750556 6954 master.cpp:7909] Ignoring update on agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 at [email protected]:37420 (2807eb76679d) as it reports no changes I0531 03:03:16.755887 6957 master.cpp:11367] Removing offer edf7bf76-ba01-4c55-afac-8f5161fdd6cc-O0 I0531 03:03:16.757293 6957 master.cpp:4362] Processing ACCEPT call for offers: [ edf7bf76-ba01-4c55-afac-8f5161fdd6cc-O0 ] on agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 at [email protected]:37420 (2807eb76679d) for framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 (default) at [email protected]:37420 I0531 03:03:16.757752 6957 master.cpp:3534] Authorizing framework principal 'test-principal' to launch task 00a3ce3e-e365-44ad-98df-f635e43899bd I0531 03:03:16.763056 6957 master.cpp:12087] Adding task 00a3ce3e-e365-44ad-98df-f635e43899bd with resources cpus(allocated: *):2; mem(allocated: *):1024; disk(allocated: *):1024; ports(allocated: *):[31000-32000] on agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 at [email protected]:37420 (2807eb76679d) I0531 03:03:16.764508 6957 master.cpp:5329] Launching task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 (default) at [email protected]:37420 with resources [{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] on agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 at [email protected]:37420 (2807eb76679d) on new executor I0531 03:03:16.767787 6957 slave.cpp:2030] Got assigned task '00a3ce3e-e365-44ad-98df-f635e43899bd' for framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:16.768447 6957 slave.cpp:8895] Checkpointing FrameworkInfo to '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/meta/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/framework.info' I0531 03:03:16.769414 6957 slave.cpp:8906] Checkpointing framework pid '[email protected]:37420' to '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/meta/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/framework.pid' I0531 03:03:16.772372 6957 slave.cpp:2404] Authorizing task '00a3ce3e-e365-44ad-98df-f635e43899bd' for framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:16.772861 6957 slave.cpp:8450] Authorizing framework principal 'test-principal' to launch task 00a3ce3e-e365-44ad-98df-f635e43899bd I0531 03:03:16.778240 6957 slave.cpp:2847] Launching task '00a3ce3e-e365-44ad-98df-f635e43899bd' for framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:16.778800 6957 paths.cpp:745] Creating sandbox '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305' for user 'mesos' I0531 03:03:16.780217 6957 slave.cpp:9668] Checkpointing ExecutorInfo to '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/meta/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/executor.info' I0531 03:03:16.781746 6957 paths.cpp:748] Creating sandbox '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/meta/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305' I0531 03:03:16.782495 6957 slave.cpp:8981] Launching executor '00a3ce3e-e365-44ad-98df-f635e43899bd' of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 with resources [{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":32.0},"type":"SCALAR"}] in work directory '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305' I0531 03:03:16.784406 6957 slave.cpp:3523] Launching container 00f6a53c-a87b-46ea-9c4e-4b7682694305 for executor '00a3ce3e-e365-44ad-98df-f635e43899bd' of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:16.785806 6957 slave.cpp:9699] Checkpointing TaskInfo to '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/meta/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305/tasks/00a3ce3e-e365-44ad-98df-f635e43899bd/task.info' I0531 03:03:16.794744 6957 slave.cpp:3044] Queued task '00a3ce3e-e365-44ad-98df-f635e43899bd' for executor '00a3ce3e-e365-44ad-98df-f635e43899bd' of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:16.795311 6957 slave.cpp:1008] Successfully attached '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305' to virtual path '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/latest' I0531 03:03:16.795605 6957 slave.cpp:1008] Successfully attached '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305' to virtual path '/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/latest' I0531 03:03:16.795876 6957 slave.cpp:1008] Successfully attached '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305' to virtual path '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305' I0531 03:03:16.797361 6957 containerizer.cpp:1252] Starting container 00f6a53c-a87b-46ea-9c4e-4b7682694305 I0531 03:03:16.800154 6957 containerizer.cpp:1418] Checkpointed ContainerConfig at '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_RwWykG/containers/00f6a53c-a87b-46ea-9c4e-4b7682694305/config' I0531 03:03:16.800549 6957 containerizer.cpp:3020] Transitioning the state of container 00f6a53c-a87b-46ea-9c4e-4b7682694305 from PROVISIONING to PREPARING I0531 03:03:16.809424 6951 containerizer.cpp:1909] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["mesos-executor","--launcher_dir=\/tmp\/SRC\/build\/mesos-1.7.0\/_build\/sub\/src"],"shell":false,"value":"\/tmp\/SRC\/build\/mesos-1.7.0\/_build\/sub\/src\/mesos-executor"},"environment":{"variables":[{"name":"LIBPROCESS_PORT","type":"VALUE","value":"0"},{"name":"MESOS_AGENT_ENDPOINT","type":"VALUE","value":"172.17.0.2:37420"},{"name":"MESOS_CHECKPOINT","type":"VALUE","value":"1"},{"name":"MESOS_DIRECTORY","type":"VALUE","value":"\/tmp\/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG\/slaves\/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0\/frameworks\/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000\/executors\/00a3ce3e-e365-44ad-98df-f635e43899bd\/runs\/00f6a53c-a87b-46ea-9c4e-4b7682694305"},{"name":"MESOS_EXECUTOR_ID","type":"VALUE","value":"00a3ce3e-e365-44ad-98df-f635e43899bd"},{"name":"MESOS_EXECUTOR_SHUTDOWN_GRACE_PERIOD","type":"VALUE","value":"5secs"},{"name":"MESOS_FRAMEWORK_ID","type":"VALUE","value":"edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000"},{"name":"MESOS_HTTP_COMMAND_EXECUTOR","type":"VALUE","value":"0"},{"name":"MESOS_RECOVERY_TIMEOUT","type":"VALUE","value":"15mins"},{"name":"MESOS_SLAVE_ID","type":"VALUE","value":"edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0"},{"name":"MESOS_SLAVE_PID","type":"VALUE","value":"[email protected]:37420"},{"name":"MESOS_SUBSCRIPTION_BACKOFF_MAX","type":"VALUE","value":"15secs"},{"name":"MESOS_SANDBOX","type":"VALUE","value":"\/tmp\/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG\/slaves\/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0\/frameworks\/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000\/executors\/00a3ce3e-e365-44ad-98df-f635e43899bd\/runs\/00f6a53c-a87b-46ea-9c4e-4b7682694305"}]},"task_environment":{},"user":"mesos","working_directory":"\/tmp\/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG\/slaves\/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0\/frameworks\/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000\/executors\/00a3ce3e-e365-44ad-98df-f635e43899bd\/runs\/00f6a53c-a87b-46ea-9c4e-4b7682694305"}" --pipe_read="30" --pipe_write="33" --runtime_directory="/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_RwWykG/containers/00f6a53c-a87b-46ea-9c4e-4b7682694305" --unshare_namespace_mnt="false"' I0531 03:03:16.818665 6951 launcher.cpp:140] Forked child with pid '13521' for container '00f6a53c-a87b-46ea-9c4e-4b7682694305' I0531 03:03:16.819283 6951 containerizer.cpp:2001] Checkpointing container's forked pid 13521 to '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/meta/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305/pids/forked.pid' I0531 03:03:16.821251 6951 containerizer.cpp:3020] Transitioning the state of container 00f6a53c-a87b-46ea-9c4e-4b7682694305 from PREPARING to ISOLATING I0531 03:03:16.826405 6945 containerizer.cpp:3020] Transitioning the state of container 00f6a53c-a87b-46ea-9c4e-4b7682694305 from ISOLATING to FETCHING I0531 03:03:16.827370 6946 fetcher.cpp:369] Starting to fetch URIs for container: 00f6a53c-a87b-46ea-9c4e-4b7682694305, directory: /tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305 I0531 03:03:16.829826 6946 containerizer.cpp:3020] Transitioning the state of container 00f6a53c-a87b-46ea-9c4e-4b7682694305 from FETCHING to RUNNING I0531 03:03:17.237423 13537 exec.cpp:162] Version: 1.7.0 I0531 03:03:17.270263 6956 slave.cpp:4817] Got registration for executor '00a3ce3e-e365-44ad-98df-f635e43899bd' of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 from executor(1)@172.17.0.2:34294 I0531 03:03:17.272253 6956 slave.cpp:4903] Checkpointing executor pid 'executor(1)@172.17.0.2:34294' to '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/meta/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305/pids/libprocess.pid' I0531 03:03:17.566551 6962 slave.cpp:3255] Sending queued task '00a3ce3e-e365-44ad-98df-f635e43899bd' to executor '00a3ce3e-e365-44ad-98df-f635e43899bd' of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 at executor(1)@172.17.0.2:34294 I0531 03:03:17.569288 13526 exec.cpp:236] Executor registered on agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 I0531 03:03:17.576977 6947 hierarchical.cpp:1519] Performed allocation for 1 agents in 900363ns I0531 03:03:17.577661 13524 executor.cpp:178] Received SUBSCRIBED event I0531 03:03:17.580996 13524 executor.cpp:182] Subscribed executor on 2807eb76679d I0531 03:03:17.581673 13524 executor.cpp:178] Received LAUNCH event I0531 03:03:17.585022 13524 executor.cpp:665] Starting task 00a3ce3e-e365-44ad-98df-f635e43899bd I0531 03:03:17.589953 6948 slave.cpp:5283] Handling status update TASK_STARTING (Status UUID: f700bf64-42dc-48f1-ac66-c946a77f42b6) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 from executor(1)@172.17.0.2:34294 I0531 03:03:17.593886 6959 task_status_update_manager.cpp:328] Received task status update TASK_STARTING (Status UUID: f700bf64-42dc-48f1-ac66-c946a77f42b6) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.594521 6959 task_status_update_manager.cpp:507] Creating StatusUpdate stream for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.595787 6959 task_status_update_manager.cpp:842] Checkpointing UPDATE for task status update TASK_STARTING (Status UUID: f700bf64-42dc-48f1-ac66-c946a77f42b6) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.596586 6959 task_status_update_manager.cpp:383] Forwarding task status update TASK_STARTING (Status UUID: f700bf64-42dc-48f1-ac66-c946a77f42b6) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 to the agent I0531 03:03:17.597530 6959 slave.cpp:5775] Forwarding the update TASK_STARTING (Status UUID: f700bf64-42dc-48f1-ac66-c946a77f42b6) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 to [email protected]:37420 I0531 03:03:17.598229 6959 slave.cpp:5668] Task status update manager successfully handled status update TASK_STARTING (Status UUID: f700bf64-42dc-48f1-ac66-c946a77f42b6) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.598662 6959 slave.cpp:5684] Sending acknowledgement for status update TASK_STARTING (Status UUID: f700bf64-42dc-48f1-ac66-c946a77f42b6) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 to executor(1)@172.17.0.2:34294 I0531 03:03:17.600111 6959 master.cpp:8345] Status update TASK_STARTING (Status UUID: f700bf64-42dc-48f1-ac66-c946a77f42b6) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 from agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 at [email protected]:37420 (2807eb76679d) I0531 03:03:17.600662 6959 master.cpp:8402] Forwarding status update TASK_STARTING (Status UUID: f700bf64-42dc-48f1-ac66-c946a77f42b6) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.601323 6959 master.cpp:10843] Updating the state of task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 (latest state: TASK_STARTING, status update state: TASK_STARTING) I0531 03:03:17.601979 6966 sched.cpp:1027] Scheduler::statusUpdate took 199456ns I0531 03:03:17.603713 6966 master.cpp:6195] Processing ACKNOWLEDGE call for status f700bf64-42dc-48f1-ac66-c946a77f42b6 for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 (default) at [email protected]:37420 on agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 I0531 03:03:17.604681 6966 task_status_update_manager.cpp:401] Received task status update acknowledgement (UUID: f700bf64-42dc-48f1-ac66-c946a77f42b6) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.605276 6966 task_status_update_manager.cpp:842] Checkpointing ACK for task status update TASK_STARTING (Status UUID: f700bf64-42dc-48f1-ac66-c946a77f42b6) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.606073 6966 slave.cpp:4519] Task status update manager successfully handled status update acknowledgement (UUID: f700bf64-42dc-48f1-ac66-c946a77f42b6) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.631450 13524 executor.cpp:485] Running '/tmp/SRC/build/mesos-1.7.0/_build/sub/src/mesos-containerizer launch <POSSIBLY-SENSITIVE-DATA>' I0531 03:03:17.635593 13524 executor.cpp:678] Forked command at 13548 I0531 03:03:17.645062 6944 slave.cpp:5283] Handling status update TASK_RUNNING (Status UUID: c6aa9c65-49c4-4f25-abad-90019e7af2f2) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 from executor(1)@172.17.0.2:34294 I0531 03:03:17.649189 6948 task_status_update_manager.cpp:328] Received task status update TASK_RUNNING (Status UUID: c6aa9c65-49c4-4f25-abad-90019e7af2f2) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.649488 6948 task_status_update_manager.cpp:842] Checkpointing UPDATE for task status update TASK_RUNNING (Status UUID: c6aa9c65-49c4-4f25-abad-90019e7af2f2) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.650390 6948 task_status_update_manager.cpp:383] Forwarding task status update TASK_RUNNING (Status UUID: c6aa9c65-49c4-4f25-abad-90019e7af2f2) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 to the agent I0531 03:03:17.651257 6965 slave.cpp:5775] Forwarding the update TASK_RUNNING (Status UUID: c6aa9c65-49c4-4f25-abad-90019e7af2f2) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 to [email protected]:37420 I0531 03:03:17.652588 6965 master.cpp:8345] Status update TASK_RUNNING (Status UUID: c6aa9c65-49c4-4f25-abad-90019e7af2f2) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 from agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 at [email protected]:37420 (2807eb76679d) I0531 03:03:17.653331 6965 master.cpp:8402] Forwarding status update TASK_RUNNING (Status UUID: c6aa9c65-49c4-4f25-abad-90019e7af2f2) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.654469 6946 slave.cpp:5668] Task status update manager successfully handled status update TASK_RUNNING (Status UUID: c6aa9c65-49c4-4f25-abad-90019e7af2f2) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.654722 6946 slave.cpp:5684] Sending acknowledgement for status update TASK_RUNNING (Status UUID: c6aa9c65-49c4-4f25-abad-90019e7af2f2) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 to executor(1)@172.17.0.2:34294 I0531 03:03:17.654935 6965 master.cpp:10843] Updating the state of task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 (latest state: TASK_RUNNING, status update state: TASK_RUNNING) I0531 03:03:17.655943 6948 sched.cpp:1027] Scheduler::statusUpdate took 185600ns I0531 03:03:17.657536 6953 master.cpp:6195] Processing ACKNOWLEDGE call for status c6aa9c65-49c4-4f25-abad-90019e7af2f2 for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 (default) at [email protected]:37420 on agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 I0531 03:03:17.658643 6959 task_status_update_manager.cpp:401] Received task status update acknowledgement (UUID: c6aa9c65-49c4-4f25-abad-90019e7af2f2) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.659193 6959 task_status_update_manager.cpp:842] Checkpointing ACK for task status update TASK_RUNNING (Status UUID: c6aa9c65-49c4-4f25-abad-90019e7af2f2) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.660025 6959 slave.cpp:4519] Task status update manager successfully handled status update acknowledgement (UUID: c6aa9c65-49c4-4f25-abad-90019e7af2f2) for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.660691 6943 slave.cpp:929] Agent terminating I0531 03:03:17.888746 6954 master.cpp:1293] Agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 at [email protected]:37420 (2807eb76679d) disconnected I0531 03:03:17.889297 6942 containerizer.cpp:301] Using isolation { environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni } I0531 03:03:17.889420 6954 master.cpp:3303] Disconnecting agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 at [email protected]:37420 (2807eb76679d) I0531 03:03:17.890275 6954 master.cpp:3322] Deactivating agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 at [email protected]:37420 (2807eb76679d) I0531 03:03:17.890890 6961 hierarchical.cpp:766] Agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 deactivated W0531 03:03:17.891001 6942 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges W0531 03:03:17.891795 6942 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges I0531 03:03:17.892216 6942 provisioner.cpp:299] Using default backend 'copy' W0531 03:03:17.945541 6942 process.cpp:2824] Attempted to spawn already running process [email protected]:37420 I0531 03:03:17.946449 6942 cluster.cpp:479] Creating default 'local' authorizer I0531 03:03:17.950368 6943 slave.cpp:266] Mesos agent started on @172.17.0.2:37420 I0531 03:03:17.950419 6943 slave.cpp:267] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_RwWykG/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_RwWykG/credential" --default_role="*" --disallow_sharing_agent_pid_namespace="false" --disk_watch_interval="1mins" --docker="docker" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io" --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_RwWykG/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="15secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_RwWykG/fetch" --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins" --frameworks_home="" --gc_delay="1weeks" --gc_disk_headroom="0.1" --hadoop_home="" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_RwWykG/http_credentials" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posix" --launcher_dir="/tmp/SRC/build/mesos-1.7.0/_build/sub/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --memory_profiling="false" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_RwWykG" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG" --zk_session_timeout="10secs" I0531 03:03:17.953269 6943 credentials.hpp:86] Loading credential for authentication from '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_RwWykG/credential' I0531 03:03:17.953603 6943 slave.cpp:299] Agent using credential for: test-principal I0531 03:03:17.953635 6943 credentials.hpp:37] Loading credentials for authentication from '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_RwWykG/http_credentials' I0531 03:03:17.954035 6943 http.cpp:959] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' I0531 03:03:17.954603 6943 disk_profile_adaptor.cpp:80] Creating default disk profile adaptor module I0531 03:03:17.956778 6943 slave.cpp:614] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] I0531 03:03:17.957154 6943 slave.cpp:622] Agent attributes: [ ] I0531 03:03:17.957185 6943 slave.cpp:631] Agent hostname: 2807eb76679d I0531 03:03:17.957546 6959 task_status_update_manager.cpp:181] Pausing sending task status updates I0531 03:03:17.965076 6943 state.cpp:66] Recovering state from '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/meta' I0531 03:03:17.965384 6943 state.cpp:711] No committed checkpointed resources found at '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/meta/resources/resources.info' I0531 03:03:17.971757 6957 slave.cpp:6925] Finished recovering checkpointed state from '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/meta', beginning agent recovery I0531 03:03:17.973151 6957 slave.cpp:7404] Recovering framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.973624 6957 slave.cpp:9099] Recovering executor '00a3ce3e-e365-44ad-98df-f635e43899bd' of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.976241 6957 task_status_update_manager.cpp:207] Recovering task status update manager I0531 03:03:17.976874 6957 task_status_update_manager.cpp:215] Recovering executor '00a3ce3e-e365-44ad-98df-f635e43899bd' of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.977334 6957 task_status_update_manager.cpp:507] Creating StatusUpdate stream for task 00a3ce3e-e365-44ad-98df-f635e43899bd of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.978497 6957 task_status_update_manager.cpp:818] Replaying task status update stream for task 00a3ce3e-e365-44ad-98df-f635e43899bd I0531 03:03:17.976625 6956 slave.cpp:1008] Successfully attached '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305' to virtual path '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/latest' I0531 03:03:17.979861 6956 slave.cpp:1008] Successfully attached '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305' to virtual path '/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/latest' I0531 03:03:17.980243 6956 slave.cpp:1008] Successfully attached '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305' to virtual path '/tmp/SlaveRecoveryTest_0_PingTimeoutDuringRecovery_AoFACG/slaves/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0/frameworks/edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000/executors/00a3ce3e-e365-44ad-98df-f635e43899bd/runs/00f6a53c-a87b-46ea-9c4e-4b7682694305' I0531 03:03:17.981278 6947 containerizer.cpp:718] Recovering Mesos containers I0531 03:03:17.981536 6947 containerizer.cpp:775] Recovering container 00f6a53c-a87b-46ea-9c4e-4b7682694305 for executor '00a3ce3e-e365-44ad-98df-f635e43899bd' of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:17.995256 6947 containerizer.cpp:1025] Recovering isolators I0531 03:03:17.998821 6959 containerizer.cpp:1064] Recovering provisioner I0531 03:03:18.000407 6959 provisioner.cpp:495] Provisioner recovery complete I0531 03:03:18.003870 6951 composing.cpp:341] Finished recovering all containerizers I0531 03:03:18.005090 6951 slave.cpp:7154] Recovering executors I0531 03:03:18.005635 6951 slave.cpp:7178] Sending reconnect request to executor '00a3ce3e-e365-44ad-98df-f635e43899bd' of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 at executor(1)@172.17.0.2:34294 I0531 03:03:18.010530 13542 exec.cpp:282] Received reconnect request from agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 I0531 03:03:18.021149 6949 slave.cpp:4980] Received re-registration message from executor '00a3ce3e-e365-44ad-98df-f635e43899bd' of framework edf7bf76-ba01-4c55-afac-8f5161fdd6cc-0000 I0531 03:03:18.033015 13544 exec.cpp:259] Executor reregistered on agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 I0531 03:03:18.038187 13544 executor.cpp:178] Received SUBSCRIBED event I0531 03:03:18.038637 13544 executor.cpp:182] Subscribed executor on 2807eb76679d I0531 03:03:18.046166 6945 slave.cpp:5897] No pings from master received within 75secs F0531 03:03:18.048151 6945 slave.cpp:1247] Check failed: state == DISCONNECTED || state == RUNNING || state == TERMINATING RECOVERING *** Check failure stack trace: *** I0531 03:03:18.046771 6951 hierarchical.cpp:1519] Performed allocation for 1 agents in 678717ns @ 0x7fa899512812 google::LogMessage::Fail() @ 0x7fa899512756 google::LogMessage::SendToLog() @ 0x7fa899512128 google::LogMessage::Flush() @ 0x7fa8995153e6 google::LogMessageFatal::~LogMessageFatal() @ 0x7fa897e01ce5 mesos::internal::slave::Slave::detected() @ 0x7fa897e9ffd3 _ZZN7process8dispatchIN5mesos8internal5slave5SlaveERKNS_6FutureI6OptionINS1_10MasterInfoEEEESB_EEvRKNS_3PIDIT_EEMSD_FvT0_EOT1_ENKUlOS9_PNS_11ProcessBaseEE_clESM_SO_ @ 0x7fa897f69483 _ZN5cpp176invokeIZN7process8dispatchIN5mesos8internal5slave5SlaveERKNS1_6FutureI6OptionINS3_10MasterInfoEEEESD_EEvRKNS1_3PIDIT_EEMSF_FvT0_EOT1_EUlOSB_PNS1_11ProcessBaseEE_JSB_SQ_EEEDTclcl7forwardISF_Efp_Espcl7forwardIT0_Efp0_EEEOSF_DpOSS_ @ 0x7fa897f5c443 _ZN6lambda8internal7PartialIZN7process8dispatchIN5mesos8internal5slave5SlaveERKNS2_6FutureI6OptionINS4_10MasterInfoEEEESE_EEvRKNS2_3PIDIT_EEMSG_FvT0_EOT1_EUlOSC_PNS2_11ProcessBaseEE_JSC_St12_PlaceholderILi1EEEE13invoke_expandISS_St5tupleIJSC_SU_EESX_IJOSR_EEJLm0ELm1EEEEDTcl6invokecl7forwardISG_Efp_Espcl6expandcl3getIXT2_EEcl7forwardISK_Efp0_EEcl7forwardISN_Efp2_EEEEOSG_OSK_N5cpp1416integer_sequenceImJXspT2_EEEESO_ @ 0x7fa897f4fa44 _ZNO6lambda8internal7PartialIZN7process8dispatchIN5mesos8internal5slave5SlaveERKNS2_6FutureI6OptionINS4_10MasterInfoEEEESE_EEvRKNS2_3PIDIT_EEMSG_FvT0_EOT1_EUlOSC_PNS2_11ProcessBaseEE_JSC_St12_PlaceholderILi1EEEEclIJSR_EEEDTcl13invoke_expandcl4movedtdefpT1fEcl4movedtdefpT10bound_argsEcvN5cpp1416integer_sequenceImJLm0ELm1EEEE_Ecl16forward_as_tuplespcl7forwardIT_Efp_EEEEDpOS10_ @ 0x7fa897f4a808 _ZN5cpp176invokeIN6lambda8internal7PartialIZN7process8dispatchIN5mesos8internal5slave5SlaveERKNS4_6FutureI6OptionINS6_10MasterInfoEEEESG_EEvRKNS4_3PIDIT_EEMSI_FvT0_EOT1_EUlOSE_PNS4_11ProcessBaseEE_JSE_St12_PlaceholderILi1EEEEEJST_EEEDTclcl7forwardISI_Efp_Espcl7forwardIT0_Efp0_EEEOSI_DpOSY_ @ 0x7fa897f4871b _ZN6lambda8internal6InvokeIvEclINS0_7PartialIZN7process8dispatchIN5mesos8internal5slave5SlaveERKNS5_6FutureI6OptionINS7_10MasterInfoEEEESH_EEvRKNS5_3PIDIT_EEMSJ_FvT0_EOT1_EUlOSF_PNS5_11ProcessBaseEE_ISF_St12_PlaceholderILi1EEEEEISU_EEEvOSJ_DpOT0_ @ 0x7fa897f45e80 _ZNO6lambda12CallableOnceIFvPN7process11ProcessBaseEEE10CallableFnINS_8internal7PartialIZNS1_8dispatchIN5mesos8internal5slave5SlaveERKNS1_6FutureI6OptionINSA_10MasterInfoEEEESK_EEvRKNS1_3PIDIT_EEMSM_FvT0_EOT1_EUlOSI_S3_E_ISI_St12_PlaceholderILi1EEEEEEclEOS3_ @ 0x7fa89941d1c4 _ZNO6lambda12CallableOnceIFvPN7process11ProcessBaseEEEclES3_ @ 0x7fa8993e90aa process::ProcessBase::consume() @ 0x7fa8994090a6 _ZNO7process13DispatchEvent7consumeEPNS_13EventConsumerE @ 0x557c9382f5ae process::ProcessBase::serve() @ 0x7fa8993e5f4e process::ProcessManager::resume() @ 0x7fa8993e22be _ZZN7process14ProcessManager12init_threadsEvENKUlvE_clEv @ 0x7fa8994032fc _ZNSt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUlvE_vEE9_M_invokeIJEEEvSt12_Index_tupleIJXspT_EEE @ 0x7fa899402686 _ZNSt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUlvE_vEEclEv @ 0x7fa899401846 _ZNSt6thread5_ImplISt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUlvE_vEEE6_M_runEv @ 0x7fa88d3ebc80 (unknown) @ 0x7fa88cbfe6ba start_thread @ 0x7fa88c93441d (unknown) I0531 03:03:19.058553 13539 exec.cpp:518] Agent exited, but framework has checkpointing enabled. Waiting 15mins to reconnect with agent edf7bf76-ba01-4c55-afac-8f5161fdd6cc-S0 Makefile:14730: recipe for target 'check-local' failed make[4]: *** [check-local] Aborted (core dumped) make[4]: Leaving directory '/tmp/SRC/build/mesos-1.7.0/_build/sub/src' Makefile:13846: recipe for target 'check-am' failed make[3]: *** [check-am] Error 2 make[3]: Leaving directory '/tmp/SRC/build/mesos-1.7.0/_build/sub/src' Makefile:13850: recipe for target 'check' failed make[2]: *** [check] Error 2 make[2]: Leaving directory '/tmp/SRC/build/mesos-1.7.0/_build/sub/src' Makefile:776: recipe for target 'check-recursive' failed make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory '/tmp/SRC/build/mesos-1.7.0/_build/sub' Makefile:982: recipe for target 'distcheck' failed make: *** [distcheck] Error 1 Untagged: mesos/mesos-build:ubuntu-16.04 Untagged: mesos/mesos-build@sha256:8685ea3c3e17663e4a1764d08df701102b4e9286c6c1a7116afccbe382777290 Deleted: sha256:4ecb5a128921ae9aad805a57a0e4d24dbcfbe84b09304997c7e2798819aa155a Deleted: sha256:91a3c8a13a99414ff67baa2d1c6a6a82b43c237327a78d7f815414e155578ac1 Deleted: sha256:d05373b7ffe6961840e0962d4b16df22a14b1bbba3416f5aee58b579f08a2bcd Deleted: sha256:db96690681268d3c4fdd48cd5edc2ca128c6b2493c67333983b63119622cc485 Deleted: sha256:70f40beaddd4e8dc15479d4f78d75b121fd4428c7bb29319a0fae0babd257e37 Deleted: sha256:77e6ddba346d8ad1e436256f6373dede5af4002006981b7d4116c561c759cefa Deleted: sha256:8db758ab2fdb54da0aec53aeac876934337e6170f5a8c8872b3d4171e3d465b7 Deleted: sha256:a7fc6b405fe8ef71edfa6163d1dc9f1cb1df426049eefaa7d388e9df21a061ad Deleted: sha256:5a3e35538f7f2e2727c8ac92f08c30002b9e8a77737de0dab91244344d59f69b Deleted: sha256:ff986b10a018b48074e6d3a68b39aad8ccc002cdad912d4148c0f92b3729323e Build step 'Execute shell' marked build as failure
