[
https://issues.apache.org/jira/browse/MESOS-7082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15857444#comment-15857444
]
Anand Mazumdar commented on MESOS-7082:
---------------------------------------
[~gilbert] [~jieyu] Any insights on what might be going wrong here? It looks
like the default executor exited fine (from the logs) but the executor
container was not destroyed leading to the failed assertion later.
> ROOT_DOCKER_DockerAndMesosContainerizers/DefaultExecutorTest.KillTask/0 is
> flaky
> --------------------------------------------------------------------------------
>
> Key: MESOS-7082
> URL: https://issues.apache.org/jira/browse/MESOS-7082
> Project: Mesos
> Issue Type: Bug
> Affects Versions: 1.2.0
> Environment: ubuntu 16.04 with/without SSL
> Reporter: Anand Mazumdar
> Labels: flaky, flaky-test, mesosphere
>
> Showed up on our internal CI
> {noformat}
> 07:00:17 [ RUN ]
> ROOT_DOCKER_DockerAndMesosContainerizers/DefaultExecutorTest.KillTask/0
> 07:00:17 I0207 07:00:17.775459 2952 cluster.cpp:160] Creating default
> 'local' authorizer
> 07:00:17 I0207 07:00:17.776511 2970 master.cpp:383] Master
> fa1554c4-572a-4b89-8994-a89460f588d3 (ip-10-153-254-29.ec2.internal) started
> on 10.153.254.29:38570
> 07:00:17 I0207 07:00:17.776538 2970 master.cpp:385] Flags at startup:
> --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins"
> --allocation_interval="1secs" --allocator="HierarchicalDRF"
> --authenticate_agents="true" --authenticate_frameworks="true"
> --authenticate_http_frameworks="true" --authenticate_http_readonly="true"
> --authenticate_http_readwrite="true" --authenticators="crammd5"
> --authorizers="local" --credentials="/tmp/ZROfJk/credentials"
> --framework_sorter="drf" --help="false" --hostname_lookup="true"
> --http_authenticators="basic" --http_framework_authenticators="basic"
> --initialize_driver_logging="true" --log_auto_initialize="true"
> --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5"
> --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000"
> --max_unreachable_tasks_per_framework="1000" --quiet="false"
> --recovery_agent_removal_limit="100%" --registry="in_memory"
> --registry_fetch_timeout="1mins" --registry_gc_interval="15mins"
> --registry_max_agent_age="2weeks" --registry_max_agent_count="102400"
> --registry_store_timeout="100secs" --registry_strict="false"
> --root_submissions="true" --user_sorter="drf" --version="false"
> --webui_dir="/usr/local/share/mesos/webui" --work_dir="/tmp/ZROfJk/master"
> --zk_session_timeout="10secs"
> 07:00:17 I0207 07:00:17.776674 2970 master.cpp:435] Master only allowing
> authenticated frameworks to register
> 07:00:17 I0207 07:00:17.776687 2970 master.cpp:449] Master only allowing
> authenticated agents to register
> 07:00:17 I0207 07:00:17.776695 2970 master.cpp:462] Master only allowing
> authenticated HTTP frameworks to register
> 07:00:17 I0207 07:00:17.776703 2970 credentials.hpp:37] Loading credentials
> for authentication from '/tmp/ZROfJk/credentials'
> 07:00:17 I0207 07:00:17.776779 2970 master.cpp:507] Using default 'crammd5'
> authenticator
> 07:00:17 I0207 07:00:17.776841 2970 http.cpp:919] Using default 'basic' HTTP
> authenticator for realm 'mesos-master-readonly'
> 07:00:17 I0207 07:00:17.776919 2970 http.cpp:919] Using default 'basic' HTTP
> authenticator for realm 'mesos-master-readwrite'
> 07:00:17 I0207 07:00:17.776970 2970 http.cpp:919] Using default 'basic' HTTP
> authenticator for realm 'mesos-master-scheduler'
> 07:00:17 I0207 07:00:17.777009 2970 master.cpp:587] Authorization enabled
> 07:00:17 I0207 07:00:17.777122 2975 hierarchical.cpp:161] Initialized
> hierarchical allocator process
> 07:00:17 I0207 07:00:17.777138 2974 whitelist_watcher.cpp:77] No whitelist
> given
> 07:00:17 I0207 07:00:17.777704 2976 master.cpp:2123] Elected as the leading
> master!
> 07:00:17 I0207 07:00:17.777726 2976 master.cpp:1645] Recovering from
> registrar
> 07:00:17 I0207 07:00:17.777784 2975 registrar.cpp:329] Recovering registrar
> 07:00:17 I0207 07:00:17.777989 2973 registrar.cpp:362] Successfully fetched
> the registry (0B) in 176384ns
> 07:00:17 I0207 07:00:17.778023 2973 registrar.cpp:461] Applied 1 operations
> in 7573ns; attempting to update the registry
> 07:00:17 I0207 07:00:17.778249 2976 registrar.cpp:506] Successfully updated
> the registry in 210944ns
> 07:00:17 I0207 07:00:17.778290 2976 registrar.cpp:392] Successfully
> recovered registrar
> 07:00:17 I0207 07:00:17.778373 2976 master.cpp:1761] Recovered 0 agents from
> the registry (172B); allowing 10mins for agents to re-register
> 07:00:17 I0207 07:00:17.778394 2974 hierarchical.cpp:188] Skipping recovery
> of hierarchical allocator: nothing to recover
> 07:00:17 I0207 07:00:17.869381 2952 containerizer.cpp:220] Using isolation:
> posix/cpu,posix/mem,filesystem/posix,network/cni
> 07:00:17 I0207 07:00:17.872557 2952 linux_launcher.cpp:150] Using
> /sys/fs/cgroup/freezer as the freezer hierarchy for the Linux launcher
> 07:00:17 I0207 07:00:17.872915 2952 provisioner.cpp:249] Using default
> backend 'overlay'
> 07:00:17 I0207 07:00:17.873425 2952 cluster.cpp:446] Creating default
> 'local' authorizer
> 07:00:17 I0207 07:00:17.873791 2974 slave.cpp:211] Mesos agent started on
> (716)@10.153.254.29:38570
> 07:00:17 I0207 07:00:17.874034 2952 scheduler.cpp:184] Version: 1.2.0
> 07:00:17 I0207 07:00:17.873829 2974 slave.cpp:212] Flags at startup:
> --acls="" --appc_simple_discovery_uri_prefix="http://";
> --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="true"
> --authenticate_http_readwrite="false" --authenticatee="crammd5"
> --authentication_backoff_factor="1secs" --authorizer="local"
> --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false"
> --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false"
> --cgroups_root="mesos" --container_disk_watch_interval="15secs"
> --containerizers="docker,mesos"
> --credential="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/credential"
> --default_role="*" --disk_watch_interval="1mins" --docker="docker"
> --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io";
> --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock"
> --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker"
> --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume"
> --enforce_container_disk_quota="false"
> --executor_registration_timeout="1mins"
> --executor_shutdown_grace_period="5secs"
> --fetcher_cache_dir="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/fetch"
> --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
> --gc_disk_headroom="0.1" --hadoop_home="" --help="false"
> --hostname_lookup="true" --http_authenticators="basic"
> --http_command_executor="false"
> --http_credentials="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/http_credentials"
> --http_heartbeat_interval="30secs" --initialize_driver_logging="true"
> --isolation="posix/cpu,posix/mem" --launcher="linux"
> --launcher_dir="/home/ubuntu/workspace/mesos/Mesos_CI-build/FLAG/Clang/label/mesos-ec2-ubuntu-16.04/mesos/build/src"
> --logbufsecs="0" --logging_level="INFO"
> --max_completed_executors_per_framework="150"
> --oversubscribed_resources_interval="15secs" --perf_duration="10secs"
> --perf_interval="1mins" --qos_correction_interval_min="0ns" --quiet="false"
> --recover="reconnect" --recovery_timeout="15mins"
> --registration_backoff_factor="10ms"
> --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]"
> --revocable_cpu_low_priority="true"
> --runtime_dir="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO"
> --sandbox_directory="/mnt/mesos/sandbox" --strict="true"
> --switch_user="true" --systemd_enable_support="true"
> --systemd_runtime_directory="/run/systemd/system" --version="false"
> --work_dir="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4"
> 07:00:17 I0207 07:00:17.874168 2974 credentials.hpp:86] Loading credential
> for authentication from
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/credential'
> 07:00:17 I0207 07:00:17.874236 2974 slave.cpp:354] Agent using credential
> for: test-principal
> 07:00:17 I0207 07:00:17.874258 2974 credentials.hpp:37] Loading credentials
> for authentication from
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/http_credentials'
> 07:00:17 I0207 07:00:17.874331 2974 http.cpp:919] Using default 'basic' HTTP
> authenticator for realm 'mesos-agent-readonly'
> 07:00:17 I0207 07:00:17.874583 2976 scheduler.cpp:470] New master detected
> at [email protected]:38570
> 07:00:17 I0207 07:00:17.874610 2976 scheduler.cpp:479] Waiting for 0ns
> before initiating a re-(connection) attempt with the master
> 07:00:17 I0207 07:00:17.874836 2974 slave.cpp:541] Agent resources:
> cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000]
> 07:00:17 I0207 07:00:17.874873 2974 slave.cpp:549] Agent attributes: [ ]
> 07:00:17 I0207 07:00:17.874881 2974 slave.cpp:554] Agent hostname:
> ip-10-153-254-29.ec2.internal
> 07:00:17 I0207 07:00:17.874991 2970 status_update_manager.cpp:177] Pausing
> sending status updates
> 07:00:17 I0207 07:00:17.875248 2972 state.cpp:62] Recovering state from
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/meta'
> 07:00:17 I0207 07:00:17.875445 2971 status_update_manager.cpp:203]
> Recovering status update manager
> 07:00:17 I0207 07:00:17.875591 2972 containerizer.cpp:599] Recovering
> containerizer
> 07:00:17 I0207 07:00:17.875604 2977 docker.cpp:868] Recovering Docker
> containers
> 07:00:17 I0207 07:00:17.875658 2977 docker.cpp:1139] Running docker -H
> unix:///var/run/docker.sock ps -a
> 07:00:17 I0207 07:00:17.879174 2973 scheduler.cpp:361] Connected with the
> master at http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:17 I0207 07:00:17.879809 2976 provisioner.cpp:410] Provisioner
> recovery complete
> 07:00:17 I0207 07:00:17.879889 2971 scheduler.cpp:243] Sending SUBSCRIBE
> call to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:17 I0207 07:00:17.880321 2976 process.cpp:3704] Handling HTTP event
> for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:17 I0207 07:00:17.880755 2972 http.cpp:420] HTTP POST for
> /master/api/v1/scheduler from 10.153.254.29:44396
> 07:00:17 I0207 07:00:17.880834 2972 master.cpp:2422] Received subscription
> request for HTTP framework 'default'
> 07:00:17 I0207 07:00:17.880857 2972 master.cpp:2159] Authorizing framework
> principal 'test-principal' to receive offers for role '*'
> 07:00:17 I0207 07:00:17.881100 2977 master.cpp:2536] Subscribing framework
> 'default' with checkpointing disabled and capabilities [ ]
> 07:00:17 I0207 07:00:17.881320 2976 master.hpp:2114] Sending heartbeat to
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:17 I0207 07:00:17.881291 2973 hierarchical.cpp:286] Added framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:17 I0207 07:00:17.881448 2973 hierarchical.cpp:1817] No allocations
> performed
> 07:00:17 I0207 07:00:17.881471 2973 hierarchical.cpp:1907] No inverse offers
> to send out!
> 07:00:17 I0207 07:00:17.881480 2973 hierarchical.cpp:1401] Performed
> allocation for 0 agents in 47645ns
> 07:00:17 I0207 07:00:17.881830 2972 scheduler.cpp:676] Enqueuing event
> SUBSCRIBED received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:17 I0207 07:00:17.882037 2972 scheduler.cpp:676] Enqueuing event
> HEARTBEAT received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:17.970202 2975 slave.cpp:5499] Finished recovery
> 07:00:18 I0207 07:00:17.970434 2975 slave.cpp:5673] Querying resource
> estimator for oversubscribable resources
> 07:00:18 I0207 07:00:17.970556 2975 slave.cpp:931] New master detected at
> [email protected]:38570
> 07:00:18 I0207 07:00:17.970564 2973 status_update_manager.cpp:177] Pausing
> sending status updates
> 07:00:18 I0207 07:00:17.970598 2975 slave.cpp:966] Detecting new master
> 07:00:18 I0207 07:00:17.970636 2975 slave.cpp:5687] Received
> oversubscribable resources {} from the resource estimator
> 07:00:18 I0207 07:00:17.976898 2970 slave.cpp:993] Authenticating with
> master [email protected]:38570
> 07:00:18 I0207 07:00:17.976929 2970 slave.cpp:1004] Using default CRAM-MD5
> authenticatee
> 07:00:18 I0207 07:00:17.977015 2974 authenticatee.cpp:121] Creating new
> client SASL connection
> 07:00:18 I0207 07:00:17.977448 2974 master.cpp:7103] Authenticating
> slave(716)@10.153.254.29:38570
> 07:00:18 I0207 07:00:17.977509 2975 authenticator.cpp:414] Starting
> authentication session for crammd5-authenticatee(1366)@10.153.254.29:38570
> 07:00:18 I0207 07:00:17.977602 2976 authenticator.cpp:98] Creating new
> server SASL connection
> 07:00:18 I0207 07:00:17.977922 2976 authenticatee.cpp:213] Received SASL
> authentication mechanisms: CRAM-MD5
> 07:00:18 I0207 07:00:17.977954 2976 authenticatee.cpp:239] Attempting to
> authenticate with mechanism 'CRAM-MD5'
> 07:00:18 I0207 07:00:17.977998 2976 authenticator.cpp:204] Received SASL
> authentication start
> 07:00:18 I0207 07:00:17.978061 2976 authenticator.cpp:326] Authentication
> requires more steps
> 07:00:18 I0207 07:00:17.978106 2976 authenticatee.cpp:259] Received SASL
> authentication step
> 07:00:18 I0207 07:00:17.978184 2974 authenticator.cpp:232] Received SASL
> authentication step
> 07:00:18 I0207 07:00:17.978210 2974 auxprop.cpp:109] Request to lookup
> properties for user: 'test-principal' realm: 'ip-10-153-254-29.ec2.internal'
> server FQDN: 'ip-10-153-254-29.ec2.internal'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: false
> 07:00:18 I0207 07:00:17.978219 2974 auxprop.cpp:181] Looking up auxiliary
> property '*userPassword'
> 07:00:18 I0207 07:00:17.978227 2974 auxprop.cpp:181] Looking up auxiliary
> property '*cmusaslsecretCRAM-MD5'
> 07:00:18 I0207 07:00:17.978235 2974 auxprop.cpp:109] Request to lookup
> properties for user: 'test-principal' realm: 'ip-10-153-254-29.ec2.internal'
> server FQDN: 'ip-10-153-254-29.ec2.internal'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: true
> 07:00:18 I0207 07:00:17.978238 2974 auxprop.cpp:131] Skipping auxiliary
> property '*userPassword' since SASL_AUXPROP_AUTHZID == true
> 07:00:18 I0207 07:00:17.978243 2974 auxprop.cpp:131] Skipping auxiliary
> property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
> 07:00:18 I0207 07:00:17.978252 2974 authenticator.cpp:318] Authentication
> success
> 07:00:18 I0207 07:00:17.978297 2973 authenticatee.cpp:299] Authentication
> success
> 07:00:18 I0207 07:00:17.978324 2974 master.cpp:7133] Successfully
> authenticated principal 'test-principal' at slave(716)@10.153.254.29:38570
> 07:00:18 I0207 07:00:17.978356 2972 authenticator.cpp:432] Authentication
> session cleanup for crammd5-authenticatee(1366)@10.153.254.29:38570
> 07:00:18 I0207 07:00:17.978426 2975 slave.cpp:1088] Successfully
> authenticated with master [email protected]:38570
> 07:00:18 I0207 07:00:17.978520 2975 slave.cpp:1515] Will retry registration
> in 19.358366ms if necessary
> 07:00:18 I0207 07:00:17.978575 2973 master.cpp:5318] Registering agent at
> slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) with id
> fa1554c4-572a-4b89-8994-a89460f588d3-S0
> 07:00:18 I0207 07:00:17.978699 2976 registrar.cpp:461] Applied 1 operations
> in 24121ns; attempting to update the registry
> 07:00:18 I0207 07:00:17.979012 2974 registrar.cpp:506] Successfully updated
> the registry in 280832ns
> 07:00:18 I0207 07:00:17.979252 2973 slave.cpp:4301] Received ping from
> slave-observer(652)@10.153.254.29:38570
> 07:00:18 I0207 07:00:17.979238 2976 master.cpp:5392] Registered agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal) with cpus(*):2; mem(*):1024; disk(*):1024;
> ports(*):[31000-32000]
> 07:00:18 I0207 07:00:17.979311 2973 slave.cpp:1134] Registered with master
> [email protected]:38570; given agent ID
> fa1554c4-572a-4b89-8994-a89460f588d3-S0
> 07:00:18 I0207 07:00:17.979312 2974 hierarchical.cpp:515] Added agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 (ip-10-153-254-29.ec2.internal) with
> cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (allocated: {})
> 07:00:18 I0207 07:00:17.979336 2973 fetcher.cpp:90] Clearing fetcher cache
> 07:00:18 I0207 07:00:17.979425 2977 status_update_manager.cpp:184] Resuming
> sending status updates
> 07:00:18 I0207 07:00:17.979490 2973 slave.cpp:1162] Checkpointing SlaveInfo
> to
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/meta/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/slave.info'
> 07:00:18 I0207 07:00:17.979542 2974 hierarchical.cpp:1907] No inverse offers
> to send out!
> 07:00:18 I0207 07:00:17.979562 2974 hierarchical.cpp:1401] Performed
> allocation for 1 agents in 198598ns
> 07:00:18 I0207 07:00:17.979625 2973 slave.cpp:1200] Forwarding total
> oversubscribed resources {}
> 07:00:18 I0207 07:00:17.979665 2970 master.cpp:6932] Sending 1 offers to
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:18 I0207 07:00:17.979815 2970 master.cpp:5949] Received update of
> agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at
> slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) with total
> oversubscribed resources {}
> 07:00:18 I0207 07:00:17.979897 2970 hierarchical.cpp:588] Agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 (ip-10-153-254-29.ec2.internal)
> updated with oversubscribed resources {} (total: cpus(*):2; mem(*):1024;
> disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):2;
> mem(*)(allocated: *):1024; disk(*)(allocated: *):1024; ports(*)(allocated:
> *):[31000-32000])
> 07:00:18 I0207 07:00:17.979951 2970 hierarchical.cpp:1817] No allocations
> performed
> 07:00:18 I0207 07:00:17.980002 2970 hierarchical.cpp:1907] No inverse offers
> to send out!
> 07:00:18 I0207 07:00:17.980016 2970 hierarchical.cpp:1401] Performed
> allocation for 1 agents in 83177ns
> 07:00:18 I0207 07:00:17.980195 2974 scheduler.cpp:676] Enqueuing event
> OFFERS received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:17.980867 2970 scheduler.cpp:243] Sending ACCEPT call
> to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:17.981184 2973 process.cpp:3704] Handling HTTP event
> for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:18 I0207 07:00:17.981575 2976 http.cpp:420] HTTP POST for
> /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:18 I0207 07:00:17.981762 2976 master.cpp:3745] Processing ACCEPT call
> for offers: [ fa1554c4-572a-4b89-8994-a89460f588d3-O0 ] on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal) for framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:18 I0207 07:00:17.981812 2976 master.cpp:3318] Authorizing framework
> principal 'test-principal' to launch task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb
> 07:00:18 I0207 07:00:17.981945 2976 master.cpp:3318] Authorizing framework
> principal 'test-principal' to launch task c24a618d-ce08-4784-b8c7-0eeda79d121b
> 07:00:18 I0207 07:00:17.982826 2976 master.cpp:8993] Adding task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb with resources cpus(*)(allocated:
> *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:17.982899 2976 master.cpp:8993] Adding task
> c24a618d-ce08-4784-b8c7-0eeda79d121b with resources cpus(*)(allocated:
> *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:17.982950 2976 master.cpp:4600] Launching task group {
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b }
> of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) with
> resources cpus(*)(allocated: *):0.2; mem(*)(allocated: *):64;
> disk(*)(allocated: *):64 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at
> slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:17.983122 2977 slave.cpp:1583] Got assigned task group
> containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb,
> c24a618d-ce08-4784-b8c7-0eeda79d121b ] for framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:17.983191 2973 hierarchical.cpp:1079] Recovered
> cpus(*)(allocated: *):1.7; mem(*)(allocated: *):928; disk(*)(allocated:
> *):928; ports(*)(allocated: *):[31000-32000] (total: cpus(*):2; mem(*):1024;
> disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):0.3;
> mem(*)(allocated: *):96; disk(*)(allocated: *):96) on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:17.983423 2977 slave.cpp:1743] Launching task group
> containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb,
> c24a618d-ce08-4784-b8c7-0eeda79d121b ] for framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:17.983650 2977 paths.cpp:547] Trying to chown
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974'
> to user 'root'
> 07:00:18 I0207 07:00:17.983779 2977 slave.cpp:6414] Launching executor
> 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 with
> resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32;
> disk(*)(allocated: *):32 in work directory
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974'
> 07:00:18 I0207 07:00:17.983988 2977 slave.cpp:2073] Queued task group
> containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb,
> c24a618d-ce08-4784-b8c7-0eeda79d121b ] for executor 'default' of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:17.984022 2974 docker.cpp:1099] No container info
> found, skipping launch
> 07:00:18 I0207 07:00:17.984032 2977 slave.cpp:884] Successfully attached
> file
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974'
> 07:00:18 I0207 07:00:17.984192 2975 containerizer.cpp:992] Starting
> container 4cfc866d-9fef-442b-8682-58dabb305974 for executor 'default' of
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:17.985002 2976 containerizer.cpp:1538] Launching
> 'mesos-containerizer' with flags '--help="false"
> --launch_info="{"command":{"arguments":["mesos-default-executor","--launcher_dir=\/home\/ubuntu\/workspace\/mesos\/Mesos_CI-build\/FLAG\/Clang\/label\/mesos-ec2-ubuntu-16.04\/mesos\/build\/src"],"shell":false,"value":"\/home\/ubuntu\/workspace\/mesos\/Mesos_CI-build\/FLAG\/Clang\/label\/mesos-ec2-ubuntu-16.04\/mesos\/build\/src\/mesos-default-executor"},"environment":{"variables":[{"name":"LIBPROCESS_PORT","value":"0"},{"name":"MESOS_AGENT_ENDPOINT","value":"10.153.254.29:38570"},{"name":"MESOS_CHECKPOINT","value":"0"},{"name":"MESOS_DIRECTORY","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974"},{"name":"MESOS_EXECUTOR_ID","value":"default"},{"name":"MESOS_EXECUTOR_SHUTDOWN_GRACE_PERIOD","value":"5secs"},{"name":"MESOS_FRAMEWORK_ID","value":"fa1554c4-572a-4b89-8994-a89460f588d3-0000"},{"name":"MESOS_HTTP_COMMAND_EXECUTOR","value":"0"},{"name":"MESOS_SLAVE_ID","value":"fa1554c4-572a-4b89-8994-a89460f588d3-S0"},{"name":"MESOS_SLAVE_PID","value":"slave(716)@10.153.254.29:38570"},{"name":"MESOS_SANDBOX","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974"}]},"user":"root","working_directory":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974"}"
> --pipe_read="30" --pipe_write="31"
> --runtime_directory="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974"
> --unshare_namespace_mnt="false"'
> 07:00:18 I0207 07:00:17.985275 2970 linux_launcher.cpp:429] Launching
> container 4cfc866d-9fef-442b-8682-58dabb305974 and cloning with namespaces
> 07:00:18 I0207 07:00:18.011076 2973 fetcher.cpp:349] Starting to fetch URIs
> for container: 4cfc866d-9fef-442b-8682-58dabb305974, directory:
> /tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:18 I0207 07:00:18.076251 29005 executor.cpp:192] Version: 1.2.0
> 07:00:18 I0207 07:00:18.078815 2974 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:18 I0207 07:00:18.079205 2975 http.cpp:303] HTTP POST for
> /slave(716)/api/v1/executor from 10.153.254.29:44400
> 07:00:18 I0207 07:00:18.079286 2975 slave.cpp:3124] Received Subscribe
> request for HTTP executor 'default' of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.080021 2970 slave.cpp:2315] Sending queued task
> group task group containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb,
> c24a618d-ce08-4784-b8c7-0eeda79d121b ] to executor 'default' of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (via HTTP)
> 07:00:18 I0207 07:00:18.080541 29024 default_executor.cpp:153] Received
> SUBSCRIBED event
> 07:00:18 I0207 07:00:18.082542 29024 default_executor.cpp:157] Subscribed
> executor on ip-10-153-254-29.ec2.internal
> 07:00:18 I0207 07:00:18.082628 29024 default_executor.cpp:153] Received
> LAUNCH_GROUP event
> 07:00:18 I0207 07:00:18.083161 2975 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.083336 2975 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.083618 2976 http.cpp:303] HTTP POST for
> /slave(716)/api/v1 from 10.153.254.29:44404
> 07:00:18 I0207 07:00:18.083688 2976 http.cpp:303] HTTP POST for
> /slave(716)/api/v1 from 10.153.254.29:44404
> 07:00:18 I0207 07:00:18.083775 2976 http.cpp:517] Processing call
> LAUNCH_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.083876 2976 http.cpp:517] Processing call
> LAUNCH_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.084066 2972 containerizer.cpp:1805] Starting nested
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.084185 2972 containerizer.cpp:1829] Trying to chown
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/966d71b2-cbc7-40a6-accf-bef80d3d8338'
> to user 'root'
> 07:00:18 I0207 07:00:18.084568 2972 containerizer.cpp:1805] Starting nested
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:18 I0207 07:00:18.084655 2972 containerizer.cpp:1829] Trying to chown
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/486b0abc-966d-49b7-b2e0-58cd1d4b462e'
> to user 'root'
> 07:00:18 I0207 07:00:18.085088 2972 containerizer.cpp:1538] Launching
> 'mesos-containerizer' with flags '--help="false"
> --launch_info="{"command":{"shell":true,"value":"sleep
> 1000"},"environment":{"variables":[{"name":"MESOS_SANDBOX","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/966d71b2-cbc7-40a6-accf-bef80d3d8338"}]},"user":"root","working_directory":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/966d71b2-cbc7-40a6-accf-bef80d3d8338"}"
> --pipe_read="57" --pipe_write="76"
> --runtime_directory="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/966d71b2-cbc7-40a6-accf-bef80d3d8338"
> --unshare_namespace_mnt="false"'
> 07:00:18 I0207 07:00:18.085297 2976 linux_launcher.cpp:429] Launching nested
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 and
> cloning with namespaces
> 07:00:18 I0207 07:00:18.114851 2972 containerizer.cpp:1538] Launching
> 'mesos-containerizer' with flags '--help="false"
> --launch_info="{"command":{"shell":true,"value":"sleep
> 1000"},"environment":{"variables":[{"name":"MESOS_SANDBOX","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/486b0abc-966d-49b7-b2e0-58cd1d4b462e"}]},"user":"root","working_directory":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/486b0abc-966d-49b7-b2e0-58cd1d4b462e"}"
> --pipe_read="77" --pipe_write="78"
> --runtime_directory="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/486b0abc-966d-49b7-b2e0-58cd1d4b462e"
> --unshare_namespace_mnt="false"'
> 07:00:18 I0207 07:00:18.115092 2974 linux_launcher.cpp:429] Launching nested
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e and
> cloning with namespaces
> 07:00:18 I0207 07:00:18.124974 2970 fetcher.cpp:349] Starting to fetch URIs
> for container:
> 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338,
> directory:
> /tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.126298 2970 fetcher.cpp:349] Starting to fetch URIs
> for container:
> 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e,
> directory:
> /tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:18 I0207 07:00:18.129250 29022 default_executor.cpp:469] Successfully
> launched tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb,
> c24a618d-ce08-4784-b8c7-0eeda79d121b ] in child containers [
> 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338,
> 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e ]
> 07:00:18 I0207 07:00:18.130044 29019 default_executor.cpp:542] Waiting for
> child container
> 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 of
> task '16b247b5-e1dd-4395-a2d7-71c9c393e5bb'
> 07:00:18 I0207 07:00:18.130199 29019 default_executor.cpp:542] Waiting for
> child container
> 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e of
> task 'c24a618d-ce08-4784-b8c7-0eeda79d121b'
> 07:00:18 I0207 07:00:18.130437 2975 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:18 I0207 07:00:18.130678 2975 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:18 I0207 07:00:18.130791 2975 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.130939 2975 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.131260 2973 http.cpp:303] HTTP POST for
> /slave(716)/api/v1 from 10.153.254.29:44408
> 07:00:18 I0207 07:00:18.131341 2973 http.cpp:303] HTTP POST for
> /slave(716)/api/v1/executor from 10.153.254.29:44402
> 07:00:18 I0207 07:00:18.131402 2973 slave.cpp:3771] Handling status update
> TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.131579 2973 http.cpp:303] HTTP POST for
> /slave(716)/api/v1 from 10.153.254.29:44406
> 07:00:18 I0207 07:00:18.131680 2973 http.cpp:303] HTTP POST for
> /slave(716)/api/v1/executor from 10.153.254.29:44402
> 07:00:18 I0207 07:00:18.131752 2973 slave.cpp:3771] Handling status update
> TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task
> c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.132120 2973 http.cpp:517] Processing call
> WAIT_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.132252 2973 http.cpp:517] Processing call
> WAIT_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.132444 2976 status_update_manager.cpp:323] Received
> status update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for
> task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.132472 2976 status_update_manager.cpp:500] Creating
> StatusUpdate stream for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.132637 2976 status_update_manager.cpp:377]
> Forwarding update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215)
> for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent
> 07:00:18 I0207 07:00:18.132741 2973 slave.cpp:4211] Forwarding the update
> TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 to [email protected]:38570
> 07:00:18 I0207 07:00:18.132776 2976 status_update_manager.cpp:323] Received
> status update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for
> task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.132791 2976 status_update_manager.cpp:500] Creating
> StatusUpdate stream for task c24a618d-ce08-4784-b8c7-0eeda79d121b of
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.132839 2973 slave.cpp:4105] Status update manager
> successfully handled status update TASK_RUNNING (UUID:
> d54c9399-1a59-426c-80f2-c5fa491b9215) for task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.132913 2976 status_update_manager.cpp:377]
> Forwarding update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009)
> for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent
> 07:00:18 I0207 07:00:18.132949 2972 master.cpp:6094] Status update
> TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:18.133024 2974 slave.cpp:4211] Forwarding the update
> TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task
> c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 to [email protected]:38570
> 07:00:18 I0207 07:00:18.133051 2972 master.cpp:6162] Forwarding status
> update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.133170 2974 slave.cpp:4105] Status update manager
> successfully handled status update TASK_RUNNING (UUID:
> 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task
> c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.133327 29025 default_executor.cpp:153] Received
> ACKNOWLEDGED event
> 07:00:18 I0207 07:00:18.133405 2972 master.cpp:8242] Updating the state of
> task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_RUNNING, status
> update state: TASK_RUNNING)
> 07:00:18 I0207 07:00:18.133518 2972 master.cpp:6094] Status update
> TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task
> c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:18.133553 2972 master.cpp:6162] Forwarding status
> update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task
> c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.133646 2972 master.cpp:8242] Updating the state of
> task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_RUNNING, status
> update state: TASK_RUNNING)
> 07:00:18 I0207 07:00:18.133905 29019 default_executor.cpp:153] Received
> ACKNOWLEDGED event
> 07:00:18 I0207 07:00:18.134141 2973 scheduler.cpp:676] Enqueuing event
> UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.134351 2973 scheduler.cpp:676] Enqueuing event
> UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.778179 2976 hierarchical.cpp:1907] No inverse offers
> to send out!
> 07:00:18 I0207 07:00:18.778226 2976 hierarchical.cpp:1401] Performed
> allocation for 1 agents in 258865ns
> 07:00:18 I0207 07:00:18.778333 2972 master.cpp:6932] Sending 1 offers to
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:18 I0207 07:00:18.778885 2972 scheduler.cpp:676] Enqueuing event
> OFFERS received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.779575 2976 scheduler.cpp:243] Sending ACCEPT call
> to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.779938 2976 process.cpp:3704] Handling HTTP event
> for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:18 I0207 07:00:18.817811 2974 http.cpp:420] HTTP POST for
> /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:18 I0207 07:00:18.817988 2974 master.cpp:3745] Processing ACCEPT call
> for offers: [ fa1554c4-572a-4b89-8994-a89460f588d3-O1 ] on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal) for framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:18 I0207 07:00:18.818032 2974 master.cpp:3318] Authorizing framework
> principal 'test-principal' to launch task 8cd47a02-ff21-4585-ab72-0ce803a4be78
> 07:00:18 I0207 07:00:18.818761 2970 master.cpp:8993] Adding task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 with resources cpus(*)(allocated:
> *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:18.818826 2970 master.cpp:4600] Launching task group {
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 } of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) with resources
> cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32
> on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at
> slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:18.818967 2976 slave.cpp:1583] Got assigned task group
> containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] for framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.819067 2971 hierarchical.cpp:1079] Recovered
> cpus(*)(allocated: *):1.6; mem(*)(allocated: *):896; disk(*)(allocated:
> *):896; ports(*)(allocated: *):[31000-32000] (total: cpus(*):2; mem(*):1024;
> disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):0.4;
> mem(*)(allocated: *):128; disk(*)(allocated: *):128) on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.819103 2971 hierarchical.cpp:1116] Framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 filtered agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 for 5secs
> 07:00:18 I0207 07:00:18.819105 2976 slave.cpp:1743] Launching task group
> containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] for framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.819150 2976 slave.cpp:2095] Queued task group
> containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] for executor
> 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (via HTTP)
> 07:00:18 I0207 07:00:18.819540 2974 slave.cpp:2315] Sending queued task
> group task group containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] to
> executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> (via HTTP)
> 07:00:18 I0207 07:00:18.820272 29019 default_executor.cpp:153] Received
> LAUNCH_GROUP event
> 07:00:18 I0207 07:00:18.821336 2970 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.821585 2972 http.cpp:303] HTTP POST for
> /slave(716)/api/v1 from 10.153.254.29:44410
> 07:00:18 I0207 07:00:18.821693 2972 http.cpp:517] Processing call
> LAUNCH_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.821916 2976 containerizer.cpp:1805] Starting nested
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:18 I0207 07:00:18.822005 2976 containerizer.cpp:1829] Trying to chown
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/5e04c992-3a62-4187-86b2-2ad4abb2f5e8'
> to user 'root'
> 07:00:18 I0207 07:00:18.822497 2975 containerizer.cpp:1538] Launching
> 'mesos-containerizer' with flags '--help="false"
> --launch_info="{"command":{"shell":true,"value":"sleep
> 1000"},"environment":{"variables":[{"name":"MESOS_SANDBOX","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/5e04c992-3a62-4187-86b2-2ad4abb2f5e8"}]},"user":"root","working_directory":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/5e04c992-3a62-4187-86b2-2ad4abb2f5e8"}"
> --pipe_read="77" --pipe_write="78"
> --runtime_directory="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/5e04c992-3a62-4187-86b2-2ad4abb2f5e8"
> --unshare_namespace_mnt="false"'
> 07:00:18 I0207 07:00:18.822722 2977 linux_launcher.cpp:429] Launching nested
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 and
> cloning with namespaces
> 07:00:18 I0207 07:00:18.851102 2976 fetcher.cpp:349] Starting to fetch URIs
> for container:
> 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8,
> directory:
> /tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:18 I0207 07:00:18.853680 29021 default_executor.cpp:469] Successfully
> launched tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] in child containers [
> 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 ]
> 07:00:18 I0207 07:00:18.854037 29026 default_executor.cpp:542] Waiting for
> child container
> 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 of
> task '8cd47a02-ff21-4585-ab72-0ce803a4be78'
> 07:00:18 I0207 07:00:18.854059 2973 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:18 I0207 07:00:18.854372 2976 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.854599 2974 http.cpp:303] HTTP POST for
> /slave(716)/api/v1 from 10.153.254.29:44412
> 07:00:18 I0207 07:00:18.854703 2974 http.cpp:517] Processing call
> WAIT_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.893777 2973 http.cpp:303] HTTP POST for
> /slave(716)/api/v1/executor from 10.153.254.29:44402
> 07:00:18 I0207 07:00:18.893868 2973 slave.cpp:3771] Handling status update
> TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.894559 2970 status_update_manager.cpp:323] Received
> status update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for
> task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.894589 2970 status_update_manager.cpp:500] Creating
> StatusUpdate stream for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.894749 2970 status_update_manager.cpp:377]
> Forwarding update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea)
> for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent
> 07:00:18 I0207 07:00:18.894865 2977 slave.cpp:4211] Forwarding the update
> TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 to [email protected]:38570
> 07:00:18 I0207 07:00:18.894951 2977 slave.cpp:4105] Status update manager
> successfully handled status update TASK_RUNNING (UUID:
> 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.895066 2975 master.cpp:6094] Status update
> TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:18.895097 2975 master.cpp:6162] Forwarding status
> update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.895196 2975 master.cpp:8242] Updating the state of
> task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_RUNNING, status
> update state: TASK_RUNNING)
> 07:00:18 I0207 07:00:18.895474 29025 default_executor.cpp:153] Received
> ACKNOWLEDGED event
> 07:00:18 I0207 07:00:18.895576 2971 scheduler.cpp:676] Enqueuing event
> UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.896118 2972 scheduler.cpp:243] Sending ACKNOWLEDGE
> call to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.896244 2972 scheduler.cpp:243] Sending ACKNOWLEDGE
> call to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.896327 2972 scheduler.cpp:243] Sending ACKNOWLEDGE
> call to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.896453 2972 scheduler.cpp:243] Sending KILL call to
> http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.896493 2975 process.cpp:3704] Handling HTTP event
> for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:18 I0207 07:00:18.933679 2976 process.cpp:3704] Handling HTTP event
> for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:18 I0207 07:00:18.933753 2976 process.cpp:3704] Handling HTTP event
> for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:18 I0207 07:00:18.933818 2976 process.cpp:3704] Handling HTTP event
> for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:18 I0207 07:00:18.934253 2976 http.cpp:420] HTTP POST for
> /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:18 I0207 07:00:18.934309 2976 master.cpp:5032] Processing ACKNOWLEDGE
> call d54c9399-1a59-426c-80f2-c5fa491b9215 for task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0
> 07:00:18 I0207 07:00:18.934440 2974 status_update_manager.cpp:395] Received
> status update acknowledgement (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215)
> for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.934512 2976 http.cpp:420] HTTP POST for
> /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:18 I0207 07:00:18.934556 2976 master.cpp:5032] Processing ACKNOWLEDGE
> call 10681538-b4e6-4eb8-b8ae-0e7af9b4e009 for task
> c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0
> 07:00:18 I0207 07:00:18.934666 2973 slave.cpp:3060] Status update manager
> successfully handled status update acknowledgement (UUID:
> d54c9399-1a59-426c-80f2-c5fa491b9215) for task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.934710 2976 http.cpp:420] HTTP POST for
> /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:18 I0207 07:00:18.934746 2973 status_update_manager.cpp:395] Received
> status update acknowledgement (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009)
> for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.934763 2976 master.cpp:5032] Processing ACKNOWLEDGE
> call 128da3e5-7a2c-4351-a36c-5dd43d7977ea for task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0
> 07:00:18 I0207 07:00:18.934803 2973 slave.cpp:3060] Status update manager
> successfully handled status update acknowledgement (UUID:
> 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task
> c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.934844 2976 http.cpp:420] HTTP POST for
> /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:18 I0207 07:00:18.934875 2976 master.cpp:4851] Processing KILL call
> for task '16b247b5-e1dd-4395-a2d7-71c9c393e5bb' of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:18 I0207 07:00:18.934918 2973 status_update_manager.cpp:395] Received
> status update acknowledgement (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea)
> for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.934916 2976 master.cpp:4924] Telling agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal) to kill task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:18 I0207 07:00:18.935019 2975 slave.cpp:2383] Asked to kill task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.935169 2975 slave.cpp:3060] Status update manager
> successfully handled status update acknowledgement (UUID:
> 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.935544 29020 default_executor.cpp:153] Received KILL
> event
> 07:00:18 I0207 07:00:18.935567 29020 default_executor.cpp:841] Received kill
> for task '16b247b5-e1dd-4395-a2d7-71c9c393e5bb'
> 07:00:18 I0207 07:00:18.935581 29020 default_executor.cpp:813] Killing child
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.936013 2975 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.936257 2976 http.cpp:303] HTTP POST for
> /slave(716)/api/v1 from 10.153.254.29:44414
> 07:00:18 I0207 07:00:18.936349 2976 http.cpp:517] Processing call
> KILL_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.936545 2974 containerizer.cpp:2116] Destroying
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 in
> RUNNING state
> 07:00:18 I0207 07:00:18.936640 2975 linux_launcher.cpp:505] Asked to destroy
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.937069 2975 linux_launcher.cpp:548] Using freezer to
> destroy cgroup
> mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.937824 2971 cgroups.cpp:2726] Freezing cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.938868 2977 cgroups.cpp:1439] Successfully froze
> cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338
> after 1.015808ms
> 07:00:18 I0207 07:00:18.939909 2975 cgroups.cpp:2744] Thawing cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.940995 2977 cgroups.cpp:1468] Successfully thawed
> cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338
> after 1.072128ms
> 07:00:19 I0207 07:00:18.975450 2973 containerizer.cpp:2479] Container
> 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 has
> exited
> 07:00:19 I0207 07:00:18.976356 2973 provisioner.cpp:484] Ignoring destroy
> request for unknown container
> 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:19 I0207 07:00:18.976426 2973 containerizer.cpp:2395] Checkpointing
> termination state to nested container's runtime directory
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/966d71b2-cbc7-40a6-accf-bef80d3d8338/termination'
> 07:00:19 I0207 07:00:18.977567 29023 default_executor.cpp:673] Child
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 of
> task '16b247b5-e1dd-4395-a2d7-71c9c393e5bb' in state TASK_KILLED terminated
> with status terminated with signal Killed
> 07:00:19 I0207 07:00:18.977624 29023 default_executor.cpp:708] Killing task
> group containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb,
> c24a618d-ce08-4784-b8c7-0eeda79d121b ]
> 07:00:19 I0207 07:00:18.977648 29023 default_executor.cpp:813] Killing child
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:19 I0207 07:00:18.977864 2973 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:19 I0207 07:00:18.978206 2977 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:19 I0207 07:00:18.978425 2977 http.cpp:303] HTTP POST for
> /slave(716)/api/v1 from 10.153.254.29:44416
> 07:00:19 I0207 07:00:18.978505 2977 http.cpp:517] Processing call
> KILL_NESTED_CONTAINER
> 07:00:19 I0207 07:00:18.978755 2972 containerizer.cpp:2116] Destroying
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e in
> RUNNING state
> 07:00:19 I0207 07:00:18.978834 2972 linux_launcher.cpp:505] Asked to destroy
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:19 I0207 07:00:18.979177 2972 linux_launcher.cpp:548] Using freezer to
> destroy cgroup
> mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:19 I0207 07:00:18.979863 2974 cgroups.cpp:2726] Freezing cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:19 I0207 07:00:18.980865 2973 cgroups.cpp:1439] Successfully froze
> cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e
> after 969984ns
> 07:00:19 I0207 07:00:18.981984 2971 cgroups.cpp:2744] Thawing cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:19 I0207 07:00:18.982986 2971 cgroups.cpp:1468] Successfully thawed
> cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e
> after 984832ns
> 07:00:19 I0207 07:00:19.017686 2977 http.cpp:303] HTTP POST for
> /slave(716)/api/v1/executor from 10.153.254.29:44402
> 07:00:19 I0207 07:00:19.017765 2977 slave.cpp:3771] Handling status update
> TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.018388 2977 status_update_manager.cpp:323] Received
> status update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for
> task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.018442 2977 status_update_manager.cpp:377]
> Forwarding update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84)
> for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent
> 07:00:19 I0207 07:00:19.018528 2976 slave.cpp:4211] Forwarding the update
> TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 to [email protected]:38570
> 07:00:19 I0207 07:00:19.018610 2976 slave.cpp:4105] Status update manager
> successfully handled status update TASK_KILLED (UUID:
> 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.018651 2977 master.cpp:6094] Status update
> TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:19 I0207 07:00:19.018682 2977 master.cpp:6162] Forwarding status
> update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.018759 2977 master.cpp:8242] Updating the state of
> task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status
> update state: TASK_KILLED)
> 07:00:19 I0207 07:00:19.018950 2974 hierarchical.cpp:1079] Recovered
> cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32
> (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000],
> allocated: cpus(*)(allocated: *):0.3; mem(*)(allocated: *):96;
> disk(*)(allocated: *):96) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0
> from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.019011 29022 default_executor.cpp:153] Received
> ACKNOWLEDGED event
> 07:00:19 I0207 07:00:19.019037 2973 scheduler.cpp:676] Enqueuing event
> UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:19 I0207 07:00:19.076431 2977 containerizer.cpp:2479] Container
> 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e has
> exited
> 07:00:19 I0207 07:00:19.077306 2974 provisioner.cpp:484] Ignoring destroy
> request for unknown container
> 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:19 I0207 07:00:19.077369 2974 containerizer.cpp:2395] Checkpointing
> termination state to nested container's runtime directory
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/486b0abc-966d-49b7-b2e0-58cd1d4b462e/termination'
> 07:00:19 I0207 07:00:19.077934 29025 default_executor.cpp:673] Child
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e of
> task 'c24a618d-ce08-4784-b8c7-0eeda79d121b' in state TASK_KILLED terminated
> with status terminated with signal Killed
> 07:00:19 I0207 07:00:19.078296 2974 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:19 I0207 07:00:19.117736 2970 http.cpp:303] HTTP POST for
> /slave(716)/api/v1/executor from 10.153.254.29:44402
> 07:00:19 I0207 07:00:19.117791 2970 slave.cpp:3771] Handling status update
> TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task
> c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.118321 2977 status_update_manager.cpp:323] Received
> status update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for
> task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.118379 2977 status_update_manager.cpp:377]
> Forwarding update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9)
> for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent
> 07:00:19 I0207 07:00:19.118453 2971 slave.cpp:4211] Forwarding the update
> TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task
> c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 to [email protected]:38570
> 07:00:19 I0207 07:00:19.118526 2971 slave.cpp:4105] Status update manager
> successfully handled status update TASK_KILLED (UUID:
> 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task
> c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.118571 2970 master.cpp:6094] Status update
> TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task
> c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:19 I0207 07:00:19.118604 2970 master.cpp:6162] Forwarding status
> update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task
> c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.118687 2970 master.cpp:8242] Updating the state of
> task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status
> update state: TASK_KILLED)
> 07:00:19 I0207 07:00:19.118865 2976 hierarchical.cpp:1079] Recovered
> cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32
> (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000],
> allocated: cpus(*)(allocated: *):0.2; mem(*)(allocated: *):64;
> disk(*)(allocated: *):64) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0
> from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.118947 29019 default_executor.cpp:153] Received
> ACKNOWLEDGED event
> 07:00:19 I0207 07:00:19.118973 2973 scheduler.cpp:676] Enqueuing event
> UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:19 I0207 07:00:19.119366 2977 scheduler.cpp:243] Sending KILL call to
> http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:19 I0207 07:00:19.119678 2972 process.cpp:3704] Handling HTTP event
> for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:19 I0207 07:00:19.157742 2970 http.cpp:420] HTTP POST for
> /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:19 I0207 07:00:19.157784 2970 master.cpp:4851] Processing KILL call
> for task '8cd47a02-ff21-4585-ab72-0ce803a4be78' of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:19 I0207 07:00:19.157804 2970 master.cpp:4924] Telling agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal) to kill task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:19 I0207 07:00:19.157855 2976 slave.cpp:2383] Asked to kill task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.158260 29024 default_executor.cpp:153] Received KILL
> event
> 07:00:19 I0207 07:00:19.158283 29024 default_executor.cpp:841] Received kill
> for task '8cd47a02-ff21-4585-ab72-0ce803a4be78'
> 07:00:19 I0207 07:00:19.158294 29024 default_executor.cpp:813] Killing child
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:19 I0207 07:00:19.158717 2974 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:19 I0207 07:00:19.158946 2972 http.cpp:303] HTTP POST for
> /slave(716)/api/v1 from 10.153.254.29:44418
> 07:00:19 I0207 07:00:19.159024 2972 http.cpp:517] Processing call
> KILL_NESTED_CONTAINER
> 07:00:19 I0207 07:00:19.159195 2976 containerizer.cpp:2116] Destroying
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 in
> RUNNING state
> 07:00:19 I0207 07:00:19.159293 2972 linux_launcher.cpp:505] Asked to destroy
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:19 I0207 07:00:19.159647 2972 linux_launcher.cpp:548] Using freezer to
> destroy cgroup
> mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:19 I0207 07:00:19.160347 2973 cgroups.cpp:2726] Freezing cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:19 I0207 07:00:19.161346 2973 cgroups.cpp:1439] Successfully froze
> cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> after 974080ns
> 07:00:19 I0207 07:00:19.162377 2972 cgroups.cpp:2744] Thawing cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:19 I0207 07:00:19.163326 2975 cgroups.cpp:1468] Successfully thawed
> cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> after 929792ns
> 07:00:19 I0207 07:00:19.177110 2975 containerizer.cpp:2479] Container
> 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 has
> exited
> 07:00:19 I0207 07:00:19.178030 2970 provisioner.cpp:484] Ignoring destroy
> request for unknown container
> 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:19 I0207 07:00:19.178082 2970 containerizer.cpp:2395] Checkpointing
> termination state to nested container's runtime directory
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/5e04c992-3a62-4187-86b2-2ad4abb2f5e8/termination'
> 07:00:19 I0207 07:00:19.178556 29020 default_executor.cpp:673] Child
> container
> 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 of
> task '8cd47a02-ff21-4585-ab72-0ce803a4be78' in state TASK_KILLED terminated
> with status terminated with signal Killed
> 07:00:19 I0207 07:00:19.178586 29020 default_executor.cpp:797] Terminating
> after 1secs
> 07:00:19 I0207 07:00:19.181659 2975 process.cpp:3704] Handling HTTP event
> for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:19 I0207 07:00:19.221710 2972 http.cpp:303] HTTP POST for
> /slave(716)/api/v1/executor from 10.153.254.29:44402
> 07:00:19 I0207 07:00:19.221762 2972 slave.cpp:3771] Handling status update
> TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.222328 2974 status_update_manager.cpp:323] Received
> status update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for
> task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.222389 2974 status_update_manager.cpp:377]
> Forwarding update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732)
> for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent
> 07:00:19 I0207 07:00:19.222486 2977 slave.cpp:4211] Forwarding the update
> TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 to [email protected]:38570
> 07:00:19 I0207 07:00:19.222591 2977 slave.cpp:4105] Status update manager
> successfully handled status update TASK_KILLED (UUID:
> c62e4ad7-468a-4934-9b77-815d878de732) for task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.222607 2971 master.cpp:6094] Status update
> TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:19 I0207 07:00:19.222627 2971 master.cpp:6162] Forwarding status
> update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.222712 2971 master.cpp:8242] Updating the state of
> task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status
> update state: TASK_KILLED)
> 07:00:19 I0207 07:00:19.222867 2975 hierarchical.cpp:1079] Recovered
> cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32
> (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000],
> allocated: cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32;
> disk(*)(allocated: *):32) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0
> from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.223067 2970 scheduler.cpp:676] Enqueuing event
> UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:19 I0207 07:00:19.779280 2973 hierarchical.cpp:1907] No inverse offers
> to send out!
> 07:00:19 I0207 07:00:19.779335 2973 hierarchical.cpp:1401] Performed
> allocation for 1 agents in 276292ns
> 07:00:19 I0207 07:00:19.779414 2971 master.cpp:6932] Sending 1 offers to
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:19 I0207 07:00:19.780038 2973 scheduler.cpp:676] Enqueuing event
> OFFERS received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:20 I0207 07:00:20.178755 29020 default_executor.cpp:708] Killing task
> group containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ]
> 07:00:20 I0207 07:00:20.284885 2970 containerizer.cpp:2479] Container
> 4cfc866d-9fef-442b-8682-58dabb305974 has exited
> 07:00:20 I0207 07:00:20.284914 2970 containerizer.cpp:2116] Destroying
> container 4cfc866d-9fef-442b-8682-58dabb305974 in RUNNING state
> 07:00:20 I0207 07:00:20.285010 2975 linux_launcher.cpp:505] Asked to destroy
> container 4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:20 I0207 07:00:20.285462 2975 linux_launcher.cpp:548] Using freezer to
> destroy cgroup mesos/4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:20 I0207 07:00:20.286226 2977 cgroups.cpp:2726] Freezing cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos
> 07:00:20 I0207 07:00:20.286248 2974 cgroups.cpp:2726] Freezing cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:20 I0207 07:00:20.288529 2975 cgroups.cpp:1439] Successfully froze
> cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos after
> 2.279168ms
> 07:00:20 I0207 07:00:20.288636 2970 cgroups.cpp:1439] Successfully froze
> cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974
> after 2.370048ms
> 07:00:20 I0207 07:00:20.289970 2973 cgroups.cpp:2744] Thawing cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos
> 07:00:20 I0207 07:00:20.290127 2975 cgroups.cpp:2744] Thawing cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:20 I0207 07:00:20.291142 2973 cgroups.cpp:1468] Successfully thawed
> cgroup
> /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos after
> 1.154048ms
> 07:00:20 I0207 07:00:20.291566 2970 cgroups.cpp:1468] Successfully thawed
> cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974
> after 1.420032ms
> 07:00:20 I0207 07:00:20.292809 2970 provisioner.cpp:484] Ignoring destroy
> request for unknown container 4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:20 I0207 07:00:20.293262 2970 slave.cpp:4706] Executor 'default' of
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 exited with status 0
> 07:00:20 I0207 07:00:20.293408 2970 master.cpp:6224] Executor 'default' of
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal): exited with status 0
> 07:00:20 I0207 07:00:20.293469 2970 master.cpp:8365] Removing executor
> 'default' with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32;
> disk(*)(allocated: *):32 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:20 I0207 07:00:20.293663 2971 hierarchical.cpp:1079] Recovered
> cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32
> (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000],
> allocated: cpus(*)(allocated: *):1.9; mem(*)(allocated: *):992;
> disk(*)(allocated: *):992; ports(*)(allocated: *):[31000-32000]) on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.293929 2970 scheduler.cpp:676] Enqueuing event
> FAILURE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:20 I0207 07:00:20.294646 2973 master.cpp:1380] Framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) disconnected
> 07:00:20 I0207 07:00:20.294739 2973 master.cpp:3080] Deactivating framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:20 W0207 07:00:20.294898 2973 master.hpp:2262] Unable to send event to
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default): connection
> closed
> 07:00:20 I0207 07:00:20.294934 2973 master.cpp:3057] Disconnecting framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:20 I0207 07:00:20.294951 2973 master.cpp:1395] Giving framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 0ns to failover
> 07:00:20 I0207 07:00:20.295022 2974 hierarchical.cpp:415] Deactivated
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.295150 2974 hierarchical.cpp:1079] Recovered
> cpus(*)(allocated: *):1.9; mem(*)(allocated: *):992; disk(*)(allocated:
> *):992; ports(*)(allocated: *):[31000-32000] (total: cpus(*):2; mem(*):1024;
> disk(*):1024; ports(*):[31000-32000], allocated: {}) on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296192 2972 master.cpp:6772] Framework failover
> timeout, removing framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> (default)
> 07:00:20 I0207 07:00:20.296218 2972 master.cpp:7657] Removing framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:20 I0207 07:00:20.296278 2972 master.cpp:8242] Updating the state of
> task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status
> update state: TASK_KILLED)
> 07:00:20 I0207 07:00:20.296283 2974 slave.cpp:2613] Asked to shut down
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 by
> [email protected]:38570
> 07:00:20 I0207 07:00:20.296320 2974 slave.cpp:2638] Shutting down framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296336 2974 slave.cpp:4806] Cleaning up executor
> 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (via HTTP)
> 07:00:20 I0207 07:00:20.296311 2972 master.cpp:8336] Removing task
> c24a618d-ce08-4784-b8c7-0eeda79d121b with resources cpus(*)(allocated:
> *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:20 I0207 07:00:20.296442 2972 master.cpp:8242] Updating the state of
> task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status
> update state: TASK_KILLED)
> 07:00:20 I0207 07:00:20.296480 2971 gc.cpp:55] Scheduling
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974'
> for gc 6.99999659133037days in the future
> 07:00:20 I0207 07:00:20.296504 2974 slave.cpp:4894] Cleaning up framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296465 2972 master.cpp:8336] Removing task
> 8cd47a02-ff21-4585-ab72-0ce803a4be78 with resources cpus(*)(allocated:
> *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:20 I0207 07:00:20.296556 2971 gc.cpp:55] Scheduling
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default'
> for gc 6.99999659133037days in the future
> 07:00:20 I0207 07:00:20.296576 2972 master.cpp:8242] Updating the state of
> task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status
> update state: TASK_KILLED)
> 07:00:20 I0207 07:00:20.296604 2975 status_update_manager.cpp:285] Closing
> status update streams for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296593 2972 master.cpp:8336] Removing task
> 16b247b5-e1dd-4395-a2d7-71c9c393e5bb with resources cpus(*)(allocated:
> *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 of framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:20 I0207 07:00:20.296638 2971 gc.cpp:55] Scheduling
> '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000'
> for gc 6.99999659133037days in the future
> 07:00:20 I0207 07:00:20.296641 2975 status_update_manager.cpp:531] Cleaning
> up status update stream for task c24a618d-ce08-4784-b8c7-0eeda79d121b of
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296808 2976 hierarchical.cpp:362] Removed framework
> fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296821 2975 status_update_manager.cpp:531] Cleaning
> up status update stream for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296928 2975 status_update_manager.cpp:531] Cleaning
> up status update stream for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of
> framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 W0207 07:00:20.297485 2976 containerizer.cpp:2104] Attempted to
> destroy unknown container 4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:20 ../../src/tests/cluster.cpp:576: Failure
> 07:00:20 Value of: containers.get().empty()
> 07:00:20 Actual: false
> 07:00:20 Expected: true
> 07:00:20 Failed to destroy containers: { 4cfc866d-9fef-442b-8682-58dabb305974
> }
> 07:00:20 I0207 07:00:20.297739 2977 slave.cpp:803] Agent terminating
> 07:00:20 I0207 07:00:20.297816 2973 master.cpp:1263] Agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal) disconnected
> 07:00:20 I0207 07:00:20.297837 2973 master.cpp:3117] Disconnecting agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:20 I0207 07:00:20.297860 2973 master.cpp:3136] Deactivating agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570
> (ip-10-153-254-29.ec2.internal)
> 07:00:20 I0207 07:00:20.297920 2977 hierarchical.cpp:617] Agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0 deactivated
> 07:00:20 I0207 07:00:20.300276 2952 master.cpp:1102] Master terminating
> 07:00:20 I0207 07:00:20.300390 2971 hierarchical.cpp:548] Removed agent
> fa1554c4-572a-4b89-8994-a89460f588d3-S0
> 07:00:20 [ FAILED ]
> ROOT_DOCKER_DockerAndMesosContainerizers/DefaultExecutorTest.KillTask/0,
> where GetParam() = "docker,mesos" (2527 ms)
> {noformat}
> Note that the other parameterized test
> {{MesosContainerizer/DefaultExecutorTest.KillTask/0}} passes successfully
> though.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
