Jan Schlicht created MESOS-9044:
-----------------------------------
Summary: DefaultExecutorTest.ROOT_ContainerStatusForTask can
segfault
Key: MESOS-9044
URL: https://issues.apache.org/jira/browse/MESOS-9044
Project: Mesos
Issue Type: Bug
Components: test
Affects Versions: 1.5.1
Environment: Ubuntu 16.04
Reporter: Jan Schlicht
The following segfault occured when testing the {{1.5.x}} branch (SHA
{{64341865d}}) on Ubuntu 16.04:
{noformat}
[ RUN ]
MesosContainerizer/DefaultExecutorTest.ROOT_ContainerStatusForTask/0
I0702 08:32:25.241318 17172 cluster.cpp:172] Creating default 'local' authorizer
I0702 08:32:25.242328 6510 master.cpp:457] Master
be25b90e-f63d-4935-aaf3-cacfc7faacbf (ip-172-16-10-86.ec2.internal) started on
172.16.10.86:32891
I0702 08:32:25.242413 6510 master.cpp:459] Flags at startup: --acls=""
--agent_ping_timeout="15secs" --agent_reregister_timeout="10mins"
--allocation_interval="1secs" --allocator="hierarchical"
--authenticate_agents="true" --authenticate_frameworks="true"
--authenticate_http_frameworks="true" --authenticate_http_readonly="true"
--authenticate_http_readwrite="true" --authenticators="crammd5"
--authorizers="local" --credentials="/tmp/I9TI6h/credentials"
--filter_gpu_resources="true" --framework_sorter="drf" --help="false"
--hostname_lookup="true" --http_authenticators="basic"
--http_framework_authenticators="basic" --initialize_driver_logging="true"
--log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO"
--max_agent_ping_timeouts="5" --max_completed_frameworks="50"
--max_completed_tasks_per_framework="1000"
--max_unreachable_tasks_per_framework="1000" --port="5050" --quiet="false"
--recovery_agent_removal_limit="100%" --registry="in_memory"
--registry_fetch_timeout="1mins" --registry_gc_interval="15mins"
--registry_max_agent_age="2weeks" --registry_max_agent_count="102400"
--registry_store_timeout="100secs" --registry_strict="false"
--require_agent_domain="false" --role_sorter="drf" --root_submissions="true"
--version="false" --webui_dir="/usr/local/share/mesos/webui"
--work_dir="/tmp/I9TI6h/master" --zk_session_timeout="10secs"
I0702 08:32:25.242554 6510 master.cpp:508] Master only allowing authenticated
frameworks to register
I0702 08:32:25.242564 6510 master.cpp:514] Master only allowing authenticated
agents to register
I0702 08:32:25.242570 6510 master.cpp:520] Master only allowing authenticated
HTTP frameworks to register
I0702 08:32:25.242575 6510 credentials.hpp:37] Loading credentials for
authentication from '/tmp/I9TI6h/credentials'
I0702 08:32:25.242677 6510 master.cpp:564] Using default 'crammd5'
authenticator
I0702 08:32:25.242728 6510 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-master-readonly'
I0702 08:32:25.242780 6510 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-master-readwrite'
I0702 08:32:25.242830 6510 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-master-scheduler'
I0702 08:32:25.242864 6510 master.cpp:643] Authorization enabled
I0702 08:32:25.243048 6507 hierarchical.cpp:175] Initialized hierarchical
allocator process
I0702 08:32:25.243223 6507 whitelist_watcher.cpp:77] No whitelist given
I0702 08:32:25.243743 6510 master.cpp:2210] Elected as the leading master!
I0702 08:32:25.243768 6510 master.cpp:1690] Recovering from registrar
I0702 08:32:25.243832 6511 registrar.cpp:347] Recovering registrar
I0702 08:32:25.244055 6511 registrar.cpp:391] Successfully fetched the
registry (0B) in 124928ns
I0702 08:32:25.244096 6511 registrar.cpp:495] Applied 1 operations in 8690ns;
attempting to update the registry
I0702 08:32:25.244261 6511 registrar.cpp:552] Successfully updated the
registry in 146944ns
I0702 08:32:25.244302 6511 registrar.cpp:424] Successfully recovered registrar
I0702 08:32:25.244416 6511 master.cpp:1803] Recovered 0 agents from the
registry (172B); allowing 10mins for agents to re-register
I0702 08:32:25.244556 6505 hierarchical.cpp:213] Skipping recovery of
hierarchical allocator: nothing to recover
W0702 08:32:25.246150 17172 process.cpp:2759] Attempted to spawn already
running process [email protected]:32891
I0702 08:32:25.246560 17172 containerizer.cpp:304] Using isolation {
environment_secret, posix/cpu, posix/mem, filesystem/posix, network/cni }
I0702 08:32:25.250222 17172 linux_launcher.cpp:146] Using
/sys/fs/cgroup/freezer as the freezer hierarchy for the Linux launcher
I0702 08:32:25.250689 17172 provisioner.cpp:299] Using default backend 'overlay'
I0702 08:32:25.251200 17172 cluster.cpp:460] Creating default 'local' authorizer
I0702 08:32:25.251788 6509 slave.cpp:262] Mesos agent started on
(996)@172.16.10.86:32891
I0702 08:32:25.251878 6509 slave.cpp:263] Flags at startup: --acls=""
--appc_simple_discovery_uri_prefix="http://";
--appc_store_dir="/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/store/appc"
--authenticate_http_executors="true" --authenticate_http_readonly="true"
--authenticate_http_readwrite="true" --authenticatee="crammd5"
--authentication_backoff_factor="1secs" --authorizer="local"
--cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false"
--cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false"
--cgroups_root="mesos" --container_disk_watch_interval="15secs"
--containerizers="mesos"
--credential="/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/credential"
--default_role="*" --disallow_sharing_agent_pid_namespace="false"
--disk_watch_interval="1mins" --docker="docker" --docker_kill_orphans="true"
--docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs"
--docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns"
--docker_store_dir="/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/store/docker"
--docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume"
--enforce_container_disk_quota="false" --executor_registration_timeout="1mins"
--executor_reregistration_timeout="2secs"
--executor_shutdown_grace_period="5secs"
--fetcher_cache_dir="/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/fetch"
--fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
--gc_disk_headroom="0.1" --hadoop_home="" --help="false"
--hostname_lookup="true" --http_command_executor="false"
--http_credentials="/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/http_credentials"
--http_heartbeat_interval="30secs" --initialize_driver_logging="true"
--isolation="posix/cpu,posix/mem"
--jwt_secret_key="/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/jwt_secret_key"
--launcher="linux"
--launcher_dir="/home/ubuntu/workspace/mesos/Mesos_CI-build/FLAG/SSL_GRPC/label/mesos-ec2-ubuntu-16.04/mesos/build/src"
--logbufsecs="0" --logging_level="INFO"
--max_completed_executors_per_framework="150"
--oversubscribed_resources_interval="15secs" --perf_duration="10secs"
--perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns"
--quiet="false" --reconfiguration_policy="equal" --recover="reconnect"
--recovery_timeout="15mins" --registration_backoff_factor="10ms"
--resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]"
--revocable_cpu_low_priority="true"
--runtime_dir="/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo"
--sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true"
--systemd_enable_support="true"
--systemd_runtime_directory="/run/systemd/system" --version="false"
--work_dir="/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ"
--zk_session_timeout="10secs"
I0702 08:32:25.252202 6509 credentials.hpp:86] Loading credential for
authentication from
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/credential'
I0702 08:32:25.252372 6509 slave.cpp:295] Agent using credential for:
test-principal
I0702 08:32:25.252455 6509 credentials.hpp:37] Loading credentials for
authentication from
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/http_credentials'
I0702 08:32:25.252651 17172 scheduler.cpp:188] Version: 1.5.1
I0702 08:32:25.252775 6509 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-agent-executor'
I0702 08:32:25.252923 6509 http.cpp:1066] Creating default 'jwt' HTTP
authenticator for realm 'mesos-agent-executor'
I0702 08:32:25.253057 6509 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-agent-readonly'
I0702 08:32:25.253095 6509 http.cpp:1066] Creating default 'jwt' HTTP
authenticator for realm 'mesos-agent-readonly'
I0702 08:32:25.253182 6509 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-agent-readwrite'
I0702 08:32:25.253212 6510 scheduler.cpp:311] Using default 'basic' HTTP
authenticatee
I0702 08:32:25.253321 6510 scheduler.cpp:494] New master detected at
[email protected]:32891
I0702 08:32:25.253345 6510 scheduler.cpp:503] Waiting for 0ns before
initiating a re-(connection) attempt with the master
I0702 08:32:25.253473 6509 http.cpp:1066] Creating default 'jwt' HTTP
authenticator for realm 'mesos-agent-readwrite'
I0702 08:32:25.253927 6507 scheduler.cpp:385] Connected with the master at
http://172.16.10.86:32891/master/api/v1/scheduler
I0702 08:32:25.254003 6509 disk_profile.cpp:80] Creating default disk profile
adaptor module
I0702 08:32:25.254273 6506 scheduler.cpp:247] Sending SUBSCRIBE call to
http://172.16.10.86:32891/master/api/v1/scheduler
I0702 08:32:25.254709 6511 process.cpp:3518] Handling HTTP event for process
'master' with path: '/master/api/v1/scheduler'
I0702 08:32:25.255129 6511 http.cpp:1185] HTTP POST for
/master/api/v1/scheduler from 172.16.10.86:48290
I0702 08:32:25.255288 6511 master.cpp:2617] Received subscription request for
HTTP framework 'default'
I0702 08:32:25.255388 6511 master.cpp:2282] Authorizing framework principal
'test-principal' to receive offers for roles '{ * }'
I0702 08:32:25.255667 6509 slave.cpp:612] Agent resources:
[{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
I0702 08:32:25.255780 6509 slave.cpp:620] Agent attributes: [ ]
I0702 08:32:25.255794 6509 slave.cpp:629] Agent hostname:
ip-172-16-10-86.ec2.internal
I0702 08:32:25.256001 6508 task_status_update_manager.cpp:181] Pausing sending
task status updates
I0702 08:32:25.256093 6511 master.cpp:2752] Subscribing framework 'default'
with checkpointing disabled and capabilities [ MULTI_ROLE,
RESERVATION_REFINEMENT ]
I0702 08:32:25.256207 6511 master.cpp:9261] Adding framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (default) with roles { } suppressed
I0702 08:32:25.256449 6510 hierarchical.cpp:297] Added framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.256582 6510 hierarchical.cpp:1517] Performed allocation for 0
agents in 81939ns
I0702 08:32:25.256822 6505 scheduler.cpp:739] Enqueuing event SUBSCRIBED
received from http://172.16.10.86:32891/master/api/v1/scheduler
I0702 08:32:25.257344 6505 state.cpp:66] Recovering state from
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/meta'
I0702 08:32:25.257441 6505 task_status_update_manager.cpp:207] Recovering task
status update manager
I0702 08:32:25.257499 6505 containerizer.cpp:674] Recovering containerizer
I0702 08:32:25.258203 6511 scheduler.cpp:739] Enqueuing event HEARTBEAT
received from http://172.16.10.86:32891/master/api/v1/scheduler
I0702 08:32:25.258296 6505 provisioner.cpp:495] Provisioner recovery complete
I0702 08:32:25.258483 6510 slave.cpp:7327] Finished recovery
I0702 08:32:25.258927 6507 task_status_update_manager.cpp:181] Pausing sending
task status updates
I0702 08:32:25.265064 6510 slave.cpp:1263] New master detected at
[email protected]:32891
I0702 08:32:25.265107 6510 slave.cpp:1318] Detecting new master
I0702 08:32:25.271335 6509 slave.cpp:1345] Authenticating with master
[email protected]:32891
I0702 08:32:25.271366 6509 slave.cpp:1354] Using default CRAM-MD5 authenticatee
I0702 08:32:25.271522 6508 authenticatee.cpp:121] Creating new client SASL
connection
I0702 08:32:25.271905 6508 master.cpp:9040] Authenticating
slave(996)@172.16.10.86:32891
I0702 08:32:25.272017 6508 authenticator.cpp:414] Starting authentication
session for crammd5-authenticatee(1747)@172.16.10.86:32891
I0702 08:32:25.272105 6507 authenticator.cpp:98] Creating new server SASL
connection
I0702 08:32:25.272487 6507 authenticatee.cpp:213] Received SASL authentication
mechanisms: CRAM-MD5
I0702 08:32:25.272511 6507 authenticatee.cpp:239] Attempting to authenticate
with mechanism 'CRAM-MD5'
I0702 08:32:25.272629 6507 authenticator.cpp:204] Received SASL authentication
start
I0702 08:32:25.272728 6507 authenticator.cpp:326] Authentication requires more
steps
I0702 08:32:25.272828 6507 authenticatee.cpp:259] Received SASL authentication
step
I0702 08:32:25.272934 6507 authenticator.cpp:232] Received SASL authentication
step
I0702 08:32:25.272959 6507 auxprop.cpp:109] Request to lookup properties for
user: 'test-principal' realm: 'ip-172-16-10-86.ec2.internal' server FQDN:
'ip-172-16-10-86.ec2.internal' SASL_AUXPROP_VERIFY_AGAINST_HASH: false
SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false
I0702 08:32:25.272969 6507 auxprop.cpp:181] Looking up auxiliary property
'*userPassword'
I0702 08:32:25.273097 6507 auxprop.cpp:181] Looking up auxiliary property
'*cmusaslsecretCRAM-MD5'
I0702 08:32:25.273177 6507 auxprop.cpp:109] Request to lookup properties for
user: 'test-principal' realm: 'ip-172-16-10-86.ec2.internal' server FQDN:
'ip-172-16-10-86.ec2.internal' SASL_AUXPROP_VERIFY_AGAINST_HASH: false
SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true
I0702 08:32:25.273206 6507 auxprop.cpp:131] Skipping auxiliary property
'*userPassword' since SASL_AUXPROP_AUTHZID == true
I0702 08:32:25.273216 6507 auxprop.cpp:131] Skipping auxiliary property
'*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
I0702 08:32:25.273360 6507 authenticator.cpp:318] Authentication success
I0702 08:32:25.273432 6510 authenticatee.cpp:299] Authentication success
I0702 08:32:25.273572 6508 master.cpp:9070] Successfully authenticated
principal 'test-principal' at slave(996)@172.16.10.86:32891
I0702 08:32:25.273589 6510 authenticator.cpp:432] Authentication session
cleanup for crammd5-authenticatee(1747)@172.16.10.86:32891
I0702 08:32:25.273784 6511 slave.cpp:1437] Successfully authenticated with
master [email protected]:32891
I0702 08:32:25.273898 6511 slave.cpp:1881] Will retry registration in
12.278859ms if necessary
I0702 08:32:25.274022 6512 master.cpp:6112] Received register agent message
from slave(996)@172.16.10.86:32891 (ip-172-16-10-86.ec2.internal)
I0702 08:32:25.274137 6512 master.cpp:3874] Authorizing agent with principal
'test-principal'
I0702 08:32:25.274278 6512 master.cpp:6174] Authorized registration of agent
at slave(996)@172.16.10.86:32891 (ip-172-16-10-86.ec2.internal)
I0702 08:32:25.274317 6512 master.cpp:6285] Registering agent at
slave(996)@172.16.10.86:32891 (ip-172-16-10-86.ec2.internal) with id
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0
I0702 08:32:25.274557 6506 registrar.cpp:495] Applied 1 operations in 34050ns;
attempting to update the registry
I0702 08:32:25.274693 6511 registrar.cpp:552] Successfully updated the
registry in 107008ns
I0702 08:32:25.274740 6511 master.cpp:6333] Admitted agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal)
I0702 08:32:25.274900 6511 master.cpp:6382] Registered agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal) with cpus:2; mem:1024; disk:1024;
ports:[31000-32000]
I0702 08:32:25.274967 6511 slave.cpp:1483] Registered with master
[email protected]:32891; given agent ID
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0
I0702 08:32:25.275122 6511 slave.cpp:1503] Checkpointing SlaveInfo to
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/meta/slaves/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0/slave.info'
I0702 08:32:25.275251 6508 hierarchical.cpp:574] Added agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 (ip-172-16-10-86.ec2.internal) with
cpus:2; mem:1024; disk:1024; ports:[31000-32000] (allocated: {})
I0702 08:32:25.275348 6511 slave.cpp:1550] Forwarding agent update
{"operations":{},"resource_version_uuid":{"value":"uGs6OI8gQfCOa6B0bMKH+g=="},"slave_id":{"value":"be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0"},"update_oversubscribed_resources":true}
I0702 08:32:25.275385 6510 task_status_update_manager.cpp:188] Resuming
sending task status updates
I0702 08:32:25.275591 6511 master.cpp:7316] Received update of agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal) with total oversubscribed resources {}
I0702 08:32:25.275652 6511 master.cpp:7410] Ignoring update on agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal) as it reports no changes
I0702 08:32:25.275887 6508 hierarchical.cpp:1517] Performed allocation for 1
agents in 298572ns
I0702 08:32:25.276010 6509 master.cpp:8870] Sending 1 offers to framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (default)
I0702 08:32:25.276571 6507 scheduler.cpp:739] Enqueuing event OFFERS received
from http://172.16.10.86:32891/master/api/v1/scheduler
I0702 08:32:25.277117 6508 scheduler.cpp:247] Sending ACCEPT call to
http://172.16.10.86:32891/master/api/v1/scheduler
I0702 08:32:25.277568 6505 process.cpp:3518] Handling HTTP event for process
'master' with path: '/master/api/v1/scheduler'
I0702 08:32:25.277956 6511 http.cpp:1185] HTTP POST for
/master/api/v1/scheduler from 172.16.10.86:48288
I0702 08:32:25.278187 6511 master.cpp:10802] Removing offer
be25b90e-f63d-4935-aaf3-cacfc7faacbf-O0
I0702 08:32:25.278355 6511 master.cpp:4293] Processing ACCEPT call for offers:
[ be25b90e-f63d-4935-aaf3-cacfc7faacbf-O0 ] on agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal) for framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (default)
I0702 08:32:25.278465 6511 master.cpp:3601] Authorizing framework principal
'test-principal' to launch task 8c18b647-db11-40f8-9147-c41f5b3a1480
I0702 08:32:25.278600 6511 master.cpp:3601] Authorizing framework principal
'test-principal' to launch task 568501f7-b7ae-4b98-8b6d-a3123d22c8a1
I0702 08:32:25.279418 6511 master.cpp:11560] Adding task
8c18b647-db11-40f8-9147-c41f5b3a1480 with resources cpus(allocated: *):0.1;
mem(allocated: *):32; disk(allocated: *):32 on agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal)
I0702 08:32:25.279484 6511 master.cpp:11560] Adding task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 with resources cpus(allocated: *):0.1;
mem(allocated: *):32; disk(allocated: *):32 on agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal)
I0702 08:32:25.279654 6511 master.cpp:5260] Launching task group {
568501f7-b7ae-4b98-8b6d-a3123d22c8a1, 8c18b647-db11-40f8-9147-c41f5b3a1480 } of
framework be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (default) with resources
cpus(allocated: *):0.2; mem(allocated: *):64; disk(allocated: *):64 on agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal) on new executor
I0702 08:32:25.279923 6510 slave.cpp:2018] Got assigned task group containing
tasks [ 8c18b647-db11-40f8-9147-c41f5b3a1480,
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 ] for framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.279932 6508 hierarchical.cpp:1192] Recovered cpus(allocated:
*):1.7; mem(allocated: *):928; disk(allocated: *):928; ports(allocated:
*):[31000-32000] (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000],
allocated: cpus(allocated: *):0.3; mem(allocated: *):96; disk(allocated: *):96)
on agent be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 from framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.280064 6508 hierarchical.cpp:1238] Framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 filtered agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 for 5secs
I0702 08:32:25.280454 6510 slave.cpp:2392] Authorizing task group containing
tasks [ 8c18b647-db11-40f8-9147-c41f5b3a1480,
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 ] for framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.280491 6510 slave.cpp:8444] Authorizing framework principal
'test-principal' to launch task 8c18b647-db11-40f8-9147-c41f5b3a1480
I0702 08:32:25.280534 6510 slave.cpp:8444] Authorizing framework principal
'test-principal' to launch task 568501f7-b7ae-4b98-8b6d-a3123d22c8a1
I0702 08:32:25.281258 6511 slave.cpp:2866] Launching task group containing
tasks [ 8c18b647-db11-40f8-9147-c41f5b3a1480,
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 ] for framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.281486 6511 paths.cpp:756] Trying to chown
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/slaves/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0/frameworks/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000/executors/default/runs/57bca45b-28f5-4f80-817a-28c3b55f351e'
to user 'root'
I0702 08:32:25.281620 6511 slave.cpp:8935] Launching executor 'default' of
framework be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 with resources
[{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":32.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"disk","scalar":{"value":32.0},"type":"SCALAR"}]
in work directory
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/slaves/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0/frameworks/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000/executors/default/runs/57bca45b-28f5-4f80-817a-28c3b55f351e'
I0702 08:32:25.281905 6511 slave.cpp:3082] Queued task group containing tasks
[ 8c18b647-db11-40f8-9147-c41f5b3a1480, 568501f7-b7ae-4b98-8b6d-a3123d22c8a1 ]
for executor 'default' of framework be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.281960 6511 slave.cpp:997] Successfully attached
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/slaves/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0/frameworks/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000/executors/default/runs/57bca45b-28f5-4f80-817a-28c3b55f351e'
to virtual path
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/slaves/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0/frameworks/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000/executors/default/runs/latest'
I0702 08:32:25.281985 6511 slave.cpp:997] Successfully attached
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/slaves/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0/frameworks/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000/executors/default/runs/57bca45b-28f5-4f80-817a-28c3b55f351e'
to virtual path
'/frameworks/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000/executors/default/runs/latest'
I0702 08:32:25.282122 6511 slave.cpp:3562] Launching container
57bca45b-28f5-4f80-817a-28c3b55f351e for executor 'default' of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.282246 6511 slave.cpp:997] Successfully attached
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/slaves/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0/frameworks/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000/executors/default/runs/57bca45b-28f5-4f80-817a-28c3b55f351e'
to virtual path
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/slaves/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0/frameworks/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000/executors/default/runs/57bca45b-28f5-4f80-817a-28c3b55f351e'
I0702 08:32:25.282320 6511 containerizer.cpp:1209] Starting container
57bca45b-28f5-4f80-817a-28c3b55f351e
I0702 08:32:25.282642 6511 containerizer.cpp:1382] Checkpointed
ContainerConfig at
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/containers/57bca45b-28f5-4f80-817a-28c3b55f351e/config'
I0702 08:32:25.282663 6511 containerizer.cpp:2968] Transitioning the state of
container 57bca45b-28f5-4f80-817a-28c3b55f351e from PROVISIONING to PREPARING
I0702 08:32:25.283603 6510 containerizer.cpp:1858] Launching
'mesos-containerizer' with flags '--help="false"
--launch_info="{"command":{"arguments":["mesos-default-executor","--launcher_dir=\/home\/ubuntu\/workspace\/mesos\/Mesos_CI-build\/FLAG\/SSL_GRPC\/label\/mesos-ec2-ubuntu-16.04\/mesos\/build\/src"],"shell":false,"value":"\/home\/ubuntu\/workspace\/mesos\/Mesos_CI-build\/FLAG\/SSL_GRPC\/label\/mesos-ec2-ubuntu-16.04\/mesos\/build\/src\/mesos-default-executor"},"environment":{"variables":[{"name":"LIBPROCESS_PORT","type":"VALUE","value":"0"},{"name":"MESOS_AGENT_ENDPOINT","type":"VALUE","value":"172.16.10.86:32891"},{"name":"MESOS_CHECKPOINT","type":"VALUE","value":"0"},{"name":"MESOS_DIRECTORY","type":"VALUE","value":"\/tmp\/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ\/slaves\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0\/frameworks\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000\/executors\/default\/runs\/57bca45b-28f5-4f80-817a-28c3b55f351e"},{"name":"MESOS_EXECUTOR_AUTHENTICATION_TOKEN","type":"VALUE","value":"eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJjaWQiOiI1N2JjYTQ1Yi0yOGY1LTRmODAtODE3YS0yOGMzYjU1ZjM1MWUiLCJlaWQiOiJkZWZhdWx0IiwiZmlkIjoiYmUyNWI5MGUtZjYzZC00OTM1LWFhZjMtY2FjZmM3ZmFhY2JmLTAwMDAifQ.ru4_3thWa81slICU2jiMryQ7m-_z7-DJyBdToYHWDQM"},{"name":"MESOS_EXECUTOR_ID","type":"VALUE","value":"default"},{"name":"MESOS_EXECUTOR_SHUTDOWN_GRACE_PERIOD","type":"VALUE","value":"5secs"},{"name":"MESOS_FRAMEWORK_ID","type":"VALUE","value":"be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000"},{"name":"MESOS_HTTP_COMMAND_EXECUTOR","type":"VALUE","value":"0"},{"name":"MESOS_SLAVE_ID","type":"VALUE","value":"be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0"},{"name":"MESOS_SLAVE_PID","type":"VALUE","value":"slave(996)@172.16.10.86:32891"},{"name":"MESOS_SANDBOX","type":"VALUE","value":"\/tmp\/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ\/slaves\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0\/frameworks\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000\/executors\/default\/runs\/57bca45b-28f5-4f80-817a-28c3b55f351e"}]},"task_environment":{},"user":"root","working_directory":"\/tmp\/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ\/slaves\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0\/frameworks\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000\/executors\/default\/runs\/57bca45b-28f5-4f80-817a-28c3b55f351e"}"
--pipe_read="56" --pipe_write="57"
--runtime_directory="/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/containers/57bca45b-28f5-4f80-817a-28c3b55f351e"
--unshare_namespace_mnt="false"'
I0702 08:32:25.283911 6506 linux_launcher.cpp:438] Launching container
57bca45b-28f5-4f80-817a-28c3b55f351e and cloning with namespaces
I0702 08:32:25.309470 6510 containerizer.cpp:2968] Transitioning the state of
container 57bca45b-28f5-4f80-817a-28c3b55f351e from PREPARING to ISOLATING
I0702 08:32:25.309967 6510 containerizer.cpp:2968] Transitioning the state of
container 57bca45b-28f5-4f80-817a-28c3b55f351e from ISOLATING to FETCHING
I0702 08:32:25.310037 6510 fetcher.cpp:369] Starting to fetch URIs for
container: 57bca45b-28f5-4f80-817a-28c3b55f351e, directory:
/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/slaves/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0/frameworks/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000/executors/default/runs/57bca45b-28f5-4f80-817a-28c3b55f351e
I0702 08:32:25.310315 6510 containerizer.cpp:2968] Transitioning the state of
container 57bca45b-28f5-4f80-817a-28c3b55f351e from FETCHING to RUNNING
I0702 08:32:25.419296 22255 executor.cpp:192] Version: 1.5.1
I0702 08:32:25.421787 6505 process.cpp:3518] Handling HTTP event for process
'slave(996)' with path: '/slave(996)/api/v1/executor'
I0702 08:32:25.422585 6511 http.cpp:1185] HTTP POST for
/slave(996)/api/v1/executor from 172.16.10.86:48292
I0702 08:32:25.422677 6511 slave.cpp:4646] Received Subscribe request for HTTP
executor 'default' of framework be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.423382 6511 slave.cpp:3334] Sending queued task group task
group containing tasks [ 8c18b647-db11-40f8-9147-c41f5b3a1480,
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 ] to executor 'default' of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (via HTTP)
I0702 08:32:25.424185 22273 default_executor.cpp:193] Received SUBSCRIBED event
I0702 08:32:25.424561 22273 default_executor.cpp:197] Subscribed executor on
ip-172-16-10-86.ec2.internal
I0702 08:32:25.424742 22273 default_executor.cpp:193] Received LAUNCH_GROUP
event
I0702 08:32:25.425122 22276 default_executor.cpp:417] Setting
'MESOS_CONTAINER_IP' to: 172.16.10.86
I0702 08:32:25.426324 6509 process.cpp:3518] Handling HTTP event for process
'slave(996)' with path: '/slave(996)/api/v1/executor'
I0702 08:32:25.426432 6509 process.cpp:3518] Handling HTTP event for process
'slave(996)' with path: '/slave(996)/api/v1'
I0702 08:32:25.426668 6509 process.cpp:3518] Handling HTTP event for process
'slave(996)' with path: '/slave(996)/api/v1'
I0702 08:32:25.427170 6509 process.cpp:3518] Handling HTTP event for process
'slave(996)' with path: '/slave(996)/api/v1/executor'
I0702 08:32:25.427729 6509 http.cpp:1185] HTTP POST for /slave(996)/api/v1
from 172.16.10.86:48296
I0702 08:32:25.427788 6509 http.cpp:1185] HTTP POST for
/slave(996)/api/v1/executor from 172.16.10.86:48294
I0702 08:32:25.427837 6509 slave.cpp:5308] Handling status update
TASK_STARTING (Status UUID: 0ed178ec-63d1-4d77-943e-9bc1e24a6142) for task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.427915 6509 http.cpp:1185] HTTP POST for /slave(996)/api/v1
from 172.16.10.86:48296
I0702 08:32:25.427992 6509 http.cpp:2581] Processing LAUNCH_NESTED_CONTAINER
call for container
'57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7'
I0702 08:32:25.428056 6509 http.cpp:2581] Processing LAUNCH_NESTED_CONTAINER
call for container
'57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359'
I0702 08:32:25.428299 6509 http.cpp:1185] HTTP POST for
/slave(996)/api/v1/executor from 172.16.10.86:48294
I0702 08:32:25.428361 6509 slave.cpp:5308] Handling status update
TASK_STARTING (Status UUID: b44e0149-c156-404e-9b3d-9b3c590768cd) for task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.428622 6509 containerizer.cpp:1174] Trying to chown
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/slaves/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0/frameworks/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000/executors/default/runs/57bca45b-28f5-4f80-817a-28c3b55f351e/containers/de582f28-8ac5-404b-aefa-4b99d32c4ad7'
to user 'root'
I0702 08:32:25.428701 6509 containerizer.cpp:1209] Starting container
57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7
I0702 08:32:25.428995 6509 containerizer.cpp:1382] Checkpointed
ContainerConfig at
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/containers/57bca45b-28f5-4f80-817a-28c3b55f351e/containers/de582f28-8ac5-404b-aefa-4b99d32c4ad7/config'
I0702 08:32:25.429008 6509 containerizer.cpp:2968] Transitioning the state of
container
57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7 from
PROVISIONING to PREPARING
I0702 08:32:25.429260 6510 task_status_update_manager.cpp:328] Received task
status update TASK_STARTING (Status UUID: 0ed178ec-63d1-4d77-943e-9bc1e24a6142)
for task 8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.429365 6510 task_status_update_manager.cpp:507] Creating
StatusUpdate stream for task 8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.429590 6510 task_status_update_manager.cpp:383] Forwarding task
status update TASK_STARTING (Status UUID: 0ed178ec-63d1-4d77-943e-9bc1e24a6142)
for task 8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 to the agent
I0702 08:32:25.429716 6510 slave.cpp:5800] Forwarding the update TASK_STARTING
(Status UUID: 0ed178ec-63d1-4d77-943e-9bc1e24a6142) for task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 to [email protected]:32891
I0702 08:32:25.429791 6510 slave.cpp:5693] Task status update manager
successfully handled status update TASK_STARTING (Status UUID:
0ed178ec-63d1-4d77-943e-9bc1e24a6142) for task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.429863 6510 task_status_update_manager.cpp:328] Received task
status update TASK_STARTING (Status UUID: b44e0149-c156-404e-9b3d-9b3c590768cd)
for task 568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.429889 6510 task_status_update_manager.cpp:507] Creating
StatusUpdate stream for task 568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.430018 6510 task_status_update_manager.cpp:383] Forwarding task
status update TASK_STARTING (Status UUID: b44e0149-c156-404e-9b3d-9b3c590768cd)
for task 568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 to the agent
I0702 08:32:25.430142 6510 master.cpp:7962] Status update TASK_STARTING
(Status UUID: 0ed178ec-63d1-4d77-943e-9bc1e24a6142) for task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 from agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal)
I0702 08:32:25.430169 6510 master.cpp:8018] Forwarding status update
TASK_STARTING (Status UUID: 0ed178ec-63d1-4d77-943e-9bc1e24a6142) for task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.430280 6510 master.cpp:10285] Updating the state of task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (latest state: TASK_STARTING, status
update state: TASK_STARTING)
I0702 08:32:25.430418 6510 slave.cpp:5800] Forwarding the update TASK_STARTING
(Status UUID: b44e0149-c156-404e-9b3d-9b3c590768cd) for task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 to [email protected]:32891
I0702 08:32:25.430493 6510 slave.cpp:5693] Task status update manager
successfully handled status update TASK_STARTING (Status UUID:
b44e0149-c156-404e-9b3d-9b3c590768cd) for task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.430689 6510 master.cpp:7962] Status update TASK_STARTING
(Status UUID: b44e0149-c156-404e-9b3d-9b3c590768cd) for task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 from agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal)
I0702 08:32:25.430725 6510 master.cpp:8018] Forwarding status update
TASK_STARTING (Status UUID: b44e0149-c156-404e-9b3d-9b3c590768cd) for task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.430817 6510 master.cpp:10285] Updating the state of task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (latest state: TASK_STARTING, status
update state: TASK_STARTING)
I0702 08:32:25.431267 6510 scheduler.cpp:739] Enqueuing event UPDATE received
from http://172.16.10.86:32891/master/api/v1/scheduler
I0702 08:32:25.431280 22269 default_executor.cpp:193] Received ACKNOWLEDGED
event
I0702 08:32:25.431555 6510 scheduler.cpp:739] Enqueuing event UPDATE received
from http://172.16.10.86:32891/master/api/v1/scheduler
I0702 08:32:25.431633 6510 scheduler.cpp:247] Sending ACKNOWLEDGE call to
http://172.16.10.86:32891/master/api/v1/scheduler
I0702 08:32:25.431769 22269 default_executor.cpp:193] Received ACKNOWLEDGED
event
I0702 08:32:25.431967 6510 scheduler.cpp:247] Sending ACKNOWLEDGE call to
http://172.16.10.86:32891/master/api/v1/scheduler
I0702 08:32:25.432468 6509 containerizer.cpp:1174] Trying to chown
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/slaves/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0/frameworks/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000/executors/default/runs/57bca45b-28f5-4f80-817a-28c3b55f351e/containers/305ba713-910d-408a-b3eb-13a0668f8359'
to user 'root'
I0702 08:32:25.432576 6509 containerizer.cpp:1209] Starting container
57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359
I0702 08:32:25.432865 6509 containerizer.cpp:1382] Checkpointed
ContainerConfig at
'/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/containers/57bca45b-28f5-4f80-817a-28c3b55f351e/containers/305ba713-910d-408a-b3eb-13a0668f8359/config'
I0702 08:32:25.432888 6509 containerizer.cpp:2968] Transitioning the state of
container
57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359 from
PROVISIONING to PREPARING
I0702 08:32:25.433377 6512 process.cpp:3518] Handling HTTP event for process
'master' with path: '/master/api/v1/scheduler'
I0702 08:32:25.433759 6506 containerizer.cpp:1858] Launching
'mesos-containerizer' with flags '--help="false"
--launch_info="{"command":{"shell":true,"value":"sleep
1000"},"environment":{"variables":[{"name":"MESOS_SANDBOX","type":"VALUE","value":"\/tmp\/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ\/slaves\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0\/frameworks\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000\/executors\/default\/runs\/57bca45b-28f5-4f80-817a-28c3b55f351e\/containers\/de582f28-8ac5-404b-aefa-4b99d32c4ad7"},{"name":"MESOS_CONTAINER_IP","type":"VALUE","value":"172.16.10.86"}]},"task_environment":{},"user":"root","working_directory":"\/tmp\/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ\/slaves\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0\/frameworks\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000\/executors\/default\/runs\/57bca45b-28f5-4f80-817a-28c3b55f351e\/containers\/de582f28-8ac5-404b-aefa-4b99d32c4ad7"}"
--pipe_read="61" --pipe_write="62"
--runtime_directory="/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/containers/57bca45b-28f5-4f80-817a-28c3b55f351e/containers/de582f28-8ac5-404b-aefa-4b99d32c4ad7"
--unshare_namespace_mnt="false"'
I0702 08:32:25.433984 6507 linux_launcher.cpp:438] Launching nested container
57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7 and
cloning with namespaces
I0702 08:32:25.461540 6506 containerizer.cpp:2968] Transitioning the state of
container
57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7 from
PREPARING to ISOLATING
I0702 08:32:25.462749 6506 containerizer.cpp:1858] Launching
'mesos-containerizer' with flags '--help="false"
--launch_info="{"command":{"shell":true,"value":"sleep
1000"},"environment":{"variables":[{"name":"MESOS_SANDBOX","type":"VALUE","value":"\/tmp\/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ\/slaves\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0\/frameworks\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000\/executors\/default\/runs\/57bca45b-28f5-4f80-817a-28c3b55f351e\/containers\/305ba713-910d-408a-b3eb-13a0668f8359"},{"name":"MESOS_CONTAINER_IP","type":"VALUE","value":"172.16.10.86"}]},"task_environment":{},"user":"root","working_directory":"\/tmp\/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ\/slaves\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0\/frameworks\/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000\/executors\/default\/runs\/57bca45b-28f5-4f80-817a-28c3b55f351e\/containers\/305ba713-910d-408a-b3eb-13a0668f8359"}"
--pipe_read="63" --pipe_write="64"
--runtime_directory="/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_3rzaDo/containers/57bca45b-28f5-4f80-817a-28c3b55f351e/containers/305ba713-910d-408a-b3eb-13a0668f8359"
--unshare_namespace_mnt="false"'
I0702 08:32:25.463119 6508 linux_launcher.cpp:438] Launching nested container
57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359 and
cloning with namespaces
I0702 08:32:25.474962 6511 process.cpp:3518] Handling HTTP event for process
'master' with path: '/master/api/v1/scheduler'
I0702 08:32:25.475798 6511 http.cpp:1185] HTTP POST for
/master/api/v1/scheduler from 172.16.10.86:48288
I0702 08:32:25.476187 6511 master.cpp:5877] Processing ACKNOWLEDGE call
0ed178ec-63d1-4d77-943e-9bc1e24a6142 for task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (default) on agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0
I0702 08:32:25.476692 6511 task_status_update_manager.cpp:401] Received task
status update acknowledgement (UUID: 0ed178ec-63d1-4d77-943e-9bc1e24a6142) for
task 8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.477541 6511 slave.cpp:4552] Task status update manager
successfully handled status update acknowledgement (UUID:
0ed178ec-63d1-4d77-943e-9bc1e24a6142) for task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.476805 6512 http.cpp:1185] HTTP POST for
/master/api/v1/scheduler from 172.16.10.86:48288
I0702 08:32:25.477756 6512 master.cpp:5877] Processing ACKNOWLEDGE call
b44e0149-c156-404e-9b3d-9b3c590768cd for task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (default) on agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0
I0702 08:32:25.478047 6512 task_status_update_manager.cpp:401] Received task
status update acknowledgement (UUID: b44e0149-c156-404e-9b3d-9b3c590768cd) for
task 568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.478205 6512 slave.cpp:4552] Task status update manager
successfully handled status update acknowledgement (UUID:
b44e0149-c156-404e-9b3d-9b3c590768cd) for task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.505738 6506 containerizer.cpp:2968] Transitioning the state of
container
57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359 from
PREPARING to ISOLATING
I0702 08:32:25.506242 6506 containerizer.cpp:2968] Transitioning the state of
container
57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7 from
ISOLATING to FETCHING
I0702 08:32:25.506649 6506 containerizer.cpp:2968] Transitioning the state of
container
57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359 from
ISOLATING to FETCHING
I0702 08:32:25.506811 6512 fetcher.cpp:369] Starting to fetch URIs for
container:
57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7,
directory:
/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/slaves/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0/frameworks/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000/executors/default/runs/57bca45b-28f5-4f80-817a-28c3b55f351e/containers/de582f28-8ac5-404b-aefa-4b99d32c4ad7
I0702 08:32:25.507256 6512 fetcher.cpp:369] Starting to fetch URIs for
container:
57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359,
directory:
/tmp/MesosContainerizer_DefaultExecutorTest_ROOT_ContainerStatusForTask_0_XZDWmQ/slaves/be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0/frameworks/be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000/executors/default/runs/57bca45b-28f5-4f80-817a-28c3b55f351e/containers/305ba713-910d-408a-b3eb-13a0668f8359
I0702 08:32:25.507809 6512 containerizer.cpp:2968] Transitioning the state of
container
57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7 from
FETCHING to RUNNING
I0702 08:32:25.508201 6512 containerizer.cpp:2968] Transitioning the state of
container
57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359 from
FETCHING to RUNNING
I0702 08:32:25.509554 22270 default_executor.cpp:644] Finished launching tasks
[ 8c18b647-db11-40f8-9147-c41f5b3a1480, 568501f7-b7ae-4b98-8b6d-a3123d22c8a1 ]
in child containers [
57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7,
57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359 ]
I0702 08:32:25.509582 22270 default_executor.cpp:668] Waiting on child
containers of tasks [ 8c18b647-db11-40f8-9147-c41f5b3a1480,
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 ]
I0702 08:32:25.511070 22271 default_executor.cpp:729] Waiting for child
container
57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7 of
task '8c18b647-db11-40f8-9147-c41f5b3a1480'
I0702 08:32:25.514940 6505 process.cpp:3518] Handling HTTP event for process
'slave(996)' with path: '/slave(996)/api/v1/executor'
I0702 08:32:25.525130 22271 default_executor.cpp:729] Waiting for child
container
57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359 of
task '568501f7-b7ae-4b98-8b6d-a3123d22c8a1'
I0702 08:32:25.525637 6506 process.cpp:3518] Handling HTTP event for process
'slave(996)' with path: '/slave(996)/api/v1'
I0702 08:32:25.525720 6506 process.cpp:3518] Handling HTTP event for process
'slave(996)' with path: '/slave(996)/api/v1'
I0702 08:32:25.526443 6506 http.cpp:1185] HTTP POST for /slave(996)/api/v1
from 172.16.10.86:48298
I0702 08:32:25.526535 6506 http.cpp:1185] HTTP POST for /slave(996)/api/v1
from 172.16.10.86:48300
I0702 08:32:25.526618 6506 http.cpp:2808] Processing WAIT_NESTED_CONTAINER
call for container
'57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7'
I0702 08:32:25.526685 6506 http.cpp:2808] Processing WAIT_NESTED_CONTAINER
call for container
'57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359'
I0702 08:32:25.549337 6510 process.cpp:3518] Handling HTTP event for process
'slave(996)' with path: '/slave(996)/api/v1/executor'
I0702 08:32:25.549942 6510 http.cpp:1185] HTTP POST for
/slave(996)/api/v1/executor from 172.16.10.86:48294
I0702 08:32:25.550034 6510 slave.cpp:5308] Handling status update TASK_RUNNING
(Status UUID: f146b3a3-c5b0-4ac2-a513-74ed628f4aa8) for task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.550156 6510 http.cpp:1185] HTTP POST for
/slave(996)/api/v1/executor from 172.16.10.86:48294
I0702 08:32:25.550209 6510 slave.cpp:5308] Handling status update TASK_RUNNING
(Status UUID: 80a549af-332f-4ab9-80b3-85a3cfcaa3c9) for task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.550624 6509 task_status_update_manager.cpp:328] Received task
status update TASK_RUNNING (Status UUID: f146b3a3-c5b0-4ac2-a513-74ed628f4aa8)
for task 8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.550681 6509 task_status_update_manager.cpp:383] Forwarding task
status update TASK_RUNNING (Status UUID: f146b3a3-c5b0-4ac2-a513-74ed628f4aa8)
for task 8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 to the agent
I0702 08:32:25.550748 6509 task_status_update_manager.cpp:328] Received task
status update TASK_RUNNING (Status UUID: 80a549af-332f-4ab9-80b3-85a3cfcaa3c9)
for task 568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.550786 6509 task_status_update_manager.cpp:383] Forwarding task
status update TASK_RUNNING (Status UUID: 80a549af-332f-4ab9-80b3-85a3cfcaa3c9)
for task 568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 to the agent
I0702 08:32:25.550838 6509 slave.cpp:5800] Forwarding the update TASK_RUNNING
(Status UUID: f146b3a3-c5b0-4ac2-a513-74ed628f4aa8) for task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 to [email protected]:32891
I0702 08:32:25.550910 6509 slave.cpp:5693] Task status update manager
successfully handled status update TASK_RUNNING (Status UUID:
f146b3a3-c5b0-4ac2-a513-74ed628f4aa8) for task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.550981 6509 slave.cpp:5800] Forwarding the update TASK_RUNNING
(Status UUID: 80a549af-332f-4ab9-80b3-85a3cfcaa3c9) for task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 to [email protected]:32891
I0702 08:32:25.551038 6509 slave.cpp:5693] Task status update manager
successfully handled status update TASK_RUNNING (Status UUID:
80a549af-332f-4ab9-80b3-85a3cfcaa3c9) for task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.551149 6509 master.cpp:7962] Status update TASK_RUNNING (Status
UUID: f146b3a3-c5b0-4ac2-a513-74ed628f4aa8) for task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 from agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal)
I0702 08:32:25.551175 6509 master.cpp:8018] Forwarding status update
TASK_RUNNING (Status UUID: f146b3a3-c5b0-4ac2-a513-74ed628f4aa8) for task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.551304 6509 master.cpp:10285] Updating the state of task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (latest state: TASK_RUNNING, status
update state: TASK_RUNNING)
I0702 08:32:25.551386 6509 master.cpp:7962] Status update TASK_RUNNING (Status
UUID: 80a549af-332f-4ab9-80b3-85a3cfcaa3c9) for task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 from agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal)
I0702 08:32:25.551409 6509 master.cpp:8018] Forwarding status update
TASK_RUNNING (Status UUID: 80a549af-332f-4ab9-80b3-85a3cfcaa3c9) for task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.551508 6509 master.cpp:10285] Updating the state of task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (latest state: TASK_RUNNING, status
update state: TASK_RUNNING)
I0702 08:32:25.551633 6509 scheduler.cpp:739] Enqueuing event UPDATE received
from http://172.16.10.86:32891/master/api/v1/scheduler
I0702 08:32:25.551872 6511 scheduler.cpp:739] Enqueuing event UPDATE received
from http://172.16.10.86:32891/master/api/v1/scheduler
I0702 08:32:25.552341 22274 default_executor.cpp:193] Received ACKNOWLEDGED
event
I0702 08:32:25.552423 22274 default_executor.cpp:193] Received ACKNOWLEDGED
event
I0702 08:32:25.552743 6511 scheduler.cpp:247] Sending ACKNOWLEDGE call to
http://172.16.10.86:32891/master/api/v1/scheduler
*** Aborted at 1530520345 (unix time) try "date -d @1530520345" if you are
using GNU date ***
I0702 08:32:25.558001 6512 process.cpp:3518] Handling HTTP event for process
'master' with path: '/master/api/v1/scheduler'
W0702 08:32:25.558317 6505 uri_disk_profile.cpp:229] Failed to poll URI:
Failed to open file: No such file or directory
I0702 08:32:25.558487 6512 master.cpp:1420] Framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (default) disconnected
I0702 08:32:25.558513 6512 master.cpp:3335] Deactivating framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (default)
I0702 08:32:25.559453 6505 hierarchical.cpp:405] Deactivated framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.559484 6512 master.cpp:3312] Disconnecting framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (default)
I0702 08:32:25.559499 6512 master.cpp:1435] Giving framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (default) 0ns to failover
I0702 08:32:25.559902 6512 http.cpp:1185] HTTP POST for
/master/api/v1/scheduler from 172.16.10.86:48288
I0702 08:32:25.560120 6512 master.cpp:8685] Framework failover timeout,
removing framework be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (default)
I0702 08:32:25.560148 6512 master.cpp:9562] Removing framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (default)
I0702 08:32:25.560297 6505 slave.cpp:3949] Asked to shut down framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 by [email protected]:32891
I0702 08:32:25.560325 6505 slave.cpp:3974] Shutting down framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.560338 6505 slave.cpp:6681] Shutting down executor 'default' of
framework be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (via HTTP)
I0702 08:32:25.560818 22274 default_executor.cpp:193] Received SHUTDOWN event
I0702 08:32:25.560845 22274 default_executor.cpp:1009] Shutting down
I0702 08:32:25.560854 22274 default_executor.cpp:1111] Killing task
8c18b647-db11-40f8-9147-c41f5b3a1480 running in child container
57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7 with
SIGTERM signal
I0702 08:32:25.560863 22274 default_executor.cpp:1133] Scheduling escalation to
SIGKILL in 3secs from now
I0702 08:32:25.561103 22274 default_executor.cpp:1111] Killing task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 running in child container
57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359 with
SIGTERM signal
I0702 08:32:25.561128 22274 default_executor.cpp:1133] Scheduling escalation to
SIGKILL in 3secs from now
I0702 08:32:25.562314 6505 process.cpp:3518] Handling HTTP event for process
'slave(996)' with path: '/slave(996)/api/v1'
I0702 08:32:25.562798 6505 process.cpp:3518] Handling HTTP event for process
'slave(996)' with path: '/slave(996)/api/v1'
I0702 08:32:25.562947 6512 master.cpp:10285] Updating the state of task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (latest state: TASK_KILLED, status
update state: TASK_KILLED)
I0702 08:32:25.563470 6505 http.cpp:1185] HTTP POST for /slave(996)/api/v1
from 172.16.10.86:48302
I0702 08:32:25.563670 6512 master.cpp:10389] Removing task
568501f7-b7ae-4b98-8b6d-a3123d22c8a1 with resources cpus(allocated: *):0.1;
mem(allocated: *):32; disk(allocated: *):32 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 on agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal)
I0702 08:32:25.565192 6510 hierarchical.cpp:1192] Recovered cpus(allocated:
*):0.1; mem(allocated: *):32; disk(allocated: *):32 (total: cpus:2; mem:1024;
disk:1024; ports:[31000-32000], allocated: cpus(allocated: *):0.2;
mem(allocated: *):64; disk(allocated: *):64) on agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 from framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.565382 6512 master.cpp:10285] Updating the state of task
8c18b647-db11-40f8-9147-c41f5b3a1480 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 (latest state: TASK_KILLED, status
update state: TASK_KILLED)
I0702 08:32:25.565527 6512 master.cpp:10389] Removing task
8c18b647-db11-40f8-9147-c41f5b3a1480 with resources cpus(allocated: *):0.1;
mem(allocated: *):32; disk(allocated: *):32 of framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 on agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal)
I0702 08:32:25.565752 6506 hierarchical.cpp:1192] Recovered cpus(allocated:
*):0.1; mem(allocated: *):32; disk(allocated: *):32 (total: cpus:2; mem:1024;
disk:1024; ports:[31000-32000], allocated: cpus(allocated: *):0.1;
mem(allocated: *):32; disk(allocated: *):32) on agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 from framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.565915 6512 master.cpp:10418] Removing executor 'default' with
resources
[{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":32.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"disk","scalar":{"value":32.0},"type":"SCALAR"}]
of framework be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000 on agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 at slave(996)@172.16.10.86:32891
(ip-172-16-10-86.ec2.internal)
I0702 08:32:25.566211 6509 hierarchical.cpp:1192] Recovered cpus(allocated:
*):0.1; mem(allocated: *):32; disk(allocated: *):32 (total: cpus:2; mem:1024;
disk:1024; ports:[31000-32000], allocated: {}) on agent
be25b90e-f63d-4935-aaf3-cacfc7faacbf-S0 from framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.566377 6505 http.cpp:1185] HTTP POST for /slave(996)/api/v1
from 172.16.10.86:48304
I0702 08:32:25.566562 6505 http.cpp:2966] Processing KILL_NESTED_CONTAINER
call for container
'57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7'
I0702 08:32:25.566853 6512 hierarchical.cpp:344] Removed framework
be25b90e-f63d-4935-aaf3-cacfc7faacbf-0000
I0702 08:32:25.567034 6505 http.cpp:2966] Processing KILL_NESTED_CONTAINER
call for container
'57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359'
PC: @ 0x7f9501d46473 mesos::v1::scheduler::Mesos::send()
*** SIGSEGV (@0x0) received by PID 17172 (TID 0x7f94f3d91700) from PID 0; stack
trace: ***
@ 0x7f94cb9790f2 (unknown)
@ 0x7f94cb97d649 (unknown)
@ 0x7f94cb970d88 (unknown)
@ 0x7f94fec0b390 (unknown)
@ 0x7f9501d46473 mesos::v1::scheduler::Mesos::send()
@ 0x5617560b5da6
_ZNK5mesos8internal5tests2v19scheduler23SendAcknowledgeActionP2INS_2v111FrameworkIDENS5_7AgentIDEE10gmock_ImplIFvPNS5_9scheduler5MesosERKNSA_12Event_UpdateEEE17gmock_PerformImplISC_SF_N7testing8internal12ExcessiveArgESL_SL_SL_SL_SL_SL_SL_EEvRKSt5tupleIJSC_SF_EET_T0_T1_T2_T3_T4_T5_T6_T7_T8_
@ 0x5617560b5f20
_ZN5mesos8internal5tests2v19scheduler23SendAcknowledgeActionP2INS_2v111FrameworkIDENS5_7AgentIDEE10gmock_ImplIFvPNS5_9scheduler5MesosERKNSA_12Event_UpdateEEE7PerformERKSt5tupleIJSC_SF_EE
@ 0x561755fb169e
_ZN7testing8internal12DoBothActionI17PromiseArgActionPILi1EPN7process7PromiseIN5mesos2v19scheduler12Event_UpdateEEEENS5_8internal5tests2v19scheduler23SendAcknowledgeActionP2INS6_11FrameworkIDENS6_7AgentIDEEEE4ImplIFvPNS7_5MesosERKS8_EE7PerformERKSt5tupleIJSN_SP_EE
@ 0x561755fe2cdb
testing::internal::FunctionMockerBase<>::UntypedPerformAction()
@ 0x5617572b2339
testing::internal::UntypedFunctionMockerBase::UntypedInvokeWith()
@ 0x5617560b795a
mesos::internal::tests::scheduler::MockHTTPScheduler<>::events()
@ 0x561756039566 std::_Function_handler<>::_M_invoke()
@ 0x7f9501d4a628 process::AsyncExecutorProcess::execute<>()
@ 0x7f9501d51d2d
_ZNO6lambda12CallableOnceIFvPN7process11ProcessBaseEEE10CallableFnINS_8internal7PartialIZNS1_8dispatchI7NothingNS1_20AsyncExecutorProcessERKSt8functionIFvRKSt5queueIN5mesos2v19scheduler5EventESt5dequeISH_SaISH_EEEEESL_SR_RSL_EENS1_6FutureIT_EERKNS1_3PIDIT0_EEMSX_FSU_T1_T2_EOT3_OT4_EUlSt10unique_ptrINS1_7PromiseISA_EESt14default_deleteIS1B_EEOSP_OSL_S3_E_IS1E_SP_SL_St12_PlaceholderILi1EEEEEEclEOS3_
@ 0x7f9502aaa6b1 process::ProcessBase::consume()
@ 0x7f9502ac835a process::ProcessManager::resume()
@ 0x7f9502acbee6
_ZNSt6thread5_ImplISt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUlvE_vEEE6_M_runEv
@ 0x7f94ff3eec80 (unknown)
@ 0x7f94fec016ba start_thread
@ 0x7f94fe93741d (unknown)
E0702 08:32:25.766984 22270 default_executor.cpp:782] Connection for waiting on
child container
57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359 of
task '568501f7-b7ae-4b98-8b6d-a3123d22c8a1' interrupted: Disconnected
E0702 08:32:25.769178 22270 default_executor.cpp:782] Connection for waiting on
child container
57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7 of
task '8c18b647-db11-40f8-9147-c41f5b3a1480' interrupted: Disconnected
E0702 08:32:25.769580 22274 default_executor.cpp:1497] Unable to establish
connection with the agent (Failed to connect to 172.16.10.86:32891: Connection
refused) for waiting on child container
57bca45b-28f5-4f80-817a-28c3b55f351e.305ba713-910d-408a-b3eb-13a0668f8359 of
task '568501f7-b7ae-4b98-8b6d-a3123d22c8a1'; Retrying again in 1secs
timeout: the monitored command dumped core
E0702 08:32:25.770203 22274 default_executor.cpp:1497] Unable to establish
connection with the agent (Failed to connect to 172.16.10.86:32891: Connection
refused) for waiting on child container
57bca45b-28f5-4f80-817a-28c3b55f351e.de582f28-8ac5-404b-aefa-4b99d32c4ad7 of
task '8c18b647-db11-40f8-9147-c41f5b3a1480'; Retrying again in 1secs
I0702 08:32:25.770306 22274 default_executor.cpp:165] Disconnected from agent
I0702 08:32:25.770566 22274 default_executor.cpp:193] Received SHUTDOWN event
W0702 08:32:25.770628 22274 default_executor.cpp:1005] Ignoring shutdown since
it is in progress
{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
