[
https://issues.apache.org/jira/browse/MESOS-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15522097#comment-15522097
]
Qian Zhang commented on MESOS-6002:
-----------------------------------
The root cause of this issue is, in aufs backend
({{AufsBackendProcess::provision()}}), the way that we do the aufs mount is not
correct. In the current implementation, we do the aufs mount with the option
{{-o dirs=workdir:layer1:layer2:layerN}}, actually we should do it with the
option {{-o dirs=workdir=rw:layer1=ro+wh:layer2=ro+wh:layerN=ro+wh}}, here the
key is for each image layer, we should not only make it readonly ({{ro}}), but
also specify {{wh}} for it so that aufs will automatically handle the whiteout
files during the mount. That is also what Docker's aufs storage dirver does:
https://github.com/docker/docker/blob/v1.12.1/daemon/graphdriver/aufs/aufs.go#L522
> The whiteout file cannot be removed correctly using aufs backend.
> -----------------------------------------------------------------
>
> Key: MESOS-6002
> URL: https://issues.apache.org/jira/browse/MESOS-6002
> Project: Mesos
> Issue Type: Bug
> Components: containerization
> Environment: Ubuntu 14, Ubuntu 12
> Or any os with aufs module
> Reporter: Gilbert Song
> Assignee: Qian Zhang
> Labels: aufs, backend, containerizer
> Attachments: whiteout.diff
>
>
> The whiteout file is not removed correctly when using the aufs backend in
> unified containerizer. It can be verified by this unit test with the aufs
> manually specified.
> {noformat}
> [20:11:24] : [Step 10/10] [ RUN ]
> ProvisionerDockerPullerTest.ROOT_INTERNET_CURL_Whiteout
> [20:11:24]W: [Step 10/10] I0805 20:11:24.986734 24295 cluster.cpp:155]
> Creating default 'local' authorizer
> [20:11:25]W: [Step 10/10] I0805 20:11:25.001153 24295 leveldb.cpp:174]
> Opened db in 14.308627ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.003731 24295 leveldb.cpp:181]
> Compacted db in 2.558329ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.003749 24295 leveldb.cpp:196]
> Created db iterator in 3086ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.003754 24295 leveldb.cpp:202]
> Seeked to beginning of db in 595ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.003758 24295 leveldb.cpp:271]
> Iterated through 0 keys in the db in 314ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.003769 24295 replica.cpp:776]
> Replica recovered with log positions 0 -> 0 with 1 holes and 0 unlearned
> [20:11:25]W: [Step 10/10] I0805 20:11:25.004086 24315 recover.cpp:451]
> Starting replica recovery
> [20:11:25]W: [Step 10/10] I0805 20:11:25.004251 24312 recover.cpp:477]
> Replica is in EMPTY status
> [20:11:25]W: [Step 10/10] I0805 20:11:25.004546 24314 replica.cpp:673]
> Replica in EMPTY status received a broadcasted recover request from
> __req_res__(5640)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.004607 24312 recover.cpp:197]
> Received a recover response from a replica in EMPTY status
> [20:11:25]W: [Step 10/10] I0805 20:11:25.004762 24313 recover.cpp:568]
> Updating replica status to STARTING
> [20:11:25]W: [Step 10/10] I0805 20:11:25.004776 24314 master.cpp:375]
> Master 21665992-d47e-402f-a00c-6f8fab613019 (ip-172-30-2-105.mesosphere.io)
> started on 172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.004787 24314 master.cpp:377] Flags
> at startup: --acls="" --agent_ping_timeout="15secs"
> --agent_reregister_timeout="10mins" --allocation_interval="1secs"
> --allocator="HierarchicalDRF" --authenticate_agents="true"
> --authenticate_frameworks="true" --authenticate_http_frameworks="true"
> --authenticate_http_readonly="true" --authenticate_http_readwrite="true"
> --authenticators="crammd5" --authorizers="local"
> --credentials="/tmp/0z753P/credentials" --framework_sorter="drf"
> --help="false" --hostname_lookup="true" --http_authenticators="basic"
> --http_framework_authenticators="basic" --initialize_driver_logging="true"
> --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO"
> --max_agent_ping_timeouts="5" --max_completed_frameworks="50"
> --max_completed_tasks_per_framework="1000" --quiet="false"
> --recovery_agent_removal_limit="100%" --registry="replicated_log"
> --registry_fetch_timeout="1mins" --registry_store_timeout="100secs"
> --registry_strict="true" --root_submissions="true" --user_sorter="drf"
> --version="false" --webui_dir="/usr/local/share/mesos/webui"
> --work_dir="/tmp/0z753P/master" --zk_session_timeout="10secs"
> [20:11:25]W: [Step 10/10] I0805 20:11:25.004920 24314 master.cpp:427]
> Master only allowing authenticated frameworks to register
> [20:11:25]W: [Step 10/10] I0805 20:11:25.004930 24314 master.cpp:441]
> Master only allowing authenticated agents to register
> [20:11:25]W: [Step 10/10] I0805 20:11:25.004935 24314 master.cpp:454]
> Master only allowing authenticated HTTP frameworks to register
> [20:11:25]W: [Step 10/10] I0805 20:11:25.004942 24314 credentials.hpp:37]
> Loading credentials for authentication from '/tmp/0z753P/credentials'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.005018 24314 master.cpp:499] Using
> default 'crammd5' authenticator
> [20:11:25]W: [Step 10/10] I0805 20:11:25.005101 24314 http.cpp:883] Using
> default 'basic' HTTP authenticator for realm 'mesos-master-readonly'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.005152 24314 http.cpp:883] Using
> default 'basic' HTTP authenticator for realm 'mesos-master-readwrite'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.005192 24314 http.cpp:883] Using
> default 'basic' HTTP authenticator for realm 'mesos-master-scheduler'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.005230 24314 master.cpp:579]
> Authorization enabled
> [20:11:25]W: [Step 10/10] I0805 20:11:25.005297 24315 hierarchical.cpp:151]
> Initialized hierarchical allocator process
> [20:11:25]W: [Step 10/10] I0805 20:11:25.005312 24312
> whitelist_watcher.cpp:77] No whitelist given
> [20:11:25]W: [Step 10/10] I0805 20:11:25.005820 24315 master.cpp:1851]
> Elected as the leading master!
> [20:11:25]W: [Step 10/10] I0805 20:11:25.005828 24315 master.cpp:1547]
> Recovering from registrar
> [20:11:25]W: [Step 10/10] I0805 20:11:25.005889 24310 registrar.cpp:332]
> Recovering registrar
> [20:11:25]W: [Step 10/10] I0805 20:11:25.006850 24311 leveldb.cpp:304]
> Persisting metadata (8 bytes) to leveldb took 2.004066ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.006865 24311 replica.cpp:320]
> Persisted replica status to STARTING
> [20:11:25]W: [Step 10/10] I0805 20:11:25.006913 24311 recover.cpp:477]
> Replica is in STARTING status
> [20:11:25]W: [Step 10/10] I0805 20:11:25.007186 24310 replica.cpp:673]
> Replica in STARTING status received a broadcasted recover request from
> __req_res__(5641)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.007289 24316 recover.cpp:197]
> Received a recover response from a replica in STARTING status
> [20:11:25]W: [Step 10/10] I0805 20:11:25.007446 24315 recover.cpp:568]
> Updating replica status to VOTING
> [20:11:25]W: [Step 10/10] I0805 20:11:25.009585 24309 leveldb.cpp:304]
> Persisting metadata (8 bytes) to leveldb took 2.053694ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.009600 24309 replica.cpp:320]
> Persisted replica status to VOTING
> [20:11:25]W: [Step 10/10] I0805 20:11:25.009632 24309 recover.cpp:582]
> Successfully joined the Paxos group
> [20:11:25]W: [Step 10/10] I0805 20:11:25.009706 24309 recover.cpp:466]
> Recover process terminated
> [20:11:25]W: [Step 10/10] I0805 20:11:25.009865 24313 log.cpp:553]
> Attempting to start the writer
> [20:11:25]W: [Step 10/10] I0805 20:11:25.010295 24312 replica.cpp:493]
> Replica received implicit promise request from
> __req_res__(5642)@172.30.2.105:36006 with proposal 1
> [20:11:25]W: [Step 10/10] I0805 20:11:25.012267 24312 leveldb.cpp:304]
> Persisting metadata (8 bytes) to leveldb took 1.955683ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.012281 24312 replica.cpp:342]
> Persisted promised to 1
> [20:11:25]W: [Step 10/10] I0805 20:11:25.012506 24311 coordinator.cpp:238]
> Coordinator attempting to fill missing positions
> [20:11:25]W: [Step 10/10] I0805 20:11:25.012964 24316 replica.cpp:388]
> Replica received explicit promise request from
> __req_res__(5643)@172.30.2.105:36006 for position 0 with proposal 2
> [20:11:25]W: [Step 10/10] I0805 20:11:25.013638 24316 leveldb.cpp:341]
> Persisting action (8 bytes) to leveldb took 654110ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.013651 24316 replica.cpp:708]
> Persisted action NOP at position 0
> [20:11:25]W: [Step 10/10] I0805 20:11:25.014034 24309 replica.cpp:537]
> Replica received write request for position 0 from
> __req_res__(5644)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.014056 24309 leveldb.cpp:436]
> Reading position from leveldb took 9338ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.016970 24309 leveldb.cpp:341]
> Persisting action (14 bytes) to leveldb took 2.898601ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.016985 24309 replica.cpp:708]
> Persisted action NOP at position 0
> [20:11:25]W: [Step 10/10] I0805 20:11:25.017221 24311 replica.cpp:691]
> Replica received learned notice for position 0 from @0.0.0.0:0
> [20:11:25]W: [Step 10/10] I0805 20:11:25.019346 24311 leveldb.cpp:341]
> Persisting action (16 bytes) to leveldb took 2.105458ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.019361 24311 replica.cpp:708]
> Persisted action NOP at position 0
> [20:11:25]W: [Step 10/10] I0805 20:11:25.019507 24313 log.cpp:569] Writer
> started with ending position 0
> [20:11:25]W: [Step 10/10] I0805 20:11:25.019839 24309 leveldb.cpp:436]
> Reading position from leveldb took 10748ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.020036 24310 registrar.cpp:365]
> Successfully fetched the registry (0B) in 14.12608ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.020072 24310 registrar.cpp:464]
> Applied 1 operations in 3729ns; attempting to update the registry
> [20:11:25]W: [Step 10/10] I0805 20:11:25.020220 24313 log.cpp:577]
> Attempting to append 209 bytes to the log
> [20:11:25]W: [Step 10/10] I0805 20:11:25.020277 24315 coordinator.cpp:348]
> Coordinator attempting to write APPEND action at position 1
> [20:11:25]W: [Step 10/10] I0805 20:11:25.020550 24311 replica.cpp:537]
> Replica received write request for position 1 from
> __req_res__(5645)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.021132 24311 leveldb.cpp:341]
> Persisting action (228 bytes) to leveldb took 565494ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.021144 24311 replica.cpp:708]
> Persisted action APPEND at position 1
> [20:11:25]W: [Step 10/10] I0805 20:11:25.021389 24310 replica.cpp:691]
> Replica received learned notice for position 1 from @0.0.0.0:0
> [20:11:25]W: [Step 10/10] I0805 20:11:25.023318 24310 leveldb.cpp:341]
> Persisting action (230 bytes) to leveldb took 1.911548ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.023332 24310 replica.cpp:708]
> Persisted action APPEND at position 1
> [20:11:25]W: [Step 10/10] I0805 20:11:25.023541 24315 registrar.cpp:509]
> Successfully updated the registry in 3.454976ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.023597 24315 registrar.cpp:395]
> Successfully recovered registrar
> [20:11:25]W: [Step 10/10] I0805 20:11:25.023643 24313 log.cpp:596]
> Attempting to truncate the log to 1
> [20:11:25]W: [Step 10/10] I0805 20:11:25.023706 24312 coordinator.cpp:348]
> Coordinator attempting to write TRUNCATE action at position 2
> [20:11:25]W: [Step 10/10] I0805 20:11:25.023710 24315 master.cpp:1655]
> Recovered 0 agents from the registry (170B); allowing 10mins for agents to
> re-register
> [20:11:25]W: [Step 10/10] I0805 20:11:25.023783 24310 hierarchical.cpp:178]
> Skipping recovery of hierarchical allocator: nothing to recover
> [20:11:25]W: [Step 10/10] I0805 20:11:25.025234 24315 replica.cpp:537]
> Replica received write request for position 2 from
> __req_res__(5646)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.027144 24315 leveldb.cpp:341]
> Persisting action (16 bytes) to leveldb took 1.892058ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.027158 24315 replica.cpp:708]
> Persisted action TRUNCATE at position 2
> [20:11:25]W: [Step 10/10] I0805 20:11:25.027400 24316 replica.cpp:691]
> Replica received learned notice for position 2 from @0.0.0.0:0
> [20:11:25]W: [Step 10/10] I0805 20:11:25.028108 24316 leveldb.cpp:341]
> Persisting action (18 bytes) to leveldb took 692102ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.028131 24316 leveldb.cpp:399]
> Deleting ~1 keys from leveldb took 10051ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.028139 24316 replica.cpp:708]
> Persisted action TRUNCATE at position 2
> [20:11:25]W: [Step 10/10] I0805 20:11:25.029505 24295
> containerizer.cpp:200] Using isolation:
> docker/runtime,filesystem/linux,network/cni
> [20:11:25]W: [Step 10/10] I0805 20:11:25.032551 24295
> linux_launcher.cpp:101] Using /sys/fs/cgroup/freezer as the freezer hierarchy
> for the Linux launcher
> [20:11:25]W: [Step 10/10] E0805 20:11:25.035212 24295 shell.hpp:106]
> Command 'hadoop version 2>&1' failed; this is the output:
> [20:11:25]W: [Step 10/10] sh: 1: hadoop: not found
> [20:11:25]W: [Step 10/10] I0805 20:11:25.035234 24295 fetcher.cpp:62]
> Skipping URI fetcher plugin 'hadoop' as it could not be created: Failed to
> create HDFS client: Failed to execute 'hadoop version 2>&1'; the command was
> either not found or exited with a non-zero exit status: 127
> [20:11:25]W: [Step 10/10] I0805 20:11:25.035277 24295
> registry_puller.cpp:111] Creating registry puller with docker registry
> 'https://registry-1.docker.io'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.036067 24295 linux.cpp:148] Bind
> mounting
> '/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf'
> and making it a shared mount
> [20:11:25]W: [Step 10/10] I0805 20:11:25.041409 24295 cluster.cpp:434]
> Creating default 'local' authorizer
> [20:11:25]W: [Step 10/10] I0805 20:11:25.041822 24309 slave.cpp:198] Mesos
> agent started on (480)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.041838 24309 slave.cpp:199] Flags
> at startup: --acls="" --appc_simple_discovery_uri_prefix="http://";
> --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="true"
> --authenticate_http_readwrite="true" --authenticatee="crammd5"
> --authentication_backoff_factor="1secs" --authorizer="local"
> --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false"
> --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false"
> --cgroups_root="mesos" --container_disk_watch_interval="15secs"
> --containerizers="mesos"
> --credential="/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/credential"
> --default_role="*" --disk_watch_interval="1mins" --docker="docker"
> --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io";
> --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock"
> --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker"
> --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume"
> --enforce_container_disk_quota="false"
> --executor_registration_timeout="1mins"
> --executor_shutdown_grace_period="5secs"
> --fetcher_cache_dir="/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/fetch"
> --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
> --gc_disk_headroom="0.1" --hadoop_home="" --help="false"
> --hostname_lookup="true" --http_authenticators="basic"
> --http_command_executor="false"
> --http_credentials="/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/http_credentials"
> --image_providers="docker" --initialize_driver_logging="true"
> --isolation="docker/runtime,filesystem/linux"
> --launcher_dir="/mnt/teamcity/work/4240ba9ddd0997c3/build/src"
> --logbufsecs="0" --logging_level="INFO"
> --oversubscribed_resources_interval="15secs" --perf_duration="10secs"
> --perf_interval="1mins" --qos_correction_interval_min="0ns" --quiet="false"
> --recover="reconnect" --recovery_timeout="15mins"
> --registration_backoff_factor="10ms"
> --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]"
> --revocable_cpu_low_priority="true" --sandbox_directory="/mnt/mesos/sandbox"
> --strict="true" --switch_user="true" --systemd_enable_support="true"
> --systemd_runtime_directory="/run/systemd/system" --version="false"
> --work_dir="/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf"
> [20:11:25]W: [Step 10/10] I0805 20:11:25.042037 24309 credentials.hpp:86]
> Loading credential for authentication from
> '/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/credential'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.042135 24309 slave.cpp:336] Agent
> using credential for: test-principal
> [20:11:25]W: [Step 10/10] I0805 20:11:25.042145 24309 credentials.hpp:37]
> Loading credentials for authentication from
> '/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/http_credentials'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.042207 24309 http.cpp:883] Using
> default 'basic' HTTP authenticator for realm 'mesos-agent-readonly'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.042326 24309 http.cpp:883] Using
> default 'basic' HTTP authenticator for realm 'mesos-agent-readwrite'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.042444 24295 sched.cpp:226]
> Version: 1.1.0
> [20:11:25]W: [Step 10/10] I0805 20:11:25.042582 24313 sched.cpp:330] New
> master detected at [email protected]:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.042618 24313 sched.cpp:396]
> Authenticating with master [email protected]:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.042628 24313 sched.cpp:403] Using
> default CRAM-MD5 authenticatee
> [20:11:25]W: [Step 10/10] I0805 20:11:25.042681 24309 slave.cpp:519] Agent
> resources: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000]
> [20:11:25]W: [Step 10/10] I0805 20:11:25.042712 24309 slave.cpp:527] Agent
> attributes: [ ]
> [20:11:25]W: [Step 10/10] I0805 20:11:25.042721 24309 slave.cpp:532] Agent
> hostname: ip-172-30-2-105.mesosphere.io
> [20:11:25]W: [Step 10/10] I0805 20:11:25.042774 24314
> authenticatee.cpp:121] Creating new client SASL connection
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043064 24309 state.cpp:57]
> Recovering state from
> '/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/meta'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043093 24315 master.cpp:5900]
> Authenticating
> [email protected]:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043184 24311
> authenticator.cpp:414] Starting authentication session for
> crammd5-authenticatee(980)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043272 24316
> status_update_manager.cpp:203] Recovering status update manager
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043310 24309 authenticator.cpp:98]
> Creating new server SASL connection
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043362 24313
> containerizer.cpp:527] Recovering containerizer
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043468 24309
> authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043488 24309
> authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043536 24309
> authenticator.cpp:204] Received SASL authentication start
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043567 24309
> authenticator.cpp:326] Authentication requires more steps
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043597 24309
> authenticatee.cpp:259] Received SASL authentication step
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043700 24312
> authenticator.cpp:232] Received SASL authentication step
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043716 24312 auxprop.cpp:109]
> Request to lookup properties for user: 'test-principal' realm:
> 'ip-172-30-2-105.mesosphere.io' server FQDN: 'ip-172-30-2-105.mesosphere.io'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: false
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043721 24312 auxprop.cpp:181]
> Looking up auxiliary property '*userPassword'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043730 24312 auxprop.cpp:181]
> Looking up auxiliary property '*cmusaslsecretCRAM-MD5'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043735 24312 auxprop.cpp:109]
> Request to lookup properties for user: 'test-principal' realm:
> 'ip-172-30-2-105.mesosphere.io' server FQDN: 'ip-172-30-2-105.mesosphere.io'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: true
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043740 24312 auxprop.cpp:131]
> Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043742 24312 auxprop.cpp:131]
> Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since
> SASL_AUXPROP_AUTHZID == true
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043751 24312
> authenticator.cpp:318] Authentication success
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043804 24311
> authenticatee.cpp:299] Authentication success
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043828 24316
> authenticator.cpp:432] Authentication session cleanup for
> crammd5-authenticatee(980)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043894 24312 master.cpp:5930]
> Successfully authenticated principal 'test-principal' at
> [email protected]:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.043998 24311 sched.cpp:502]
> Successfully authenticated with master [email protected]:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044008 24311 sched.cpp:820]
> Sending SUBSCRIBE call to [email protected]:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044054 24311 sched.cpp:853] Will
> retry registration in 598.967375ms if necessary
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044087 24315 master.cpp:2425]
> Received SUBSCRIBE call for framework 'default' at
> [email protected]:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044102 24315 master.cpp:1887]
> Authorizing framework principal 'test-principal' to receive offers for role
> '*'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044196 24315 master.cpp:2501]
> Subscribing framework default with checkpointing disabled and capabilities [
> ]
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044319 24309 hierarchical.cpp:271]
> Added framework 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044335 24309
> hierarchical.cpp:1548] No allocations performed
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044339 24309
> hierarchical.cpp:1643] No inverse offers to send out!
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044337 24315 sched.cpp:743]
> Framework registered with 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044356 24309
> hierarchical.cpp:1192] Performed allocation for 0 agents in 26622ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044387 24315 sched.cpp:757]
> Scheduler::registered took 13681ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044664 24313
> metadata_manager.cpp:248] Successfully loaded image 'alpine'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044682 24313
> metadata_manager.cpp:248] Successfully loaded image 'library/alpine'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044685 24313
> metadata_manager.cpp:251] Successfully loaded 2 Docker images
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044770 24316 provisioner.cpp:255]
> Provisioner recovery complete
> [20:11:25]W: [Step 10/10] I0805 20:11:25.044936 24309 slave.cpp:4872]
> Finished recovery
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045084 24309 slave.cpp:5044]
> Querying resource estimator for oversubscribable resources
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045176 24309 slave.cpp:895] New
> master detected at [email protected]:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045186 24309 slave.cpp:954]
> Authenticating with master [email protected]:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045192 24315
> status_update_manager.cpp:177] Pausing sending status updates
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045195 24309 slave.cpp:965] Using
> default CRAM-MD5 authenticatee
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045246 24309 slave.cpp:927]
> Detecting new master
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045272 24312
> authenticatee.cpp:121] Creating new client SASL connection
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045307 24309 slave.cpp:5058]
> Received oversubscribable resources from the resource estimator
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045445 24312 master.cpp:5900]
> Authenticating slave(480)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045506 24310
> authenticator.cpp:414] Starting authentication session for
> crammd5-authenticatee(981)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045573 24316 authenticator.cpp:98]
> Creating new server SASL connection
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045722 24316
> authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045733 24316
> authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045786 24313
> authenticator.cpp:204] Received SASL authentication start
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045814 24313
> authenticator.cpp:326] Authentication requires more steps
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045845 24313
> authenticatee.cpp:259] Received SASL authentication step
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045876 24313
> authenticator.cpp:232] Received SASL authentication step
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045891 24313 auxprop.cpp:109]
> Request to lookup properties for user: 'test-principal' realm:
> 'ip-172-30-2-105.mesosphere.io' server FQDN: 'ip-172-30-2-105.mesosphere.io'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: false
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045899 24313 auxprop.cpp:181]
> Looking up auxiliary property '*userPassword'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045909 24313 auxprop.cpp:181]
> Looking up auxiliary property '*cmusaslsecretCRAM-MD5'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045919 24313 auxprop.cpp:109]
> Request to lookup properties for user: 'test-principal' realm:
> 'ip-172-30-2-105.mesosphere.io' server FQDN: 'ip-172-30-2-105.mesosphere.io'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: true
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045923 24313 auxprop.cpp:131]
> Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045927 24313 auxprop.cpp:131]
> Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since
> SASL_AUXPROP_AUTHZID == true
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045933 24313
> authenticator.cpp:318] Authentication success
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045964 24313
> authenticatee.cpp:299] Authentication success
> [20:11:25]W: [Step 10/10] I0805 20:11:25.045986 24310 master.cpp:5930]
> Successfully authenticated principal 'test-principal' at
> slave(480)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.046007 24313
> authenticator.cpp:432] Authentication session cleanup for
> crammd5-authenticatee(981)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.046118 24316 slave.cpp:1049]
> Successfully authenticated with master [email protected]:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.046165 24316 slave.cpp:1455] Will
> retry registration in 13.54989ms if necessary
> [20:11:25]W: [Step 10/10] I0805 20:11:25.046214 24314 master.cpp:4554]
> Registering agent at slave(480)@172.30.2.105:36006
> (ip-172-30-2-105.mesosphere.io) with id
> 21665992-d47e-402f-a00c-6f8fab613019-S0
> [20:11:25]W: [Step 10/10] I0805 20:11:25.046315 24309 registrar.cpp:464]
> Applied 1 operations in 11551ns; attempting to update the registry
> [20:11:25]W: [Step 10/10] I0805 20:11:25.046525 24315 log.cpp:577]
> Attempting to append 395 bytes to the log
> [20:11:25]W: [Step 10/10] I0805 20:11:25.046561 24315 coordinator.cpp:348]
> Coordinator attempting to write APPEND action at position 3
> [20:11:25]W: [Step 10/10] I0805 20:11:25.046823 24311 replica.cpp:537]
> Replica received write request for position 3 from
> __req_res__(5647)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.047461 24311 leveldb.cpp:341]
> Persisting action (414 bytes) to leveldb took 621763ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.047473 24311 replica.cpp:708]
> Persisted action APPEND at position 3
> [20:11:25]W: [Step 10/10] I0805 20:11:25.047700 24311 replica.cpp:691]
> Replica received learned notice for position 3 from @0.0.0.0:0
> [20:11:25]W: [Step 10/10] I0805 20:11:25.049839 24311 leveldb.cpp:341]
> Persisting action (416 bytes) to leveldb took 2.121721ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.049860 24311 replica.cpp:708]
> Persisted action APPEND at position 3
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050199 24315 registrar.cpp:509]
> Successfully updated the registry in 3.862016ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050240 24311 log.cpp:596]
> Attempting to truncate the log to 3
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050288 24315 coordinator.cpp:348]
> Coordinator attempting to write TRUNCATE action at position 4
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050401 24310 slave.cpp:3739]
> Received ping from slave-observer(439)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050425 24314 master.cpp:4623]
> Registered agent 21665992-d47e-402f-a00c-6f8fab613019-S0 at
> slave(480)@172.30.2.105:36006 (ip-172-30-2-105.mesosphere.io) with cpus(*):2;
> mem(*):1024; disk(*):1024; ports(*):[31000-32000]
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050448 24310 slave.cpp:1095]
> Registered with master [email protected]:36006; given agent ID
> 21665992-d47e-402f-a00c-6f8fab613019-S0
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050472 24310 fetcher.cpp:86]
> Clearing fetcher cache
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050478 24313 hierarchical.cpp:478]
> Added agent 21665992-d47e-402f-a00c-6f8fab613019-S0
> (ip-172-30-2-105.mesosphere.io) with cpus(*):2; mem(*):1024; disk(*):1024;
> ports(*):[31000-32000] (allocated: )
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050585 24316
> status_update_manager.cpp:184] Resuming sending status updates
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050616 24310 slave.cpp:1118]
> Checkpointing SlaveInfo to
> '/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/meta/slaves/21665992-d47e-402f-a00c-6f8fab613019-S0/slave.info'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050631 24311 replica.cpp:537]
> Replica received write request for position 4 from
> __req_res__(5648)@172.30.2.105:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050671 24313
> hierarchical.cpp:1643] No inverse offers to send out!
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050694 24313
> hierarchical.cpp:1215] Performed allocation for agent
> 21665992-d47e-402f-a00c-6f8fab613019-S0 in 191764ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050732 24310 slave.cpp:1155]
> Forwarding total oversubscribed resources
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050765 24312 master.cpp:5729]
> Sending 1 offers to framework 21665992-d47e-402f-a00c-6f8fab613019-0000
> (default) at [email protected]:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050825 24312 master.cpp:5006]
> Received update of agent 21665992-d47e-402f-a00c-6f8fab613019-S0 at
> slave(480)@172.30.2.105:36006 (ip-172-30-2-105.mesosphere.io) with total
> oversubscribed resources
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050896 24309 sched.cpp:917]
> Scheduler::resourceOffers took 20825ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050904 24312 hierarchical.cpp:542]
> Agent 21665992-d47e-402f-a00c-6f8fab613019-S0 (ip-172-30-2-105.mesosphere.io)
> updated with oversubscribed resources (total: cpus(*):2; mem(*):1024;
> disk(*):1024; ports(*):[31000-32000], allocated: cpus(*):2; mem(*):1024;
> disk(*):1024; ports(*):[31000-32000])
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050941 24312
> hierarchical.cpp:1548] No allocations performed
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050951 24312
> hierarchical.cpp:1643] No inverse offers to send out!
> [20:11:25]W: [Step 10/10] I0805 20:11:25.050963 24312
> hierarchical.cpp:1215] Performed allocation for agent
> 21665992-d47e-402f-a00c-6f8fab613019-S0 in 39673ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.051311 24312 master.cpp:3346]
> Processing ACCEPT call for offers: [ 21665992-d47e-402f-a00c-6f8fab613019-O0
> ] on agent 21665992-d47e-402f-a00c-6f8fab613019-S0 at
> slave(480)@172.30.2.105:36006 (ip-172-30-2-105.mesosphere.io) for framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 (default) at
> [email protected]:36006
> [20:11:25]W: [Step 10/10] I0805 20:11:25.051332 24312 master.cpp:2981]
> Authorizing framework principal 'test-principal' to launch task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2
> [20:11:25]W: [Step 10/10] I0805 20:11:25.051690 24309 master.cpp:7451]
> Adding task 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 with resources cpus(*):1;
> mem(*):128 on agent 21665992-d47e-402f-a00c-6f8fab613019-S0
> (ip-172-30-2-105.mesosphere.io)
> [20:11:25]W: [Step 10/10] I0805 20:11:25.051717 24309 master.cpp:3835]
> Launching task 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 (default) at
> [email protected]:36006 with
> resources cpus(*):1; mem(*):128 on agent
> 21665992-d47e-402f-a00c-6f8fab613019-S0 at slave(480)@172.30.2.105:36006
> (ip-172-30-2-105.mesosphere.io)
> [20:11:25]W: [Step 10/10] I0805 20:11:25.051810 24315 slave.cpp:1495] Got
> assigned task 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 for framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:25]W: [Step 10/10] I0805 20:11:25.051861 24314 hierarchical.cpp:924]
> Recovered cpus(*):1; mem(*):896; disk(*):1024; ports(*):[31000-32000] (total:
> cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated:
> cpus(*):1; mem(*):128) on agent 21665992-d47e-402f-a00c-6f8fab613019-S0 from
> framework 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:25]W: [Step 10/10] I0805 20:11:25.051882 24314 hierarchical.cpp:961]
> Framework 21665992-d47e-402f-a00c-6f8fab613019-0000 filtered agent
> 21665992-d47e-402f-a00c-6f8fab613019-S0 for 5secs
> [20:11:25]W: [Step 10/10] I0805 20:11:25.052016 24315 slave.cpp:1614]
> Launching task 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 for framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:25]W: [Step 10/10] I0805 20:11:25.052245 24315 paths.cpp:536] Trying
> to chown
> '/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/slaves/21665992-d47e-402f-a00c-6f8fab613019-S0/frameworks/21665992-d47e-402f-a00c-6f8fab613019-0000/executors/3b9069a1-abe8-4c37-ba1d-a84db1ee95c2/runs/cb771051-d88d-428a-8c0b-cca24f477811'
> to user 'root'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.053449 24311 leveldb.cpp:341]
> Persisting action (16 bytes) to leveldb took 2.663453ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.053488 24311 replica.cpp:708]
> Persisted action TRUNCATE at position 4
> [20:11:25]W: [Step 10/10] I0805 20:11:25.054006 24313 replica.cpp:691]
> Replica received learned notice for position 4 from @0.0.0.0:0
> [20:11:25]W: [Step 10/10] I0805 20:11:25.055517 24315 slave.cpp:5764]
> Launching executor '3b9069a1-abe8-4c37-ba1d-a84db1ee95c2' of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 with resources cpus(*):0.1;
> mem(*):32 in work directory
> '/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/slaves/21665992-d47e-402f-a00c-6f8fab613019-S0/frameworks/21665992-d47e-402f-a00c-6f8fab613019-0000/executors/3b9069a1-abe8-4c37-ba1d-a84db1ee95c2/runs/cb771051-d88d-428a-8c0b-cca24f477811'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.055673 24315 slave.cpp:1840]
> Queuing task '3b9069a1-abe8-4c37-ba1d-a84db1ee95c2' for executor
> '3b9069a1-abe8-4c37-ba1d-a84db1ee95c2' of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:25]W: [Step 10/10] I0805 20:11:25.055687 24310
> containerizer.cpp:786] Starting container
> 'cb771051-d88d-428a-8c0b-cca24f477811' for executor
> '3b9069a1-abe8-4c37-ba1d-a84db1ee95c2' of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:25]W: [Step 10/10] I0805 20:11:25.055707 24315 slave.cpp:848]
> Successfully attached file
> '/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/slaves/21665992-d47e-402f-a00c-6f8fab613019-S0/frameworks/21665992-d47e-402f-a00c-6f8fab613019-0000/executors/3b9069a1-abe8-4c37-ba1d-a84db1ee95c2/runs/cb771051-d88d-428a-8c0b-cca24f477811'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.055882 24315
> metadata_manager.cpp:167] Looking for image 'cirros'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.056037 24311
> registry_puller.cpp:236] Pulling image 'library/cirros' from
> 'docker-manifest://registry-1.docker.io:443library/cirros?latest#https' to
> '/tmp/mesos/store/docker/staging/rRyODt'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.057193 24313 leveldb.cpp:341]
> Persisting action (18 bytes) to leveldb took 2.141869ms
> [20:11:25]W: [Step 10/10] I0805 20:11:25.057449 24313 leveldb.cpp:399]
> Deleting ~2 keys from leveldb took 146047ns
> [20:11:25]W: [Step 10/10] I0805 20:11:25.057476 24313 replica.cpp:708]
> Persisted action TRUNCATE at position 4
> [20:11:25]W: [Step 10/10] I0805 20:11:25.438024 24316
> registry_puller.cpp:259] The manifest for image 'library/cirros' is '{
> [20:11:25]W: [Step 10/10] "schemaVersion": 1,
> [20:11:25]W: [Step 10/10] "name": "library/cirros",
> [20:11:25]W: [Step 10/10] "tag": "latest",
> [20:11:25]W: [Step 10/10] "architecture": "amd64",
> [20:11:25]W: [Step 10/10] "fsLayers": [
> [20:11:25]W: [Step 10/10] {
> [20:11:25]W: [Step 10/10] "blobSum":
> "sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4"
> [20:11:25]W: [Step 10/10] },
> [20:11:25]W: [Step 10/10] {
> [20:11:25]W: [Step 10/10] "blobSum":
> "sha256:b5a1edf1e076b8cd0a1befe7124b256c5757da5497a188c908d53643262047e1"
> [20:11:25]W: [Step 10/10] },
> [20:11:25]W: [Step 10/10] {
> [20:11:25]W: [Step 10/10] "blobSum":
> "sha256:e6cc72aea3e6702f07dc862041195b47deb7def56984860d1b4ff912fb458333"
> [20:11:25]W: [Step 10/10] },
> [20:11:25]W: [Step 10/10] {
> [20:11:25]W: [Step 10/10] "blobSum":
> "sha256:8c4568d4063684a72abcc5dbf16b74750d74ee600d4f520a5fad77308de9e195"
> [20:11:25]W: [Step 10/10] },
> [20:11:25]W: [Step 10/10] {
> [20:11:25]W: [Step 10/10] "blobSum":
> "sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4"
> [20:11:25]W: [Step 10/10] }
> [20:11:25]W: [Step 10/10] ],
> [20:11:25]W: [Step 10/10] "history": [
> [20:11:25]W: [Step 10/10] {
> [20:11:25]W: [Step 10/10] "v1Compatibility":
> "{\"architecture\":\"amd64\",\"author\":\"Eric Windisch
> \\[email protected]\\u003e\",\"config\":{\"Hostname\":\"8586a1739f82\",\"Domainname\":\"\",\"User\":\"\",\"AttachStdin\":false,\"AttachStdout\":false,\"AttachStderr\":false,\"Tty\":false,\"OpenStdin\":false,\"StdinOnce\":false,\"Env\":null,\"Cmd\":[\"/sbin/init\"],\"Image\":\"7725b0aea0a1124fba2a0ee33cd6c73822cfdb78ab14fdb6c612325f5ed7e8e4\",\"Volumes\":null,\"WorkingDir\":\"\",\"Entrypoint\":null,\"OnBuild\":null,\"Labels\":null},\"container\":\"08616e5819c6aab371bfd9ede6159bc2bb832911f50e3d88fcdb9057327361d4\",\"container_config\":{\"Hostname\":\"8586a1739f82\",\"Domainname\":\"\",\"User\":\"\",\"AttachStdin\":false,\"AttachStdout\":false,\"AttachStderr\":false,\"Tty\":false,\"OpenStdin\":false,\"StdinOnce\":false,\"Env\":null,\"Cmd\":[\"/bin/sh\",\"-c\",\"#(nop)
> CMD
> [\\\"/sbin/init\\\"]\"],\"Image\":\"7725b0aea0a1124fba2a0ee33cd6c73822cfdb78ab14fdb6c612325f5ed7e8e4\",\"Volumes\":null,\"WorkingDir\":\"\",\"Entrypoint\":null,\"OnBuild\":null,\"Labels\":null},\"created\":\"2016-01-04T21:25:07.075919325Z\",\"docker_version\":\"1.8.3\",\"id\":\"d8ca8144dee347ab43f0123099cc5c8d1b64b96c17da9637769519257006617e\",\"os\":\"linux\",\"parent\":\"500e7eced838c4822a111abdb64fce8e7f3c0ecaf3d47157331b0cd30ebac4dc\"}"
> [20:11:25]W: [Step 10/10] },
> [20:11:25]W: [Step 10/10] {
> [20:11:25]W: [Step 10/10] "v1Compatibility":
> "{\"id\":\"500e7eced838c4822a111abdb64fce8e7f3c0ecaf3d47157331b0cd30ebac4dc\",\"parent\":\"c42d375c72b4e709bc0eeda368591277fa73836dfd5597fe98e2524c8587536e\",\"created\":\"2016-01-04T21:25:06.327404242Z\",\"container_config\":{\"Cmd\":[\"/bin/sh
> -c sed -i '/is_lxc \\u0026\\u0026 lxc_netdown/d'
> /etc/init.d/rc.sysinit\"]},\"author\":\"Eric Windisch
> \\[email protected]\\u003e\"}"
> [20:11:25]W: [Step 10/10] },
> [20:11:25]W: [Step 10/10] {
> [20:11:25]W: [Step 10/10] "v1Compatibility":
> "{\"id\":\"c42d375c72b4e709bc0eeda368591277fa73836dfd5597fe98e2524c8587536e\",\"parent\":\"34fa5867b8b0888ea3b718df9ad2925b8f7f50b6583b7cbdfabd826bfe5c6de8\",\"created\":\"2016-01-04T21:25:04.222498861Z\",\"container_config\":{\"Cmd\":[\"/bin/sh
> -c rm /etc/rc3.d/S40-network\"]},\"author\":\"Eric Windisch
> \\[email protected]\\u003e\"}"
> [20:11:25]W: [Step 10/10] },
> [20:11:25]W: [Step 10/10] {
> [20:11:25]W: [Step 10/10] "v1Compatibility":
> "{\"id\":\"34fa5867b8b0888ea3b718df9ad2925b8f7f50b6583b7cbdfabd826bfe5c6de8\",\"parent\":\"3690474eb5b4b26fdfbd89c6e159e8cc376ca76ef48032a30fa6aafd56337880\",\"created\":\"2016-01-04T21:25:01.412759058Z\",\"container_config\":{\"Cmd\":[\"/bin/sh
> -c #(nop) ADD
> file:65515284d0bebdd40442eb13bb6a9e6596ff52e7a6c847363d82844ed88a169e in
> /\"]},\"author\":\"Eric Windisch \\[email protected]\\u003e\"}"
> [20:11:25]W: [Step 10/10] },
> [20:11:25]W: [Step 10/10] {
> [20:11:25]W: [Step 10/10] "v1Compatibility":
> "{\"id\":\"3690474eb5b4b26fdfbd89c6e159e8cc376ca76ef48032a30fa6aafd56337880\",\"created\":\"2016-01-04T21:25:00.01231519Z\",\"container_config\":{\"Cmd\":[\"/bin/sh
> -c #(nop) MAINTAINER Eric Windisch
> \\[email protected]\\u003e\"]},\"author\":\"Eric Windisch
> \\[email protected]\\u003e\"}"
> [20:11:25]W: [Step 10/10] }
> [20:11:25]W: [Step 10/10] ],
> [20:11:25]W: [Step 10/10] "signatures": [
> [20:11:25]W: [Step 10/10] {
> [20:11:25]W: [Step 10/10] "header": {
> [20:11:25]W: [Step 10/10] "jwk": {
> [20:11:25]W: [Step 10/10] "crv": "P-256",
> [20:11:25]W: [Step 10/10] "kid":
> "Z3VA:KNRP:DUR5:ZGOH:YBO6:UTHO:V56S:XKQF:ZHQ4:OCYL:STK4:QFUZ",
> [20:11:25]W: [Step 10/10] "kty": "EC",
> [20:11:25]W: [Step 10/10] "x":
> "t9C-E0_BCULU0WzXFtKSDBnG1mNmoBurH4aFv7Y7QPw",
> [20:11:25]W: [Step 10/10] "y":
> "tYhiPXODH2tgNPDrl_ScfZUDh6KL1Xl1wUAprIN8urM"
> [20:11:25]W: [Step 10/10] },
> [20:11:25]W: [Step 10/10] "alg": "ES256"
> [20:11:25]W: [Step 10/10] },
> [20:11:25]W: [Step 10/10] "signature":
> "Vm2dYcwRmiJLmLIWHZF8yx9f32JykG9qWDLP4nVNT_8x_3QF3CLG8g0wBIOLc85gR-I6kqB_4Ryhca6O1XNuaQ",
> [20:11:25]W: [Step 10/10] "protected":
> "eyJmb3JtYXRMZW5ndGgiOjM2MzEsImZvcm1hdFRhaWwiOiJDbjAiLCJ0aW1lIjoiMjAxNi0wOC0wNVQyMDoxMToyNVoifQ"
> [20:11:25]W: [Step 10/10] }
> [20:11:25]W: [Step 10/10] ]
> [20:11:25]W: [Step 10/10] }'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.438086 24316
> registry_puller.cpp:369] Fetching blob
> 'sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4' for
> layer 'd8ca8144dee347ab43f0123099cc5c8d1b64b96c17da9637769519257006617e' of
> image 'library/cirros'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.438100 24316
> registry_puller.cpp:369] Fetching blob
> 'sha256:b5a1edf1e076b8cd0a1befe7124b256c5757da5497a188c908d53643262047e1' for
> layer '500e7eced838c4822a111abdb64fce8e7f3c0ecaf3d47157331b0cd30ebac4dc' of
> image 'library/cirros'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.438109 24316
> registry_puller.cpp:369] Fetching blob
> 'sha256:e6cc72aea3e6702f07dc862041195b47deb7def56984860d1b4ff912fb458333' for
> layer 'c42d375c72b4e709bc0eeda368591277fa73836dfd5597fe98e2524c8587536e' of
> image 'library/cirros'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.438118 24316
> registry_puller.cpp:369] Fetching blob
> 'sha256:8c4568d4063684a72abcc5dbf16b74750d74ee600d4f520a5fad77308de9e195' for
> layer '34fa5867b8b0888ea3b718df9ad2925b8f7f50b6583b7cbdfabd826bfe5c6de8' of
> image 'library/cirros'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.438127 24316
> registry_puller.cpp:369] Fetching blob
> 'sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4' for
> layer '3690474eb5b4b26fdfbd89c6e159e8cc376ca76ef48032a30fa6aafd56337880' of
> image 'library/cirros'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.942389 24309
> registry_puller.cpp:306] Extracting layer tar ball
> '/tmp/mesos/store/docker/staging/rRyODt/sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4
> to rootfs
> '/tmp/mesos/store/docker/staging/rRyODt/d8ca8144dee347ab43f0123099cc5c8d1b64b96c17da9637769519257006617e/rootfs'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.944542 24309
> registry_puller.cpp:306] Extracting layer tar ball
> '/tmp/mesos/store/docker/staging/rRyODt/sha256:b5a1edf1e076b8cd0a1befe7124b256c5757da5497a188c908d53643262047e1
> to rootfs
> '/tmp/mesos/store/docker/staging/rRyODt/500e7eced838c4822a111abdb64fce8e7f3c0ecaf3d47157331b0cd30ebac4dc/rootfs'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.946662 24309
> registry_puller.cpp:306] Extracting layer tar ball
> '/tmp/mesos/store/docker/staging/rRyODt/sha256:e6cc72aea3e6702f07dc862041195b47deb7def56984860d1b4ff912fb458333
> to rootfs
> '/tmp/mesos/store/docker/staging/rRyODt/c42d375c72b4e709bc0eeda368591277fa73836dfd5597fe98e2524c8587536e/rootfs'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.948341 24309
> registry_puller.cpp:306] Extracting layer tar ball
> '/tmp/mesos/store/docker/staging/rRyODt/sha256:8c4568d4063684a72abcc5dbf16b74750d74ee600d4f520a5fad77308de9e195
> to rootfs
> '/tmp/mesos/store/docker/staging/rRyODt/34fa5867b8b0888ea3b718df9ad2925b8f7f50b6583b7cbdfabd826bfe5c6de8/rootfs'
> [20:11:25]W: [Step 10/10] I0805 20:11:25.950039 24309
> registry_puller.cpp:306] Extracting layer tar ball
> '/tmp/mesos/store/docker/staging/rRyODt/sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4
> to rootfs
> '/tmp/mesos/store/docker/staging/rRyODt/3690474eb5b4b26fdfbd89c6e159e8cc376ca76ef48032a30fa6aafd56337880/rootfs'
> [20:11:26]W: [Step 10/10] I0805 20:11:26.006029 24313
> hierarchical.cpp:1734] Filtered offer with cpus(*):1; mem(*):896;
> disk(*):1024; ports(*):[31000-32000] on agent
> 21665992-d47e-402f-a00c-6f8fab613019-S0 for framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.006069 24313
> hierarchical.cpp:1548] No allocations performed
> [20:11:26]W: [Step 10/10] I0805 20:11:26.006075 24313
> hierarchical.cpp:1643] No inverse offers to send out!
> [20:11:26]W: [Step 10/10] I0805 20:11:26.006089 24313
> hierarchical.cpp:1192] Performed allocation for 1 agents in 196593ns
> [20:11:26]W: [Step 10/10] I0805 20:11:26.044724 24314
> metadata_manager.cpp:155] Successfully cached image 'cirros'
> [20:11:26]W: [Step 10/10] I0805 20:11:26.045126 24314 provisioner.cpp:312]
> Provisioning image rootfs
> '/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/provisioner/containers/cb771051-d88d-428a-8c0b-cca24f477811/backends/aufs/rootfses/6541ef43-5e41-4151-ad78-68d8b8542ed4'
> for container cb771051-d88d-428a-8c0b-cca24f477811 using the 'aufs' backend
> [20:11:26]W: [Step 10/10] I0805 20:11:26.045382 24315 aufs.cpp:152]
> Provisioning image rootfs with aufs:
> 'dirs=/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/provisioner/containers/cb771051-d88d-428a-8c0b-cca24f477811/backends/aufs/scratch/6541ef43-5e41-4151-ad78-68d8b8542ed4/workdir:/tmp/mesos/store/docker/layers/d8ca8144dee347ab43f0123099cc5c8d1b64b96c17da9637769519257006617e/rootfs:/tmp/mesos/store/docker/layers/500e7eced838c4822a111abdb64fce8e7f3c0ecaf3d47157331b0cd30ebac4dc/rootfs:/tmp/mesos/store/docker/layers/c42d375c72b4e709bc0eeda368591277fa73836dfd5597fe98e2524c8587536e/rootfs:/tmp/mesos/store/docker/layers/34fa5867b8b0888ea3b718df9ad2925b8f7f50b6583b7cbdfabd826bfe5c6de8/rootfs:/tmp/mesos/store/docker/layers/3690474eb5b4b26fdfbd89c6e159e8cc376ca76ef48032a30fa6aafd56337880/rootfs'
> [20:11:26]W: [Step 10/10] I0805 20:11:26.052793 24316
> containerizer.cpp:1299] Launching 'mesos-containerizer' with flags
> '--command="{"arguments":["mesos-executor","--launcher_dir=\/mnt\/teamcity\/work\/4240ba9ddd0997c3\/build\/src","--sandbox_directory=\/mnt\/mesos\/sandbox","--user=root","--rootfs=\/mnt\/teamcity\/temp\/buildTmp\/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf\/provisioner\/containers\/cb771051-d88d-428a-8c0b-cca24f477811\/backends\/aufs\/rootfses\/6541ef43-5e41-4151-ad78-68d8b8542ed4"],"shell":false,"user":"root","value":"\/mnt\/teamcity\/work\/4240ba9ddd0997c3\/build\/src\/mesos-executor"}"
> --help="false" --pipe_read="31" --pipe_write="109"
> --pre_exec_commands="[{"arguments":["mesos-containerizer","mount","--help=false","--operation=make-rslave","--path=\/"],"shell":false,"value":"\/mnt\/teamcity\/work\/4240ba9ddd0997c3\/build\/src\/mesos-containerizer"},{"arguments":["mount","-n","--rbind","\/mnt\/teamcity\/temp\/buildTmp\/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf\/slaves\/21665992-d47e-402f-a00c-6f8fab613019-S0\/frameworks\/21665992-d47e-402f-a00c-6f8fab613019-0000\/executors\/3b9069a1-abe8-4c37-ba1d-a84db1ee95c2\/runs\/cb771051-d88d-428a-8c0b-cca24f477811","\/mnt\/teamcity\/temp\/buildTmp\/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf\/provisioner\/containers\/cb771051-d88d-428a-8c0b-cca24f477811\/backends\/aufs\/rootfses\/6541ef43-5e41-4151-ad78-68d8b8542ed4\/mnt\/mesos\/sandbox"],"shell":false,"value":"mount"}]"
> --unshare_namespace_mnt="false" --user="root"
> --working_directory="/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/slaves/21665992-d47e-402f-a00c-6f8fab613019-S0/frameworks/21665992-d47e-402f-a00c-6f8fab613019-0000/executors/3b9069a1-abe8-4c37-ba1d-a84db1ee95c2/runs/cb771051-d88d-428a-8c0b-cca24f477811"'
> [20:11:26]W: [Step 10/10] I0805 20:11:26.052883 24316
> linux_launcher.cpp:281] Cloning child process with flags = CLONE_NEWNS
> [20:11:26] : [Step 10/10] Executing pre-exec command
> '{"arguments":["mesos-containerizer","mount","--help=false","--operation=make-rslave","--path=\/"],"shell":false,"value":"\/mnt\/teamcity\/work\/4240ba9ddd0997c3\/build\/src\/mesos-containerizer"}'
> [20:11:26] : [Step 10/10] Executing pre-exec command
> '{"arguments":["mount","-n","--rbind","\/mnt\/teamcity\/temp\/buildTmp\/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf\/slaves\/21665992-d47e-402f-a00c-6f8fab613019-S0\/frameworks\/21665992-d47e-402f-a00c-6f8fab613019-0000\/executors\/3b9069a1-abe8-4c37-ba1d-a84db1ee95c2\/runs\/cb771051-d88d-428a-8c0b-cca24f477811","\/mnt\/teamcity\/temp\/buildTmp\/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf\/provisioner\/containers\/cb771051-d88d-428a-8c0b-cca24f477811\/backends\/aufs\/rootfses\/6541ef43-5e41-4151-ad78-68d8b8542ed4\/mnt\/mesos\/sandbox"],"shell":false,"value":"mount"}'
> [20:11:26]W: [Step 10/10] I0805 20:11:26.379375 9819 exec.cpp:162]
> Version: 1.1.0
> [20:11:26]W: [Step 10/10] I0805 20:11:26.379905 24309 slave.cpp:2881] Got
> registration for executor '3b9069a1-abe8-4c37-ba1d-a84db1ee95c2' of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 from executor(1)@172.30.2.105:45519
> [20:11:26]W: [Step 10/10] I0805 20:11:26.380353 9824 exec.cpp:237]
> Executor registered on agent 21665992-d47e-402f-a00c-6f8fab613019-S0
> [20:11:26]W: [Step 10/10] I0805 20:11:26.380439 24316 slave.cpp:2005]
> Sending queued task '3b9069a1-abe8-4c37-ba1d-a84db1ee95c2' to executor
> '3b9069a1-abe8-4c37-ba1d-a84db1ee95c2' of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 at executor(1)@172.30.2.105:45519
> [20:11:26] : [Step 10/10] Received SUBSCRIBED event
> [20:11:26] : [Step 10/10] Subscribed executor on
> ip-172-30-2-105.mesosphere.io
> [20:11:26] : [Step 10/10] Received LAUNCH event
> [20:11:26] : [Step 10/10] Starting task 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2
> [20:11:26] : [Step 10/10]
> /mnt/teamcity/work/4240ba9ddd0997c3/build/src/mesos-containerizer launch
> --command="{"arguments":["test","!","-f","\/etc\/rc3.d\/S40-network"],"shell":false,"value":"\/usr\/bin\/test"}"
> --help="false"
> --rootfs="/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/provisioner/containers/cb771051-d88d-428a-8c0b-cca24f477811/backends/aufs/rootfses/6541ef43-5e41-4151-ad78-68d8b8542ed4"
> --unshare_namespace_mnt="false" --user="root"
> --working_directory="/mnt/mesos/sandbox"
> [20:11:26] : [Step 10/10] Forked command at 9828
> [20:11:26]W: [Step 10/10] I0805 20:11:26.385869 24310 slave.cpp:3264]
> Handling status update TASK_RUNNING (UUID:
> 0f5f19fa-2bfa-45cd-9855-c34737304f52) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 from executor(1)@172.30.2.105:45519
> [20:11:26]W: [Step 10/10] I0805 20:11:26.386337 24315
> status_update_manager.cpp:323] Received status update TASK_RUNNING (UUID:
> 0f5f19fa-2bfa-45cd-9855-c34737304f52) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.386355 24315
> status_update_manager.cpp:500] Creating StatusUpdate stream for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.386513 24315
> status_update_manager.cpp:377] Forwarding update TASK_RUNNING (UUID:
> 0f5f19fa-2bfa-45cd-9855-c34737304f52) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 to the agent
> [20:11:26]W: [Step 10/10] I0805 20:11:26.386613 24314 slave.cpp:3657]
> Forwarding the update TASK_RUNNING (UUID:
> 0f5f19fa-2bfa-45cd-9855-c34737304f52) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 to [email protected]:36006
> [20:11:26]W: [Step 10/10] I0805 20:11:26.386684 24314 slave.cpp:3551]
> Status update manager successfully handled status update TASK_RUNNING (UUID:
> 0f5f19fa-2bfa-45cd-9855-c34737304f52) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.386706 24314 slave.cpp:3567]
> Sending acknowledgement for status update TASK_RUNNING (UUID:
> 0f5f19fa-2bfa-45cd-9855-c34737304f52) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 to executor(1)@172.30.2.105:45519
> [20:11:26]W: [Step 10/10] I0805 20:11:26.386802 24311 master.cpp:5141]
> Status update TASK_RUNNING (UUID: 0f5f19fa-2bfa-45cd-9855-c34737304f52) for
> task 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 from agent
> 21665992-d47e-402f-a00c-6f8fab613019-S0 at slave(480)@172.30.2.105:36006
> (ip-172-30-2-105.mesosphere.io)
> [20:11:26]W: [Step 10/10] I0805 20:11:26.386826 24311 master.cpp:5203]
> Forwarding status update TASK_RUNNING (UUID:
> 0f5f19fa-2bfa-45cd-9855-c34737304f52) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.386890 24311 master.cpp:6845]
> Updating the state of task 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 (latest state: TASK_RUNNING, status
> update state: TASK_RUNNING)
> [20:11:26]W: [Step 10/10] I0805 20:11:26.386998 24315 sched.cpp:1025]
> Scheduler::statusUpdate took 50116ns
> [20:11:26]W: [Step 10/10] I0805 20:11:26.387138 24315 master.cpp:4266]
> Processing ACKNOWLEDGE call 0f5f19fa-2bfa-45cd-9855-c34737304f52 for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 (default) at
> [email protected]:36006 on agent
> 21665992-d47e-402f-a00c-6f8fab613019-S0
> [20:11:26]W: [Step 10/10] I0805 20:11:26.388357 24313
> status_update_manager.cpp:395] Received status update acknowledgement (UUID:
> 0f5f19fa-2bfa-45cd-9855-c34737304f52) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.388425 24313 slave.cpp:2650]
> Status update manager successfully handled status update acknowledgement
> (UUID: 0f5f19fa-2bfa-45cd-9855-c34737304f52) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26] : [Step 10/10] Changing root to
> /mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/provisioner/containers/cb771051-d88d-428a-8c0b-cca24f477811/backends/aufs/rootfses/6541ef43-5e41-4151-ad78-68d8b8542ed4
> [20:11:26] : [Step 10/10] Command exited with status 1 (pid: 9828)
> [20:11:26]W: [Step 10/10] I0805 20:11:26.486747 24311 slave.cpp:3264]
> Handling status update TASK_FAILED (UUID:
> 9a8b3240-f4f2-4457-a90f-16cbf09d134d) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 from executor(1)@172.30.2.105:45519
> [20:11:26]W: [Step 10/10] I0805 20:11:26.487098 24313 slave.cpp:6104]
> Terminating task 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2
> [20:11:26]W: [Step 10/10] I0805 20:11:26.487478 24315
> status_update_manager.cpp:323] Received status update TASK_FAILED (UUID:
> 9a8b3240-f4f2-4457-a90f-16cbf09d134d) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.487525 24315
> status_update_manager.cpp:377] Forwarding update TASK_FAILED (UUID:
> 9a8b3240-f4f2-4457-a90f-16cbf09d134d) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 to the agent
> [20:11:26]W: [Step 10/10] I0805 20:11:26.487591 24314 slave.cpp:3657]
> Forwarding the update TASK_FAILED (UUID:
> 9a8b3240-f4f2-4457-a90f-16cbf09d134d) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 to [email protected]:36006
> [20:11:26]W: [Step 10/10] I0805 20:11:26.487664 24314 slave.cpp:3551]
> Status update manager successfully handled status update TASK_FAILED (UUID:
> 9a8b3240-f4f2-4457-a90f-16cbf09d134d) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26] : [Step 10/10]
> ../../src/tests/containerizer/provisioner_docker_tests.cpp:625: Failure
> [20:11:26]W: [Step 10/10] I0805 20:11:26.487684 24314 slave.cpp:3567]
> Sending acknowledgement for status update TASK_FAILED (UUID:
> 9a8b3240-f4f2-4457-a90f-16cbf09d134d) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 to executor(1)@172.30.2.105:45519
> [20:11:26] : [Step 10/10] Value of: statusFinished->state()
> [20:11:26] : [Step 10/10] Actual: TASK_FAILED
> [20:11:26]W: [Step 10/10] I0805 20:11:26.487730 24309 master.cpp:5141]
> Status update TASK_FAILED (UUID: 9a8b3240-f4f2-4457-a90f-16cbf09d134d) for
> task 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 from agent
> 21665992-d47e-402f-a00c-6f8fab613019-S0 at slave(480)@172.30.2.105:36006
> (ip-172-30-2-105.mesosphere.io)
> [20:11:26] : [Step 10/10] Expected: TASK_FINISHED
> [20:11:26]W: [Step 10/10] I0805 20:11:26.487756 24309 master.cpp:5203]
> Forwarding status update TASK_FAILED (UUID:
> 9a8b3240-f4f2-4457-a90f-16cbf09d134d) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.487802 24309 master.cpp:6845]
> Updating the state of task 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 (latest state: TASK_FAILED, status
> update state: TASK_FAILED)
> [20:11:26]W: [Step 10/10] I0805 20:11:26.487908 24310 sched.cpp:1025]
> Scheduler::statusUpdate took 44522ns
> [20:11:26]W: [Step 10/10] I0805 20:11:26.487980 24312 hierarchical.cpp:924]
> Recovered cpus(*):1; mem(*):128 (total: cpus(*):2; mem(*):1024; disk(*):1024;
> ports(*):[31000-32000], allocated: ) on agent
> 21665992-d47e-402f-a00c-6f8fab613019-S0 from framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488000 24313 master.cpp:4266]
> Processing ACKNOWLEDGE call 9a8b3240-f4f2-4457-a90f-16cbf09d134d for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 (default) at
> [email protected]:36006 on agent
> 21665992-d47e-402f-a00c-6f8fab613019-S0
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488028 24313 master.cpp:6911]
> Removing task 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 with resources cpus(*):1;
> mem(*):128 of framework 21665992-d47e-402f-a00c-6f8fab613019-0000 on agent
> 21665992-d47e-402f-a00c-6f8fab613019-S0 at slave(480)@172.30.2.105:36006
> (ip-172-30-2-105.mesosphere.io)
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488126 24295 sched.cpp:1987] Asked
> to stop the driver
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488155 24310
> status_update_manager.cpp:395] Received status update acknowledgement (UUID:
> 9a8b3240-f4f2-4457-a90f-16cbf09d134d) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488179 24312 sched.cpp:1187]
> Stopping framework 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488198 24310
> status_update_manager.cpp:531] Cleaning up status update stream for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488283 24314 master.cpp:6304]
> Processing TEARDOWN call for framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 (default) at
> [email protected]:36006
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488302 24314 master.cpp:6316]
> Removing framework 21665992-d47e-402f-a00c-6f8fab613019-0000 (default) at
> [email protected]:36006
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488351 24313 hierarchical.cpp:382]
> Deactivated framework 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488355 24309 slave.cpp:2650]
> Status update manager successfully handled status update acknowledgement
> (UUID: 9a8b3240-f4f2-4457-a90f-16cbf09d134d) for task
> 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2 of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488371 24309 slave.cpp:6145]
> Completing task 3b9069a1-abe8-4c37-ba1d-a84db1ee95c2
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488409 24309 slave.cpp:2218] Asked
> to shut down framework 21665992-d47e-402f-a00c-6f8fab613019-0000 by
> [email protected]:36006
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488425 24309 slave.cpp:2243]
> Shutting down framework 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488436 24309 slave.cpp:4460]
> Shutting down executor '3b9069a1-abe8-4c37-ba1d-a84db1ee95c2' of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 at executor(1)@172.30.2.105:45519
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488445 24314 hierarchical.cpp:333]
> Removed framework 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.488981 24309
> containerizer.cpp:1637] Destroying container
> 'cb771051-d88d-428a-8c0b-cca24f477811'
> [20:11:26]W: [Step 10/10] I0805 20:11:26.489099 9822 exec.cpp:414]
> Executor asked to shutdown
> [20:11:26]W: [Step 10/10] I0805 20:11:26.490057 24310 cgroups.cpp:2678]
> Freezing cgroup
> /sys/fs/cgroup/freezer/mesos/cb771051-d88d-428a-8c0b-cca24f477811
> [20:11:26]W: [Step 10/10] I0805 20:11:26.491039 24313 cgroups.cpp:1412]
> Successfully froze cgroup
> /sys/fs/cgroup/freezer/mesos/cb771051-d88d-428a-8c0b-cca24f477811 after
> 958976ns
> [20:11:26]W: [Step 10/10] I0805 20:11:26.492154 24311 cgroups.cpp:2696]
> Thawing cgroup
> /sys/fs/cgroup/freezer/mesos/cb771051-d88d-428a-8c0b-cca24f477811
> [20:11:26]W: [Step 10/10] I0805 20:11:26.493185 24314 cgroups.cpp:1441]
> Successfully thawed cgroup
> /sys/fs/cgroup/freezer/mesos/cb771051-d88d-428a-8c0b-cca24f477811 after
> 1.014016ms
> [20:11:26]W: [Step 10/10] I0805 20:11:26.505236 24311 slave.cpp:3785] Got
> exited event for executor(1)@172.30.2.105:45519
> [20:11:26]W: [Step 10/10] I0805 20:11:26.545552 24313
> containerizer.cpp:1878] Executor for container
> 'cb771051-d88d-428a-8c0b-cca24f477811' has exited
> [20:11:26]W: [Step 10/10] I0805 20:11:26.545567 24313
> containerizer.cpp:1633] Destroy has already been initiated for
> 'cb771051-d88d-428a-8c0b-cca24f477811'
> [20:11:26]W: [Step 10/10] I0805 20:11:26.546809 24314 provisioner.cpp:455]
> Destroying container rootfs at
> '/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/provisioner/containers/cb771051-d88d-428a-8c0b-cca24f477811/backends/aufs/rootfses/6541ef43-5e41-4151-ad78-68d8b8542ed4'
> for container cb771051-d88d-428a-8c0b-cca24f477811
> [20:11:26]W: [Step 10/10] I0805 20:11:26.581281 24312 slave.cpp:4142]
> Executor '3b9069a1-abe8-4c37-ba1d-a84db1ee95c2' of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 terminated with signal Killed
> [20:11:26]W: [Step 10/10] I0805 20:11:26.581300 24312 slave.cpp:4246]
> Cleaning up executor '3b9069a1-abe8-4c37-ba1d-a84db1ee95c2' of framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000 at executor(1)@172.30.2.105:45519
> [20:11:26]W: [Step 10/10] I0805 20:11:26.581406 24309 gc.cpp:55] Scheduling
> '/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/slaves/21665992-d47e-402f-a00c-6f8fab613019-S0/frameworks/21665992-d47e-402f-a00c-6f8fab613019-0000/executors/3b9069a1-abe8-4c37-ba1d-a84db1ee95c2/runs/cb771051-d88d-428a-8c0b-cca24f477811'
> for gc 6.99999327130667days in the future
> [20:11:26]W: [Step 10/10] I0805 20:11:26.581437 24312 slave.cpp:4334]
> Cleaning up framework 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.581456 24309 gc.cpp:55] Scheduling
> '/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/slaves/21665992-d47e-402f-a00c-6f8fab613019-S0/frameworks/21665992-d47e-402f-a00c-6f8fab613019-0000/executors/3b9069a1-abe8-4c37-ba1d-a84db1ee95c2'
> for gc 6.99999327068148days in the future
> [20:11:26]W: [Step 10/10] I0805 20:11:26.581508 24310
> status_update_manager.cpp:285] Closing status update streams for framework
> 21665992-d47e-402f-a00c-6f8fab613019-0000
> [20:11:26]W: [Step 10/10] I0805 20:11:26.581571 24316 gc.cpp:55] Scheduling
> '/mnt/teamcity/temp/buildTmp/ProvisionerDockerPullerTest_ROOT_INTERNET_CURL_Whiteout_Aqlqpf/slaves/21665992-d47e-402f-a00c-6f8fab613019-S0/frameworks/21665992-d47e-402f-a00c-6f8fab613019-0000'
> for gc 6.99999326983704days in the future
> [20:11:26]W: [Step 10/10] I0805 20:11:26.581689 24295 slave.cpp:767] Agent
> terminating
> [20:11:26]W: [Step 10/10] I0805 20:11:26.581763 24309 master.cpp:1245]
> Agent 21665992-d47e-402f-a00c-6f8fab613019-S0 at
> slave(480)@172.30.2.105:36006 (ip-172-30-2-105.mesosphere.io) disconnected
> [20:11:26]W: [Step 10/10] I0805 20:11:26.581775 24309 master.cpp:2785]
> Disconnecting agent 21665992-d47e-402f-a00c-6f8fab613019-S0 at
> slave(480)@172.30.2.105:36006 (ip-172-30-2-105.mesosphere.io)
> [20:11:26]W: [Step 10/10] I0805 20:11:26.581810 24309 master.cpp:2804]
> Deactivating agent 21665992-d47e-402f-a00c-6f8fab613019-S0 at
> slave(480)@172.30.2.105:36006 (ip-172-30-2-105.mesosphere.io)
> [20:11:26]W: [Step 10/10] I0805 20:11:26.581904 24309 hierarchical.cpp:571]
> Agent 21665992-d47e-402f-a00c-6f8fab613019-S0 deactivated
> [20:11:26]W: [Step 10/10] I0805 20:11:26.583799 24295 master.cpp:1092]
> Master terminating
> [20:11:26]W: [Step 10/10] I0805 20:11:26.583896 24315 hierarchical.cpp:510]
> Removed agent 21665992-d47e-402f-a00c-6f8fab613019-S0
> [20:11:26] : [Step 10/10] [ FAILED ]
> ProvisionerDockerPullerTest.ROOT_INTERNET_CURL_Whiteout (1599 ms)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
