See <https://builds.apache.org/job/Mesos-Buildbot/BUILDTOOL=cmake,COMPILER=gcc,CONFIGURATION=--verbose,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1,OS=ubuntu%3A14.04,label_exp=(docker%7C%7CHadoop)&&(!ubuntu-us1)&&(!ubuntu-eu2)/3411/display/redirect?page=changes>
Changes: [alexr] Improved failure message in `MesosContainerizer::remove()`. [alexr] Improved the wording in COMMAND health check logs. [alexr] Added support for COMMAND health checks to default executor. [alexr] Enabled pause/resume for health checks. [alexr] Made COMMAND health checks resilient to agent failovers. [alexr] Refrained from reusing check's `ContainerID` in COMMAND health checks. [alexr] Docker environment gets passed on docker run command. [alexr] Removed containerizer flag logging to prevent leak of sensitive data. ------------------------------------------ [...truncated 22.31 MB...] I0324 06:19:39.260789 25374 slave.cpp:210] Mesos agent started on (663)@172.17.0.2:45745 I0324 06:19:39.260887 25371 scheduler.cpp:184] Version: 1.3.0 I0324 06:19:39.260810 25374 slave.cpp:211] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://"; --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/ContentType_SchedulerTest_KillTask_0_ayZDFx/credential" --default_role="*" --disk_watch_interval="1mins" --docker="docker" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/ContentType_SchedulerTest_KillTask_0_ayZDFx/fetch" --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks" --gc_disk_headroom="0.1" --hadoop_home="" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_command_executor="false" --http_credentials="/tmp/ContentType_SchedulerTest_KillTask_0_ayZDFx/http_credentials" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posix" --launcher_dir="/mesos/build/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --qos_correction_interval_min="0ns" --quiet="false" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/ContentType_SchedulerTest_KillTask_0_ayZDFx" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/ContentType_SchedulerTest_KillTask_0_DE5gth" I0324 06:19:39.261224 25375 scheduler.cpp:470] New master detected at [email protected]:45745 I0324 06:19:39.261240 25374 credentials.hpp:86] Loading credential for authentication from '/tmp/ContentType_SchedulerTest_KillTask_0_ayZDFx/credential' I0324 06:19:39.261247 25375 scheduler.cpp:479] Waiting for 0ns before initiating a re-(connection) attempt with the master I0324 06:19:39.261332 25374 slave.cpp:243] Agent using credential for: test-principal I0324 06:19:39.261350 25374 credentials.hpp:37] Loading credentials for authentication from '/tmp/ContentType_SchedulerTest_KillTask_0_ayZDFx/http_credentials' I0324 06:19:39.261499 25374 http.cpp:957] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' I0324 06:19:39.261557 25374 http.cpp:957] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readwrite' I0324 06:19:39.262156 25374 slave.cpp:430] Agent resources: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] I0324 06:19:39.262199 25374 slave.cpp:438] Agent attributes: [ ] I0324 06:19:39.262207 25374 slave.cpp:443] Agent hostname: 56e011c53567 I0324 06:19:39.262279 25372 status_update_manager.cpp:177] Pausing sending status updates I0324 06:19:39.262658 25384 state.cpp:62] Recovering state from '/tmp/ContentType_SchedulerTest_KillTask_0_DE5gth/meta' I0324 06:19:39.263010 25378 status_update_manager.cpp:203] Recovering status update manager I0324 06:19:39.263264 25384 scheduler.cpp:361] Connected with the master at http://172.17.0.2:45745/master/api/v1/scheduler I0324 06:19:39.263347 25378 slave.cpp:5638] Finished recovery I0324 06:19:39.263782 25378 slave.cpp:5820] Querying resource estimator for oversubscribable resources I0324 06:19:39.263928 25378 slave.cpp:821] New master detected at [email protected]:45745 I0324 06:19:39.263936 25386 status_update_manager.cpp:177] Pausing sending status updates I0324 06:19:39.263972 25378 slave.cpp:856] Detecting new master I0324 06:19:39.264017 25387 scheduler.cpp:243] Sending SUBSCRIBE call to http://172.17.0.2:45745/master/api/v1/scheduler I0324 06:19:39.264102 25378 slave.cpp:5834] Received oversubscribable resources {} from the resource estimator I0324 06:19:39.264482 25384 process.cpp:3705] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' I0324 06:19:39.264942 25372 http.cpp:440] HTTP POST for /master/api/v1/scheduler from 172.17.0.2:50911 I0324 06:19:39.265025 25372 master.cpp:2517] Received subscription request for HTTP framework 'default' I0324 06:19:39.265054 25372 master.cpp:2201] Authorizing framework principal 'test-principal' to receive offers for roles '{ * }' I0324 06:19:39.265241 25372 master.cpp:2632] Subscribing framework 'default' with checkpointing disabled and capabilities [ ] I0324 06:19:39.265416 25373 hierarchical.cpp:271] Added framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.265444 25375 master.hpp:2179] Sending heartbeat to 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.265489 25373 hierarchical.cpp:1862] No allocations performed I0324 06:19:39.265534 25373 hierarchical.cpp:1952] No inverse offers to send out! I0324 06:19:39.265583 25373 hierarchical.cpp:1446] Performed allocation for 0 agents in 101164ns I0324 06:19:39.265931 25384 scheduler.cpp:676] Enqueuing event SUBSCRIBED received from http://172.17.0.2:45745/master/api/v1/scheduler I0324 06:19:39.266176 25384 scheduler.cpp:676] Enqueuing event HEARTBEAT received from http://172.17.0.2:45745/master/api/v1/scheduler I0324 06:19:39.267050 25384 slave.cpp:883] Authenticating with master [email protected]:45745 I0324 06:19:39.267082 25384 slave.cpp:894] Using default CRAM-MD5 authenticatee I0324 06:19:39.267174 25379 authenticatee.cpp:121] Creating new client SASL connection I0324 06:19:39.267354 25379 master.cpp:7252] Authenticating slave(663)@172.17.0.2:45745 I0324 06:19:39.267421 25374 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(1246)@172.17.0.2:45745 I0324 06:19:39.267542 25382 authenticator.cpp:98] Creating new server SASL connection I0324 06:19:39.267725 25378 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I0324 06:19:39.267752 25378 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I0324 06:19:39.267809 25384 authenticator.cpp:204] Received SASL authentication start I0324 06:19:39.267879 25384 authenticator.cpp:326] Authentication requires more steps I0324 06:19:39.267968 25378 authenticatee.cpp:259] Received SASL authentication step I0324 06:19:39.268056 25387 authenticator.cpp:232] Received SASL authentication step I0324 06:19:39.268102 25387 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '56e011c53567' server FQDN: '56e011c53567' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0324 06:19:39.268121 25387 auxprop.cpp:181] Looking up auxiliary property '*userPassword' I0324 06:19:39.268136 25387 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0324 06:19:39.268160 25387 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: '56e011c53567' server FQDN: '56e011c53567' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0324 06:19:39.268172 25387 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0324 06:19:39.268180 25387 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0324 06:19:39.268196 25387 authenticator.cpp:318] Authentication success I0324 06:19:39.268265 25378 authenticatee.cpp:299] Authentication success I0324 06:19:39.268290 25373 master.cpp:7282] Successfully authenticated principal 'test-principal' at slave(663)@172.17.0.2:45745 I0324 06:19:39.268313 25387 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(1246)@172.17.0.2:45745 I0324 06:19:39.268420 25382 slave.cpp:978] Successfully authenticated with master [email protected]:45745 I0324 06:19:39.268604 25382 slave.cpp:1406] Will retry registration in 11.554355ms if necessary I0324 06:19:39.268690 25381 master.cpp:5437] Registering agent at slave(663)@172.17.0.2:45745 (56e011c53567) with id 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 I0324 06:19:39.268868 25373 registrar.cpp:463] Applied 1 operations in 18345ns; attempting to update the registry I0324 06:19:39.269300 25373 registrar.cpp:508] Successfully updated the registry in 388096ns I0324 06:19:39.269574 25386 slave.cpp:4421] Received ping from slave-observer(597)@172.17.0.2:45745 I0324 06:19:39.269608 25375 master.cpp:5511] Registered agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] I0324 06:19:39.269712 25379 hierarchical.cpp:527] Added agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 (56e011c53567) with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (allocated: {}) I0324 06:19:39.269753 25386 slave.cpp:1024] Registered with master [email protected]:45745; given agent ID 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 I0324 06:19:39.269783 25386 fetcher.cpp:94] Clearing fetcher cache I0324 06:19:39.269913 25387 status_update_manager.cpp:184] Resuming sending status updates I0324 06:19:39.270062 25379 hierarchical.cpp:1952] No inverse offers to send out! I0324 06:19:39.270087 25379 hierarchical.cpp:1446] Performed allocation for 1 agents in 300878ns I0324 06:19:39.270151 25386 slave.cpp:1052] Checkpointing SlaveInfo to '/tmp/ContentType_SchedulerTest_KillTask_0_DE5gth/meta/slaves/38ff29c9-336e-467b-9bfe-5a8bba871e08-S0/slave.info' I0324 06:19:39.270249 25377 master.cpp:7081] Sending 1 offers to framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (default) I0324 06:19:39.270479 25386 slave.cpp:1090] Forwarding total oversubscribed resources {} I0324 06:19:39.270553 25386 master.cpp:6098] Received update of agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) with total oversubscribed resources {} I0324 06:19:39.270978 25382 scheduler.cpp:676] Enqueuing event OFFERS received from http://172.17.0.2:45745/master/api/v1/scheduler I0324 06:19:39.271975 25378 scheduler.cpp:243] Sending ACCEPT call to http://172.17.0.2:45745/master/api/v1/scheduler I0324 06:19:39.272516 25387 process.cpp:3705] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' I0324 06:19:39.273157 25379 http.cpp:440] HTTP POST for /master/api/v1/scheduler from 172.17.0.2:50910 I0324 06:19:39.273409 25379 master.cpp:3839] Processing ACCEPT call for offers: [ 38ff29c9-336e-467b-9bfe-5a8bba871e08-O0 ] on agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) for framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (default) I0324 06:19:39.273458 25379 master.cpp:3415] Authorizing framework principal 'test-principal' to launch task 69937fe4-b18e-4b51-bb6d-0371d567b159 W0324 06:19:39.274371 25377 validation.cpp:1113] Executor 'default' for task '69937fe4-b18e-4b51-bb6d-0371d567b159' uses less CPUs (None) than the minimum required (0.01). Please update your executor, as this will be mandatory in future releases. W0324 06:19:39.274397 25377 validation.cpp:1125] Executor 'default' for task '69937fe4-b18e-4b51-bb6d-0371d567b159' uses less memory (None) than the minimum required (32MB). Please update your executor, as this will be mandatory in future releases. I0324 06:19:39.274526 25377 master.cpp:9097] Adding task 69937fe4-b18e-4b51-bb6d-0371d567b159 with resources cpus(*)(allocated: *):2; mem(*)(allocated: *):1024; disk(*)(allocated: *):1024; ports(*)(allocated: *):[31000-32000] on agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) I0324 06:19:39.274646 25377 master.cpp:4489] Launching task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (default) with resources cpus(*)(allocated: *):2; mem(*)(allocated: *):1024; disk(*)(allocated: *):1024; ports(*)(allocated: *):[31000-32000] on agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) I0324 06:19:39.274891 25384 slave.cpp:1516] Got assigned task '69937fe4-b18e-4b51-bb6d-0371d567b159' for framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.275224 25384 slave.cpp:1797] Authorizing task '69937fe4-b18e-4b51-bb6d-0371d567b159' for framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.275254 25384 slave.cpp:6257] Authorizing framework principal 'test-principal' to launch task 69937fe4-b18e-4b51-bb6d-0371d567b159 I0324 06:19:39.275432 25379 hierarchical.cpp:852] Updated allocation of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 on agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 from cpus(*)(allocated: *):2; mem(*)(allocated: *):1024; disk(*)(allocated: *):1024; ports(*)(allocated: *):[31000-32000] to cpus(*)(allocated: *):2; mem(*)(allocated: *):1024; disk(*)(allocated: *):1024; ports(*)(allocated: *):[31000-32000] I0324 06:19:39.275692 25374 slave.cpp:1984] Launching task '69937fe4-b18e-4b51-bb6d-0371d567b159' for framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.276274 25374 paths.cpp:547] Trying to chown '/tmp/ContentType_SchedulerTest_KillTask_0_DE5gth/slaves/38ff29c9-336e-467b-9bfe-5a8bba871e08-S0/frameworks/38ff29c9-336e-467b-9bfe-5a8bba871e08-0000/executors/default/runs/7b907174-77f8-45a7-805e-4d1aef6f9379' to user 'mesos' I0324 06:19:39.276460 25374 slave.cpp:6604] Launching executor 'default' of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 with resources {} in work directory '/tmp/ContentType_SchedulerTest_KillTask_0_DE5gth/slaves/38ff29c9-336e-467b-9bfe-5a8bba871e08-S0/frameworks/38ff29c9-336e-467b-9bfe-5a8bba871e08-0000/executors/default/runs/7b907174-77f8-45a7-805e-4d1aef6f9379' I0324 06:19:39.276770 25374 slave.cpp:2198] Queued task '69937fe4-b18e-4b51-bb6d-0371d567b159' for executor 'default' of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.276819 25374 slave.cpp:774] Successfully attached file '/tmp/ContentType_SchedulerTest_KillTask_0_DE5gth/slaves/38ff29c9-336e-467b-9bfe-5a8bba871e08-S0/frameworks/38ff29c9-336e-467b-9bfe-5a8bba871e08-0000/executors/default/runs/7b907174-77f8-45a7-805e-4d1aef6f9379' I0324 06:19:39.277638 25372 executor.cpp:192] Version: 1.3.0 I0324 06:19:39.278419 25373 executor.cpp:401] Connected with the agent I0324 06:19:39.279053 25380 executor.cpp:302] Sending SUBSCRIBE call to http://172.17.0.2:45745/slave(663)/api/v1/executor I0324 06:19:39.279590 25385 process.cpp:3705] Handling HTTP event for process 'slave(663)' with path: '/slave(663)/api/v1/executor' I0324 06:19:39.280105 25387 http.cpp:331] HTTP POST for /slave(663)/api/v1/executor from 172.17.0.2:50912 I0324 06:19:39.280179 25387 slave.cpp:3244] Received Subscribe request for HTTP executor 'default' of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.280623 25387 slave.cpp:2411] Sending queued task '69937fe4-b18e-4b51-bb6d-0371d567b159' to executor 'default' of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (via HTTP) I0324 06:19:39.281275 25379 executor.cpp:716] Enqueuing event SUBSCRIBED received from http://172.17.0.2:45745/slave(663)/api/v1/executor I0324 06:19:39.281729 25372 executor.cpp:716] Enqueuing event LAUNCH received from http://172.17.0.2:45745/slave(663)/api/v1/executor I0324 06:19:39.282155 25386 executor.cpp:302] Sending UPDATE call to http://172.17.0.2:45745/slave(663)/api/v1/executor I0324 06:19:39.282663 25376 process.cpp:3705] Handling HTTP event for process 'slave(663)' with path: '/slave(663)/api/v1/executor' I0324 06:19:39.283087 25384 http.cpp:331] HTTP POST for /slave(663)/api/v1/executor from 172.17.0.2:50913 I0324 06:19:39.283151 25384 slave.cpp:3891] Handling status update TASK_RUNNING (UUID: ef0de327-9bcb-41d4-8969-88c904743085) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.283476 25376 status_update_manager.cpp:323] Received status update TASK_RUNNING (UUID: ef0de327-9bcb-41d4-8969-88c904743085) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.283504 25376 status_update_manager.cpp:500] Creating StatusUpdate stream for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.283679 25376 status_update_manager.cpp:377] Forwarding update TASK_RUNNING (UUID: ef0de327-9bcb-41d4-8969-88c904743085) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 to the agent I0324 06:19:39.283807 25386 slave.cpp:4331] Forwarding the update TASK_RUNNING (UUID: ef0de327-9bcb-41d4-8969-88c904743085) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 to [email protected]:45745 I0324 06:19:39.283957 25386 slave.cpp:4225] Status update manager successfully handled status update TASK_RUNNING (UUID: ef0de327-9bcb-41d4-8969-88c904743085) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.283972 25378 master.cpp:6243] Status update TASK_RUNNING (UUID: ef0de327-9bcb-41d4-8969-88c904743085) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 from agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) I0324 06:19:39.284008 25378 master.cpp:6311] Forwarding status update TASK_RUNNING (UUID: ef0de327-9bcb-41d4-8969-88c904743085) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.284150 25378 master.cpp:8345] Updating the state of task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (latest state: TASK_RUNNING, status update state: TASK_RUNNING) I0324 06:19:39.284435 25380 executor.cpp:716] Enqueuing event ACKNOWLEDGED received from http://172.17.0.2:45745/slave(663)/api/v1/executor I0324 06:19:39.284639 25382 scheduler.cpp:676] Enqueuing event UPDATE received from http://172.17.0.2:45745/master/api/v1/scheduler I0324 06:19:39.285501 25381 scheduler.cpp:243] Sending ACKNOWLEDGE call to http://172.17.0.2:45745/master/api/v1/scheduler I0324 06:19:39.285647 25381 scheduler.cpp:243] Sending KILL call to http://172.17.0.2:45745/master/api/v1/scheduler I0324 06:19:39.285938 25386 process.cpp:3705] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' I0324 06:19:39.323231 25377 process.cpp:3705] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' I0324 06:19:39.323675 25378 http.cpp:440] HTTP POST for /master/api/v1/scheduler from 172.17.0.2:50910 I0324 06:19:39.323740 25378 master.cpp:5151] Processing ACKNOWLEDGE call ef0de327-9bcb-41d4-8969-88c904743085 for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (default) on agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 I0324 06:19:39.323910 25375 status_update_manager.cpp:395] Received status update acknowledgement (UUID: ef0de327-9bcb-41d4-8969-88c904743085) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.323945 25378 http.cpp:440] HTTP POST for /master/api/v1/scheduler from 172.17.0.2:50910 I0324 06:19:39.324009 25378 master.cpp:4970] Processing KILL call for task '69937fe4-b18e-4b51-bb6d-0371d567b159' of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (default) I0324 06:19:39.324074 25378 master.cpp:5043] Telling agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) to kill task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (default) I0324 06:19:39.324165 25383 slave.cpp:3180] Status update manager successfully handled status update acknowledgement (UUID: ef0de327-9bcb-41d4-8969-88c904743085) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.324303 25383 slave.cpp:2508] Asked to kill task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.324925 25384 executor.cpp:716] Enqueuing event KILL received from http://172.17.0.2:45745/slave(663)/api/v1/executor I0324 06:19:39.325239 25384 executor.cpp:302] Sending UPDATE call to http://172.17.0.2:45745/slave(663)/api/v1/executor I0324 06:19:39.325641 25382 process.cpp:3705] Handling HTTP event for process 'slave(663)' with path: '/slave(663)/api/v1/executor' I0324 06:19:39.363601 25385 http.cpp:331] HTTP POST for /slave(663)/api/v1/executor from 172.17.0.2:50913 I0324 06:19:39.363658 25385 slave.cpp:3891] Handling status update TASK_KILLED (UUID: 5550eaab-ac8b-4bc4-b2fb-e5bcfb58c9fb) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.364352 25373 status_update_manager.cpp:323] Received status update TASK_KILLED (UUID: 5550eaab-ac8b-4bc4-b2fb-e5bcfb58c9fb) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.364434 25373 status_update_manager.cpp:377] Forwarding update TASK_KILLED (UUID: 5550eaab-ac8b-4bc4-b2fb-e5bcfb58c9fb) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 to the agent I0324 06:19:39.364537 25384 slave.cpp:4331] Forwarding the update TASK_KILLED (UUID: 5550eaab-ac8b-4bc4-b2fb-e5bcfb58c9fb) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 to [email protected]:45745 I0324 06:19:39.364711 25384 slave.cpp:4225] Status update manager successfully handled status update TASK_KILLED (UUID: 5550eaab-ac8b-4bc4-b2fb-e5bcfb58c9fb) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.364737 25382 master.cpp:6243] Status update TASK_KILLED (UUID: 5550eaab-ac8b-4bc4-b2fb-e5bcfb58c9fb) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 from agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) I0324 06:19:39.364780 25382 master.cpp:6311] Forwarding status update TASK_KILLED (UUID: 5550eaab-ac8b-4bc4-b2fb-e5bcfb58c9fb) for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.364933 25382 master.cpp:8345] Updating the state of task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED) I0324 06:19:39.365231 25379 executor.cpp:716] Enqueuing event ACKNOWLEDGED received from http://172.17.0.2:45745/slave(663)/api/v1/executor I0324 06:19:39.365402 25375 scheduler.cpp:676] Enqueuing event UPDATE received from http://172.17.0.2:45745/master/api/v1/scheduler I0324 06:19:39.365600 25386 hierarchical.cpp:1116] Recovered cpus(*)(allocated: *):2; mem(*)(allocated: *):1024; disk(*)(allocated: *):1024; ports(*)(allocated: *):[31000-32000] (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: {}) on agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 from framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.366286 25384 master.cpp:1434] Framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (default) disconnected I0324 06:19:39.366312 25384 master.cpp:3148] Deactivating framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (default) I0324 06:19:39.366350 25384 master.cpp:3125] Disconnecting framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (default) I0324 06:19:39.366403 25382 hierarchical.cpp:376] Deactivated framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.366400 25384 master.cpp:1449] Giving framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (default) 0ns to failover I0324 06:19:39.367668 25378 master.cpp:6921] Framework failover timeout, removing framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (default) I0324 06:19:39.367693 25378 master.cpp:7777] Removing framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (default) I0324 06:19:39.367763 25378 master.cpp:8345] Updating the state of task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED) I0324 06:19:39.367786 25376 slave.cpp:2738] Asked to shut down framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 by [email protected]:45745 I0324 06:19:39.367817 25376 slave.cpp:2763] Shutting down framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.367784 25378 master.cpp:8439] Removing task 69937fe4-b18e-4b51-bb6d-0371d567b159 with resources cpus(*)(allocated: *):2; mem(*)(allocated: *):1024; disk(*)(allocated: *):1024; ports(*)(allocated: *):[31000-32000] of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 on agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) I0324 06:19:39.367840 25376 slave.cpp:5150] Shutting down executor 'default' of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (via HTTP) I0324 06:19:39.367935 25378 master.cpp:8468] Removing executor 'default' with resources {} of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 on agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) I0324 06:19:39.368144 25376 hierarchical.cpp:323] Removed framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.368526 25383 executor.cpp:716] Enqueuing event SHUTDOWN received from http://172.17.0.2:45745/slave(663)/api/v1/executor *** Aborted at 1490336379 (unix time) try "date -d @1490336379" if you are using GNU date *** I0324 06:19:39.369002 25374 slave.cpp:4836] Executor 'default' of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 exited with status 0 I0324 06:19:39.369045 25374 slave.cpp:4936] Cleaning up executor 'default' of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 (via HTTP) W0324 06:19:39.369109 25381 master.cpp:6367] Ignoring unknown exited executor 'default' of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 on agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) I0324 06:19:39.369279 25386 gc.cpp:55] Scheduling '/tmp/ContentType_SchedulerTest_KillTask_0_DE5gth/slaves/38ff29c9-336e-467b-9bfe-5a8bba871e08-S0/frameworks/38ff29c9-336e-467b-9bfe-5a8bba871e08-0000/executors/default/runs/7b907174-77f8-45a7-805e-4d1aef6f9379' for gc 6.99999572682963days in the future I0324 06:19:39.369309 25374 slave.cpp:5024] Cleaning up framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.369355 25386 gc.cpp:55] Scheduling '/tmp/ContentType_SchedulerTest_KillTask_0_DE5gth/slaves/38ff29c9-336e-467b-9bfe-5a8bba871e08-S0/frameworks/38ff29c9-336e-467b-9bfe-5a8bba871e08-0000/executors/default' for gc 6.99999572576593days in the future I0324 06:19:39.369405 25384 status_update_manager.cpp:285] Closing status update streams for framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.369448 25384 status_update_manager.cpp:531] Cleaning up status update stream for task 69937fe4-b18e-4b51-bb6d-0371d567b159 of framework 38ff29c9-336e-467b-9bfe-5a8bba871e08-0000 I0324 06:19:39.369457 25382 gc.cpp:55] Scheduling '/tmp/ContentType_SchedulerTest_KillTask_0_DE5gth/slaves/38ff29c9-336e-467b-9bfe-5a8bba871e08-S0/frameworks/38ff29c9-336e-467b-9bfe-5a8bba871e08-0000' for gc 6.99999572427259days in the future I0324 06:19:39.369804 25374 slave.cpp:693] Agent terminating I0324 06:19:39.369932 25374 master.cpp:1317] Agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) disconnected I0324 06:19:39.369981 25374 master.cpp:3185] Disconnecting agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) I0324 06:19:39.370021 25374 master.cpp:3204] Deactivating agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 at slave(663)@172.17.0.2:45745 (56e011c53567) I0324 06:19:39.370267 25372 hierarchical.cpp:655] Agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 deactivated PC: @ 0x1c419d7 testing::internal::UntypedFunctionMockerBase::UntypedInvokeWith() *** SIGSEGV (@0x29) received by PID 25371 (TID 0x2ad5982ee700) from PID 41; stack trace: *** @ 0x2ad58dd20330 (unknown) I0324 06:19:39.371597 25376 master.cpp:1156] Master terminating I0324 06:19:39.371826 25381 hierarchical.cpp:560] Removed agent 38ff29c9-336e-467b-9bfe-5a8bba871e08-S0 @ 0x1c419d7 testing::internal::UntypedFunctionMockerBase::UntypedInvokeWith() @ 0xdb4900 mesos::internal::tests::executor::MockHTTPExecutor<>::event() [ OK ] ContentType/SchedulerTest.KillTask/0 (122 ms) [ RUN ] ContentType/SchedulerTest.KillTask/1 I0324 06:19:39.377554 25371 cluster.cpp:160] Creating default 'local' authorizer @ 0xdd87a7 mesos::internal::tests::executor::TestMesos<>::events() I0324 06:19:39.379081 25381 master.cpp:437] Master d0cc2635-2291-43c5-a929-d0a557fbd8be (56e011c53567) started on 172.17.0.2:45745 I0324 06:19:39.379134 25381 master.cpp:439] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="1secs" --allocator="HierarchicalDRF" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/vAltCk/credentials" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_unreachable_tasks_per_framework="1000" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --root_submissions="true" --user_sorter="drf" --version="false" --webui_dir="/usr/local/share/mesos/webui" --work_dir="/tmp/vAltCk/master" --zk_session_timeout="10secs" I0324 06:19:39.379317 25381 master.cpp:489] Master only allowing authenticated frameworks to register I0324 06:19:39.379328 25381 master.cpp:503] Master only allowing authenticated agents to register I0324 06:19:39.379338 25381 master.cpp:516] Master only allowing authenticated HTTP frameworks to register I0324 06:19:39.379348 25381 credentials.hpp:37] Loading credentials for authentication from '/tmp/vAltCk/credentials' I0324 06:19:39.379504 25381 master.cpp:561] Using default 'crammd5' authenticator I0324 06:19:39.379561 25381 http.cpp:957] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' I0324 06:19:39.379673 25381 http.cpp:957] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' I0324 06:19:39.379719 25381 http.cpp:957] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' I0324 06:19:39.379746 25381 master.cpp:641] Authorization enabled @ 0xdc468d std::_Function_handler<>::_M_invoke() I0324 06:19:39.379811 25387 whitelist_watcher.cpp:77] No whitelist given I0324 06:19:39.379822 25379 hierarchical.cpp:159] Initialized hierarchical allocator process I0324 06:19:39.380478 25377 master.cpp:2165] Elected as the leading master! I0324 06:19:39.380491 25377 master.cpp:1704] Recovering from registrar I0324 06:19:39.380574 25382 registrar.cpp:331] Recovering registrar I0324 06:19:39.380820 25384 registrar.cpp:364] Successfully fetched the registry (0B) in 221952ns I0324 06:19:39.380854 25384 registrar.cpp:463] Applied 1 operations in 3706ns; attempting to update the registry @ 0x2ad58b57ab55 process::AsyncExecutorProcess::execute<>() I0324 06:19:39.381122 25379 registrar.cpp:508] Successfully updated the registry in 248832ns I0324 06:19:39.381166 25379 registrar.cpp:394] Successfully recovered registrar I0324 06:19:39.381376 25383 master.cpp:1803] Recovered 0 agents from the registry (129B); allowing 10mins for agents to re-register I0324 06:19:39.381402 25380 hierarchical.cpp:186] Skipping recovery of hierarchical allocator: nothing to recover @ 0x2ad58b584785 _ZNSt17_Function_handlerIFvPN7process11ProcessBaseEEZNS0_8dispatchI7NothingNS0_20AsyncExecutorProcessERKSt8functionIFvRKSt5queueIN5mesos2v18executor5EventESt5dequeISC_SaISC_EEEEESG_SK_SG_EENS0_6FutureIT_EERKNS0_3PIDIT0_EEMSR_FSO_T1_T2_ET3_T4_EUlS2_E_E9_M_invokeERKSt9_Any_dataS2_ @ 0x2ad58c541e51 process::ProcessManager::resume() @ 0x2ad58c54b037 _ZNSt6thread5_ImplISt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUt_vEEE6_M_runEv @ 0x2ad58dfdfa60 (unknown) @ 0x2ad58dd18184 start_thread @ 0x2ad58e84bbed (unknown) make[3]: Leaving directory `/mesos/build' make[3]: *** [CMakeFiles/check] Segmentation fault make[2]: Leaving directory `/mesos/build' make[2]: *** [CMakeFiles/check.dir/all] Error 2 make[1]: Leaving directory `/mesos/build' make[1]: *** [CMakeFiles/check.dir/rule] Error 2 make: *** [check] Error 2 + docker rmi mesos-1490333691-20319 Untagged: mesos-1490333691-20319:latest Deleted: sha256:759878d81f6e6a38164f39942cec4498d23c980b557fab0b39df858099eb20ac Deleted: sha256:9adc0fcf905708412fea398c1f4cca40603124236d4367b3148a23cd9ab54416 Deleted: sha256:4cf809bcdd715e4ee188166fba64e920bf013007619fc4da830725e4c12b1eb2 Deleted: sha256:56ebcc0e88b154a3f3ff4663b58474dc0e51c70313b0d1d5177a5a97b53a7c3f Deleted: sha256:5489a0a564071b61e9016b665f535f3b45b85205c0afc079612e5b182e5c4b37 Deleted: sha256:ea1c530efbfeb0651f4ed399fff3c354437b55b0537bab6a4f9c6e86666de4f2 Deleted: sha256:4603503edf4c24c3e0d856a69a3c33c1c31ef190412b5b42babdd9d45794df14 Deleted: sha256:8402e664a4c1e92a17764ff56a393c6298a4de62c7ce672db34916e342faee79 Deleted: sha256:5c9602d7d0fa4fb36f4fa7433ce14f468042b4eae3f9f76d1d07f9405b61095c Deleted: sha256:e03d101561bf6cc23c79e46fb20f1864c91f4ac369805f43704d86bbdfdf426c Deleted: sha256:de2e6fe80565c7d3cc95a4ea15ea14a861c589c3e3822b19f3424d6312e27bdd Deleted: sha256:6b229e91dfed5f734f062181d2c05beccf8d5d55fbf0df963c1afadca4baaac7 Deleted: sha256:ec6e199275bc7cafc9ec0f6ba0cfbdd5e4e1554eea650661a194587d35ffe184 Deleted: sha256:b02f6f6ead50a75b1aff57aa32015dbef0cf42316a2f9547de42bdda57ee1f00 Deleted: sha256:8d89c783ae1b8fb42808cd2ad85a08979b58bdcd94f709ad769ecfb9f810dced Deleted: sha256:ec9dcb410dd081cc33a5e31fe5d6a57c65bf8376225369ce12a89731c90c74fb Deleted: sha256:3350546841e487a9cfec90be3d5440e27d94dc4c37bfc62f65e85189dd0fa998 Deleted: sha256:f5b98d094727302634ebcefa226e98d66eb85d48cdd409c546053d181a49651e Deleted: sha256:3e716cd1647cfac5be113f2fc1b1281e7a3d93aff502879d2ab86db65a6cec5a Deleted: sha256:33bc8a03b4caa8b8549bf7a5de31bbce6a74be1d4cca3313311df8833b52a12b Deleted: sha256:cc1f44450f04d75e7d3b04ebb60368a705a58199c1794494fed473c6b452d043 Deleted: sha256:3d594db58cdc0c51c180a0461a8a3b040304596c0265b1449e53a6db21a90b5f Deleted: sha256:0cd2f26231a609ce5c484392d489d5f72f2700cb048cced8c73ecba8e1c31e98 Deleted: sha256:1ec9fbf5fc13ec612f731c1f6f327231e19c15dfe6ac35bcadd971ad23d5e302 Build step 'Execute shell' marked build as failure
