See <https://builds.apache.org/job/Mesos-Buildbot/BUILDTOOL=autotools,COMPILER=gcc,CONFIGURATION=--verbose,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1,OS=ubuntu%3A14.04,label_exp=(ubuntu)&&(!ubuntu-us1)&&(!ubuntu-eu2)/4083/display/redirect?page=changes>
Changes: [gregorywmann] Moved task validation from `getExecutorInfo` to `runTask` on agent. [gregorywmann] Added a test to verify the fix for a failed agent assertion. ------------------------------------------ [...truncated 27.44 MB...] I0810 00:20:38.414790 5055 status_update_manager.cpp:395] Received status update acknowledgement (UUID: e95016cb-0405-4f3f-9ac6-081d34f8f54c) for task 348daf98-49e7-464b-8685-42ddf3a19440 of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 I0810 00:20:38.415439 5055 status_update_manager.cpp:377] Forwarding update TASK_KILLED (UUID: 248c5015-7c4b-4f22-b763-d55bff013d09) for task 348daf98-49e7-464b-8685-42ddf3a19440 of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 to the agent I0810 00:20:38.417093 19579 executor.cpp:171] Received ACKNOWLEDGED event I0810 00:20:38.417460 5055 slave.cpp:4797] Forwarding the update TASK_KILLED (UUID: 248c5015-7c4b-4f22-b763-d55bff013d09) for task 348daf98-49e7-464b-8685-42ddf3a19440 of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 to master@172.17.0.4:36555 I0810 00:20:38.417840 19581 executor.cpp:171] Received ACKNOWLEDGED event I0810 00:20:38.418362 5055 slave.cpp:3609] Status update manager successfully handled status update acknowledgement (UUID: e95016cb-0405-4f3f-9ac6-081d34f8f54c) for task 348daf98-49e7-464b-8685-42ddf3a19440 of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 I0810 00:20:38.418673 19581 checker_process.cpp:199] Stopped COMMAND health check for task '348daf98-49e7-464b-8685-42ddf3a19440' I0810 00:20:38.419276 5055 master.cpp:6846] Status update TASK_KILLED (UUID: 248c5015-7c4b-4f22-b763-d55bff013d09) for task 348daf98-49e7-464b-8685-42ddf3a19440 of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 from agent 947f3ab4-86f1-4666-977e-c0036a027b50-S0 at slave(695)@172.17.0.4:36555 (b72f8033f2b9) I0810 00:20:38.420189 5055 master.cpp:6908] Forwarding status update TASK_KILLED (UUID: 248c5015-7c4b-4f22-b763-d55bff013d09) for task 348daf98-49e7-464b-8685-42ddf3a19440 of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 I0810 00:20:38.420851 5055 master.cpp:8933] Updating the state of task 348daf98-49e7-464b-8685-42ddf3a19440 of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED) I0810 00:20:38.422168 5058 sched.cpp:1041] Scheduler::statusUpdate took 167246ns I0810 00:20:38.423907 5033 sched.cpp:2021] Asked to stop the driver I0810 00:20:38.424234 5059 sched.cpp:1203] Stopping framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 I0810 00:20:38.425781 19587 process.cpp:1072] Failed to accept socket: future discarded I0810 00:20:38.427109 5055 master.cpp:5477] Processing ACKNOWLEDGE call 248c5015-7c4b-4f22-b763-d55bff013d09 for task 348daf98-49e7-464b-8685-42ddf3a19440 of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 (default) at scheduler-ad8f5ee2-89b8-46a1-9b96-e2a03b1785f0@172.17.0.4:36555 on agent 947f3ab4-86f1-4666-977e-c0036a027b50-S0 I0810 00:20:38.427597 5055 master.cpp:9027] Removing task 348daf98-49e7-464b-8685-42ddf3a19440 with resources [{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 on agent 947f3ab4-86f1-4666-977e-c0036a027b50-S0 at slave(695)@172.17.0.4:36555 (b72f8033f2b9) I0810 00:20:38.429379 5054 containerizer.cpp:2121] Destroying container 9220812f-1315-4b44-acad-34ea0206caf6 in RUNNING state I0810 00:20:38.429417 5054 containerizer.cpp:2627] Transitioning the state of container 9220812f-1315-4b44-acad-34ea0206caf6 from RUNNING to DESTROYING I0810 00:20:38.429785 5054 launcher.cpp:156] Asked to destroy container 9220812f-1315-4b44-acad-34ea0206caf6 I0810 00:20:38.430985 5057 status_update_manager.cpp:395] Received status update acknowledgement (UUID: 248c5015-7c4b-4f22-b763-d55bff013d09) for task 348daf98-49e7-464b-8685-42ddf3a19440 of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 I0810 00:20:38.431795 5057 status_update_manager.cpp:531] Cleaning up status update stream for task 348daf98-49e7-464b-8685-42ddf3a19440 of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 I0810 00:20:38.432499 5052 hierarchical.cpp:1152] Recovered cpus(allocated: *):2; mem(allocated: *):1024; disk(allocated: *):1024; ports(allocated: *):[31000-32000] (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000], allocated: {}) on agent 947f3ab4-86f1-4666-977e-c0036a027b50-S0 from framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 I0810 00:20:38.433189 5057 slave.cpp:3609] Status update manager successfully handled status update acknowledgement (UUID: 248c5015-7c4b-4f22-b763-d55bff013d09) for task 348daf98-49e7-464b-8685-42ddf3a19440 of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 I0810 00:20:38.433826 5057 slave.cpp:7561] Completing task 348daf98-49e7-464b-8685-42ddf3a19440 I0810 00:20:38.434839 5055 master.cpp:8348] Processing TEARDOWN call for framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 (default) at scheduler-ad8f5ee2-89b8-46a1-9b96-e2a03b1785f0@172.17.0.4:36555 I0810 00:20:38.443500 5055 master.cpp:8360] Removing framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 (default) at scheduler-ad8f5ee2-89b8-46a1-9b96-e2a03b1785f0@172.17.0.4:36555 I0810 00:20:38.444284 5055 master.cpp:3264] Deactivating framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 (default) at scheduler-ad8f5ee2-89b8-46a1-9b96-e2a03b1785f0@172.17.0.4:36555 I0810 00:20:38.444828 5059 hierarchical.cpp:412] Deactivated framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 I0810 00:20:38.445757 5056 slave.cpp:3159] Asked to shut down framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 by master@172.17.0.4:36555 I0810 00:20:38.445845 5056 slave.cpp:3184] Shutting down framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 I0810 00:20:38.445947 5056 slave.cpp:5651] Shutting down executor '348daf98-49e7-464b-8685-42ddf3a19440' of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 (via HTTP) W0810 00:20:38.446774 5056 slave.hpp:733] Unable to send event to executor '348daf98-49e7-464b-8685-42ddf3a19440' of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 (via HTTP): connection closed I0810 00:20:38.447988 5053 hierarchical.cpp:355] Removed framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 I0810 00:20:38.537508 5058 containerizer.cpp:2527] Container 9220812f-1315-4b44-acad-34ea0206caf6 has exited I0810 00:20:38.542495 5058 provisioner.cpp:490] Ignoring destroy request for unknown container 9220812f-1315-4b44-acad-34ea0206caf6 I0810 00:20:38.543876 5054 slave.cpp:5329] Executor '348daf98-49e7-464b-8685-42ddf3a19440' of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 terminated with signal Killed I0810 00:20:38.544070 5054 slave.cpp:5429] Cleaning up executor '348daf98-49e7-464b-8685-42ddf3a19440' of framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 (via HTTP) I0810 00:20:38.544445 5059 gc.cpp:59] Scheduling '/tmp/HTTPCommandExecutor_CommandExecutorTest_NoTransitionFromKillingToRunning_1_kdHKVM/slaves/947f3ab4-86f1-4666-977e-c0036a027b50-S0/frameworks/947f3ab4-86f1-4666-977e-c0036a027b50-0000/executors/348daf98-49e7-464b-8685-42ddf3a19440/runs/9220812f-1315-4b44-acad-34ea0206caf6' for gc 6.99999370047407days in the future I0810 00:20:38.544620 5054 slave.cpp:5525] Cleaning up framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 I0810 00:20:38.544863 5059 gc.cpp:59] Scheduling '/tmp/HTTPCommandExecutor_CommandExecutorTest_NoTransitionFromKillingToRunning_1_kdHKVM/slaves/947f3ab4-86f1-4666-977e-c0036a027b50-S0/frameworks/947f3ab4-86f1-4666-977e-c0036a027b50-0000/executors/348daf98-49e7-464b-8685-42ddf3a19440' for gc 6.99999369832days in the future I0810 00:20:38.545079 5054 status_update_manager.cpp:285] Closing status update streams for framework 947f3ab4-86f1-4666-977e-c0036a027b50-0000 I0810 00:20:38.545362 5059 gc.cpp:59] Scheduling '/tmp/HTTPCommandExecutor_CommandExecutorTest_NoTransitionFromKillingToRunning_1_kdHKVM/slaves/947f3ab4-86f1-4666-977e-c0036a027b50-S0/frameworks/947f3ab4-86f1-4666-977e-c0036a027b50-0000' for gc 6.99999369444444days in the future I0810 00:20:38.546890 5033 slave.cpp:843] Agent terminating I0810 00:20:38.547372 5058 master.cpp:1318] Agent 947f3ab4-86f1-4666-977e-c0036a027b50-S0 at slave(695)@172.17.0.4:36555 (b72f8033f2b9) disconnected I0810 00:20:38.547888 5058 master.cpp:3301] Disconnecting agent 947f3ab4-86f1-4666-977e-c0036a027b50-S0 at slave(695)@172.17.0.4:36555 (b72f8033f2b9) I0810 00:20:38.548028 5058 master.cpp:3320] Deactivating agent 947f3ab4-86f1-4666-977e-c0036a027b50-S0 at slave(695)@172.17.0.4:36555 (b72f8033f2b9) I0810 00:20:38.548499 5053 hierarchical.cpp:690] Agent 947f3ab4-86f1-4666-977e-c0036a027b50-S0 deactivated I0810 00:20:38.559298 5033 master.cpp:1160] Master terminating I0810 00:20:38.560358 5057 hierarchical.cpp:626] Removed agent 947f3ab4-86f1-4666-977e-c0036a027b50-S0 [ OK ] HTTPCommandExecutor/CommandExecutorTest.NoTransitionFromKillingToRunning/1 (708 ms) [----------] 6 tests from HTTPCommandExecutor/CommandExecutorTest (3419 ms total) [----------] 7 tests from MesosContainerizer/DefaultExecutorTest [ RUN ] MesosContainerizer/DefaultExecutorTest.TaskRunning/0 I0810 00:20:38.576247 5033 cluster.cpp:162] Creating default 'local' authorizer I0810 00:20:38.580648 5058 master.cpp:442] Master 72cca24f-7478-4e5e-92e4-e555213a5e4d (b72f8033f2b9) started on 172.17.0.4:36555 I0810 00:20:38.580955 5058 master.cpp:444] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="1secs" --allocator="HierarchicalDRF" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/ZlQ00B/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_unreachable_tasks_per_framework="1000" --port="5050" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --root_submissions="true" --user_sorter="drf" --version="false" --webui_dir="/mesos/mesos-1.4.0/_inst/share/mesos/webui" --work_dir="/tmp/ZlQ00B/master" --zk_session_timeout="10secs" I0810 00:20:38.581322 5058 master.cpp:494] Master only allowing authenticated frameworks to register I0810 00:20:38.581357 5058 master.cpp:508] Master only allowing authenticated agents to register I0810 00:20:38.581387 5058 master.cpp:521] Master only allowing authenticated HTTP frameworks to register I0810 00:20:38.581413 5058 credentials.hpp:37] Loading credentials for authentication from '/tmp/ZlQ00B/credentials' I0810 00:20:38.582126 5058 master.cpp:566] Using default 'crammd5' authenticator I0810 00:20:38.583565 5058 http.cpp:1026] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly' I0810 00:20:38.584197 5058 http.cpp:1026] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite' I0810 00:20:38.584805 5058 http.cpp:1026] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler' I0810 00:20:38.585168 5058 master.cpp:646] Authorization enabled I0810 00:20:38.585629 5056 whitelist_watcher.cpp:77] No whitelist given I0810 00:20:38.585708 5054 hierarchical.cpp:171] Initialized hierarchical allocator process I0810 00:20:38.591121 5054 master.cpp:2163] Elected as the leading master! I0810 00:20:38.591173 5054 master.cpp:1702] Recovering from registrar I0810 00:20:38.591477 5057 registrar.cpp:347] Recovering registrar I0810 00:20:38.592521 5057 registrar.cpp:391] Successfully fetched the registry (0B) in 732928ns I0810 00:20:38.593120 5057 registrar.cpp:495] Applied 1 operations in 47095ns; attempting to update the registry I0810 00:20:38.594010 5057 registrar.cpp:552] Successfully updated the registry in 624896ns I0810 00:20:38.594985 5057 registrar.cpp:424] Successfully recovered registrar I0810 00:20:38.595648 5052 master.cpp:1801] Recovered 0 agents from the registry (129B); allowing 10mins for agents to re-register I0810 00:20:38.596007 5057 hierarchical.cpp:209] Skipping recovery of hierarchical allocator: nothing to recover I0810 00:20:38.602233 5033 process.cpp:3228] Attempting to spawn already spawned process files@172.17.0.4:36555 I0810 00:20:38.604693 5033 containerizer.cpp:246] Using isolation: posix/cpu,posix/mem,filesystem/posix,network/cni,environment_secret W0810 00:20:38.605389 5033 backend.cpp:76] Failed to create 'aufs' backend: AufsBackend requires root privileges W0810 00:20:38.605644 5033 backend.cpp:76] Failed to create 'bind' backend: BindBackend requires root privileges I0810 00:20:38.605813 5033 provisioner.cpp:255] Using default backend 'copy' I0810 00:20:38.609807 5033 cluster.cpp:448] Creating default 'local' authorizer I0810 00:20:38.612715 5059 slave.cpp:250] Mesos agent started on (696)@172.17.0.4:36555 I0810 00:20:38.612921 5059 slave.cpp:251] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_M31IOT/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_M31IOT/credential" --default_role="*" --disk_watch_interval="1mins" --docker="docker" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io" --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_M31IOT/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_M31IOT/fetch" --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks" --gc_disk_headroom="0.1" --hadoop_home="" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_M31IOT/http_credentials" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="posix" --launcher_dir="/mesos/mesos-1.4.0/_build/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_M31IOT" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_cBCQUK" I0810 00:20:38.613395 5033 scheduler.cpp:184] Version: 1.4.0 I0810 00:20:38.613443 5059 credentials.hpp:86] Loading credential for authentication from '/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_M31IOT/credential' I0810 00:20:38.613850 5059 slave.cpp:283] Agent using credential for: test-principal I0810 00:20:38.614709 5059 credentials.hpp:37] Loading credentials for authentication from '/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_M31IOT/http_credentials' I0810 00:20:38.614446 5056 scheduler.cpp:470] New master detected at master@172.17.0.4:36555 I0810 00:20:38.614879 5056 scheduler.cpp:479] Waiting for 0ns before initiating a re-(connection) attempt with the master I0810 00:20:38.615321 5059 http.cpp:1026] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly' I0810 00:20:38.619415 5059 slave.cpp:565] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] I0810 00:20:38.619796 5059 slave.cpp:573] Agent attributes: [ ] I0810 00:20:38.619907 5059 slave.cpp:582] Agent hostname: b72f8033f2b9 I0810 00:20:38.620957 5054 scheduler.cpp:361] Connected with the master at http://172.17.0.4:36555/master/api/v1/scheduler I0810 00:20:38.621490 5055 status_update_manager.cpp:177] Pausing sending status updates I0810 00:20:38.623003 5053 scheduler.cpp:243] Sending SUBSCRIBE call to http://172.17.0.4:36555/master/api/v1/scheduler I0810 00:20:38.625206 5056 process.cpp:3933] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' I0810 00:20:38.626940 5058 state.cpp:64] Recovering state from '/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_cBCQUK/meta' I0810 00:20:38.627614 5053 http.cpp:1166] HTTP POST for /master/api/v1/scheduler from 172.17.0.4:34488 I0810 00:20:38.627854 5053 master.cpp:2545] Received subscription request for HTTP framework 'default' I0810 00:20:38.628355 5053 master.cpp:2228] Authorizing framework principal 'test-principal' to receive offers for roles '{ * }' I0810 00:20:38.629693 5053 master.cpp:2681] Subscribing framework 'default' with checkpointing disabled and capabilities [ RESERVATION_REFINEMENT ] I0810 00:20:38.638623 5057 status_update_manager.cpp:203] Recovering status update manager I0810 00:20:38.639078 5055 containerizer.cpp:598] Recovering containerizer I0810 00:20:38.640758 5059 master.hpp:2217] Sending heartbeat to 72cca24f-7478-4e5e-92e4-e555213a5e4d-0000 I0810 00:20:38.641221 5054 hierarchical.cpp:303] Added framework 72cca24f-7478-4e5e-92e4-e555213a5e4d-0000 I0810 00:20:38.643759 5056 scheduler.cpp:676] Enqueuing event SUBSCRIBED received from http://172.17.0.4:36555/master/api/v1/scheduler I0810 00:20:38.644280 5055 provisioner.cpp:416] Provisioner recovery complete I0810 00:20:38.644888 5054 hierarchical.cpp:1925] No allocations performed I0810 00:20:38.645046 5054 hierarchical.cpp:2015] No inverse offers to send out! I0810 00:20:38.645165 5054 hierarchical.cpp:1468] Performed allocation for 0 agents in 368067ns I0810 00:20:38.645932 5054 slave.cpp:6210] Finished recovery I0810 00:20:38.647536 5054 slave.cpp:6392] Querying resource estimator for oversubscribable resources I0810 00:20:38.647977 5052 scheduler.cpp:676] Enqueuing event HEARTBEAT received from http://172.17.0.4:36555/master/api/v1/scheduler I0810 00:20:38.648241 5054 slave.cpp:6406] Received oversubscribable resources {} from the resource estimator I0810 00:20:38.648504 5057 status_update_manager.cpp:177] Pausing sending status updates I0810 00:20:38.648514 5054 slave.cpp:971] New master detected at master@172.17.0.4:36555 I0810 00:20:38.648797 5054 slave.cpp:1006] Detecting new master I0810 00:20:38.657126 5052 slave.cpp:1033] Authenticating with master master@172.17.0.4:36555 I0810 00:20:38.657243 5052 slave.cpp:1044] Using default CRAM-MD5 authenticatee I0810 00:20:38.657738 5052 authenticatee.cpp:121] Creating new client SASL connection I0810 00:20:38.658352 5057 master.cpp:7837] Authenticating slave(696)@172.17.0.4:36555 I0810 00:20:38.658861 5057 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(1326)@172.17.0.4:36555 I0810 00:20:38.659888 5057 authenticator.cpp:98] Creating new server SASL connection I0810 00:20:38.660529 5057 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5 I0810 00:20:38.660725 5057 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5' I0810 00:20:38.661160 5057 authenticator.cpp:204] Received SASL authentication start I0810 00:20:38.661357 5057 authenticator.cpp:326] Authentication requires more steps I0810 00:20:38.661607 5057 authenticatee.cpp:259] Received SASL authentication step I0810 00:20:38.662142 5057 authenticator.cpp:232] Received SASL authentication step I0810 00:20:38.662652 5057 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'b72f8033f2b9' server FQDN: 'b72f8033f2b9' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false I0810 00:20:38.663090 5057 auxprop.cpp:181] Looking up auxiliary property '*userPassword' I0810 00:20:38.663367 5057 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5' I0810 00:20:38.663657 5057 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'b72f8033f2b9' server FQDN: 'b72f8033f2b9' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true I0810 00:20:38.663724 5057 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true I0810 00:20:38.663789 5057 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true I0810 00:20:38.664083 5057 authenticator.cpp:318] Authentication success I0810 00:20:38.664361 5056 authenticatee.cpp:299] Authentication success I0810 00:20:38.664746 5055 master.cpp:7867] Successfully authenticated principal 'test-principal' at slave(696)@172.17.0.4:36555 I0810 00:20:38.665216 5056 slave.cpp:1128] Successfully authenticated with master master@172.17.0.4:36555 I0810 00:20:38.665351 5053 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(1326)@172.17.0.4:36555 I0810 00:20:38.665681 5056 slave.cpp:1572] Will retry registration in 17.199349ms if necessary I0810 00:20:38.666133 5052 master.cpp:5712] Received register agent message from slave(696)@172.17.0.4:36555 (b72f8033f2b9) *** Aborted at 1502324438 (unix time) try "date -d @1502324438" if you are using GNU date *** I0810 00:20:38.666952 5052 master.cpp:3803] Authorizing agent with principal 'test-principal' I0810 00:20:38.667630 5054 master.cpp:5772] Authorized registration of agent at slave(696)@172.17.0.4:36555 (b72f8033f2b9) I0810 00:20:38.667954 5054 master.cpp:5865] Registering agent at slave(696)@172.17.0.4:36555 (b72f8033f2b9) with id 72cca24f-7478-4e5e-92e4-e555213a5e4d-S0 I0810 00:20:38.668736 5053 registrar.cpp:495] Applied 1 operations in 74315ns; attempting to update the registry I0810 00:20:38.669734 5056 registrar.cpp:552] Successfully updated the registry in 877056ns I0810 00:20:38.670104 5054 master.cpp:5912] Admitted agent 72cca24f-7478-4e5e-92e4-e555213a5e4d-S0 at slave(696)@172.17.0.4:36555 (b72f8033f2b9) I0810 00:20:38.671213 5056 slave.cpp:4887] Received ping from slave-observer(640)@172.17.0.4:36555 I0810 00:20:38.671489 5056 slave.cpp:1174] Registered with master master@172.17.0.4:36555; given agent ID 72cca24f-7478-4e5e-92e4-e555213a5e4d-S0 I0810 00:20:38.671321 5054 master.cpp:5943] Registered agent 72cca24f-7478-4e5e-92e4-e555213a5e4d-S0 at slave(696)@172.17.0.4:36555 (b72f8033f2b9) with [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] I0810 00:20:38.672111 5054 status_update_manager.cpp:184] Resuming sending status updates I0810 00:20:38.672190 5056 slave.cpp:1194] Checkpointing SlaveInfo to '/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_cBCQUK/meta/slaves/72cca24f-7478-4e5e-92e4-e555213a5e4d-S0/slave.info' I0810 00:20:38.672729 5056 slave.cpp:1232] Forwarding total oversubscribed resources {} I0810 00:20:38.672720 5053 hierarchical.cpp:593] Added agent 72cca24f-7478-4e5e-92e4-e555213a5e4d-S0 (b72f8033f2b9) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (allocated: {}) I0810 00:20:38.673053 5056 master.cpp:6688] Received update of agent 72cca24f-7478-4e5e-92e4-e555213a5e4d-S0 at slave(696)@172.17.0.4:36555 (b72f8033f2b9) with total oversubscribed resources {} I0810 00:20:38.673524 5053 hierarchical.cpp:660] Agent 72cca24f-7478-4e5e-92e4-e555213a5e4d-S0 (b72f8033f2b9) updated with total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000] I0810 00:20:38.675614 5053 hierarchical.cpp:2015] No inverse offers to send out! I0810 00:20:38.676015 5053 hierarchical.cpp:1468] Performed allocation for 1 agents in 2.076706ms I0810 00:20:38.676606 5052 master.cpp:7667] Sending 1 offers to framework 72cca24f-7478-4e5e-92e4-e555213a5e4d-0000 (default) I0810 00:20:38.680426 5059 scheduler.cpp:676] Enqueuing event OFFERS received from http://172.17.0.4:36555/master/api/v1/scheduler I0810 00:20:38.683446 5053 scheduler.cpp:243] Sending ACCEPT call to http://172.17.0.4:36555/master/api/v1/scheduler I0810 00:20:38.685967 5055 process.cpp:3933] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler' I0810 00:20:38.688315 5055 http.cpp:1166] HTTP POST for /master/api/v1/scheduler from 172.17.0.4:34486 I0810 00:20:38.689574 5055 master.cpp:9164] Removing offer 72cca24f-7478-4e5e-92e4-e555213a5e4d-O0 I0810 00:20:38.690121 5055 master.cpp:4153] Processing ACCEPT call for offers: [ 72cca24f-7478-4e5e-92e4-e555213a5e4d-O0 ] on agent 72cca24f-7478-4e5e-92e4-e555213a5e4d-S0 at slave(696)@172.17.0.4:36555 (b72f8033f2b9) for framework 72cca24f-7478-4e5e-92e4-e555213a5e4d-0000 (default) I0810 00:20:38.691069 5055 master.cpp:3530] Authorizing framework principal 'test-principal' to launch task c592a9b2-5cba-4a6b-9b1e-11390e35ed04 I0810 00:20:38.695595 5052 master.cpp:9724] Adding task c592a9b2-5cba-4a6b-9b1e-11390e35ed04 with resources [{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":32.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"disk","scalar":{"value":32.0},"type":"SCALAR"}] on agent 72cca24f-7478-4e5e-92e4-e555213a5e4d-S0 at slave(696)@172.17.0.4:36555 (b72f8033f2b9) I0810 00:20:38.696051 5052 master.cpp:5019] Launching task group { c592a9b2-5cba-4a6b-9b1e-11390e35ed04 } of framework 72cca24f-7478-4e5e-92e4-e555213a5e4d-0000 (default) with resources cpus(allocated: *):0.1; mem(allocated: *):32; disk(allocated: *):32 on agent 72cca24f-7478-4e5e-92e4-e555213a5e4d-S0 at slave(696)@172.17.0.4:36555 (b72f8033f2b9) I0810 00:20:38.696969 5053 slave.cpp:1701] Got assigned task group containing tasks [ c592a9b2-5cba-4a6b-9b1e-11390e35ed04 ] for framework 72cca24f-7478-4e5e-92e4-e555213a5e4d-0000 I0810 00:20:38.697500 5052 hierarchical.cpp:1152] Recovered cpus(allocated: *):1.8; mem(allocated: *):960; disk(allocated: *):960; ports(allocated: *):[31000-32000] (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000], allocated: cpus(allocated: *):0.2; mem(allocated: *):64; disk(allocated: *):64) on agent 72cca24f-7478-4e5e-92e4-e555213a5e4d-S0 from framework 72cca24f-7478-4e5e-92e4-e555213a5e4d-0000 I0810 00:20:38.697682 5052 hierarchical.cpp:1189] Framework 72cca24f-7478-4e5e-92e4-e555213a5e4d-0000 filtered agent 72cca24f-7478-4e5e-92e4-e555213a5e4d-S0 for 5secs I0810 00:20:38.699765 5053 slave.cpp:1982] Authorizing task group containing tasks [ c592a9b2-5cba-4a6b-9b1e-11390e35ed04 ] for framework 72cca24f-7478-4e5e-92e4-e555213a5e4d-0000 I0810 00:20:38.700265 5053 slave.cpp:6709] Authorizing framework principal 'test-principal' to launch task c592a9b2-5cba-4a6b-9b1e-11390e35ed04 I0810 00:20:38.701748 5058 slave.cpp:2169] Launching task group containing tasks [ c592a9b2-5cba-4a6b-9b1e-11390e35ed04 ] for framework 72cca24f-7478-4e5e-92e4-e555213a5e4d-0000 I0810 00:20:38.703722 5058 paths.cpp:578] Trying to chown '/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_cBCQUK/slaves/72cca24f-7478-4e5e-92e4-e555213a5e4d-S0/frameworks/72cca24f-7478-4e5e-92e4-e555213a5e4d-0000/executors/default/runs/3b1ddfd8-27fb-473f-b3ee-ab631a314028' to user 'mesos' I0810 00:20:38.704253 5058 slave.cpp:7165] Launching executor 'default' of framework 72cca24f-7478-4e5e-92e4-e555213a5e4d-0000 with resources [{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":32.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"disk","scalar":{"value":32.0},"type":"SCALAR"}] in work directory '/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_cBCQUK/slaves/72cca24f-7478-4e5e-92e4-e555213a5e4d-S0/frameworks/72cca24f-7478-4e5e-92e4-e555213a5e4d-0000/executors/default/runs/3b1ddfd8-27fb-473f-b3ee-ab631a314028' I0810 00:20:38.705289 5058 slave.cpp:2856] Launching container 3b1ddfd8-27fb-473f-b3ee-ab631a314028 for executor 'default' of framework 72cca24f-7478-4e5e-92e4-e555213a5e4d-0000 I0810 00:20:38.705905 5058 slave.cpp:2398] Queued task group containing tasks [ c592a9b2-5cba-4a6b-9b1e-11390e35ed04 ] for executor 'default' of framework 72cca24f-7478-4e5e-92e4-e555213a5e4d-0000 I0810 00:20:38.706059 5058 containerizer.cpp:1072] Starting container 3b1ddfd8-27fb-473f-b3ee-ab631a314028 I0810 00:20:38.706621 5056 slave.cpp:924] Successfully attached file '/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_cBCQUK/slaves/72cca24f-7478-4e5e-92e4-e555213a5e4d-S0/frameworks/72cca24f-7478-4e5e-92e4-e555213a5e4d-0000/executors/default/runs/3b1ddfd8-27fb-473f-b3ee-ab631a314028' I0810 00:20:38.707149 5053 slave.cpp:924] Successfully attached file '/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_cBCQUK/slaves/72cca24f-7478-4e5e-92e4-e555213a5e4d-S0/frameworks/72cca24f-7478-4e5e-92e4-e555213a5e4d-0000/executors/default/runs/3b1ddfd8-27fb-473f-b3ee-ab631a314028' I0810 00:20:38.707239 5058 containerizer.cpp:2627] Transitioning the state of container 3b1ddfd8-27fb-473f-b3ee-ab631a314028 from PROVISIONING to PREPARING I0810 00:20:38.713156 5059 containerizer.cpp:1646] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["mesos-default-executor","--launcher_dir=\/mesos\/mesos-1.4.0\/_build\/src"],"shell":false,"value":"\/mesos\/mesos-1.4.0\/_build\/src\/mesos-default-executor"},"environment":{"variables":[{"name":"LIBPROCESS_PORT","type":"VALUE","value":"0"},{"name":"MESOS_AGENT_ENDPOINT","type":"VALUE","value":"172.17.0.4:36555"},{"name":"MESOS_CHECKPOINT","type":"VALUE","value":"0"},{"name":"MESOS_DIRECTORY","type":"VALUE","value":"\/tmp\/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_cBCQUK\/slaves\/72cca24f-7478-4e5e-92e4-e555213a5e4d-S0\/frameworks\/72cca24f-7478-4e5e-92e4-e555213a5e4d-0000\/executors\/default\/runs\/3b1ddfd8-27fb-473f-b3ee-ab631a314028"},{"name":"MESOS_EXECUTOR_ID","type":"VALUE","value":"default"},{"name":"MESOS_EXECUTOR_SHUTDOWN_GRACE_PERIOD","type":"VALUE","value":"5secs"},{"name":"MESOS_FRAMEWORK_ID","type":"VALUE","value":"72cca24f-7478-4e5e-92e4-e555213a5e4d-0000"},{"name":"MESOS_HTTP_COMMAND_EXECUTOR","type":"VALUE","value":"0"},{"name":"MESOS_SLAVE_ID","type":"VALUE","value":"72cca24f-7478-4e5e-92e4-e555213a5e4d-S0"},{"name":"MESOS_SLAVE_PID","type":"VALUE","value":"slave(696)@172.17.0.4:36555"},{"name":"MESOS_SANDBOX","type":"VALUE","value":"\/tmp\/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_cBCQUK\/slaves\/72cca24f-7478-4e5e-92e4-e555213a5e4d-S0\/frameworks\/72cca24f-7478-4e5e-92e4-e555213a5e4d-0000\/executors\/default\/runs\/3b1ddfd8-27fb-473f-b3ee-ab631a314028"}]},"task_environment":{},"user":"mesos","working_directory":"\/tmp\/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_cBCQUK\/slaves\/72cca24f-7478-4e5e-92e4-e555213a5e4d-S0\/frameworks\/72cca24f-7478-4e5e-92e4-e555213a5e4d-0000\/executors\/default\/runs\/3b1ddfd8-27fb-473f-b3ee-ab631a314028"}" --pipe_read="30" --pipe_write="43" --runtime_directory="/tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_M31IOT/containers/3b1ddfd8-27fb-473f-b3ee-ab631a314028" --unshare_namespace_mnt="false"' I0810 00:20:38.720458 5059 launcher.cpp:140] Forked child with pid '19606' for container '3b1ddfd8-27fb-473f-b3ee-ab631a314028' I0810 00:20:38.722049 5059 containerizer.cpp:2627] Transitioning the state of container 3b1ddfd8-27fb-473f-b3ee-ab631a314028 from PREPARING to ISOLATING I0810 00:20:38.725144 5059 containerizer.cpp:2627] Transitioning the state of container 3b1ddfd8-27fb-473f-b3ee-ab631a314028 from ISOLATING to FETCHING I0810 00:20:38.725605 5059 fetcher.cpp:379] Starting to fetch URIs for container: 3b1ddfd8-27fb-473f-b3ee-ab631a314028, directory: /tmp/MesosContainerizer_DefaultExecutorTest_TaskRunning_0_cBCQUK/slaves/72cca24f-7478-4e5e-92e4-e555213a5e4d-S0/frameworks/72cca24f-7478-4e5e-92e4-e555213a5e4d-0000/executors/default/runs/3b1ddfd8-27fb-473f-b3ee-ab631a314028 I0810 00:20:38.728224 5054 containerizer.cpp:2627] Transitioning the state of container 3b1ddfd8-27fb-473f-b3ee-ab631a314028 from FETCHING to RUNNING PC: @ 0x2b4bdfb710d4 process::EventQueue::Consumer::empty() *** SIGSEGV (@0x8) received by PID 5033 (TID 0x2b4beb17e700) from PID 8; stack trace: *** @ 0x2b4c11f8b417 (unknown) @ 0x2b4c11f8f6f9 (unknown) @ 0x2b4be220f330 (unknown) @ 0x2b4bdfb710d4 process::EventQueue::Consumer::empty() @ 0x2b4bdfb5dd82 process::ProcessManager::resume() @ 0x2b4bdfb5a37e _ZZN7process14ProcessManager12init_threadsEvENKUlvE_clEv @ 0x2b4bdfb6baec _ZNSt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUlvE_vEE9_M_invokeIIEEEvSt12_Index_tupleIIXspT_EEE @ 0x2b4bdfb6ba43 _ZNSt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUlvE_vEEclEv @ 0x2b4bdfb6b9dc _ZNSt6thread5_ImplISt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUlvE_vEEE6_M_runEv @ 0x2b4be1a90a60 (unknown) @ 0x2b4be2207184 start_thread @ 0x2b4be251affd (unknown) I0810 00:20:38.964110 19620 executor.cpp:192] Version: 1.4.0 make[4]: *** [check-local] Segmentation fault (core dumped) make[4]: Leaving directory `/mesos/mesos-1.4.0/_build/src' make[3]: *** [check-am] Error 2 I0810 00:20:39.035405 19634 default_executor.cpp:157] Disconnected from agent make[3]: Leaving directory `/mesos/mesos-1.4.0/_build/src' make[2]: *** [check] Error 2 make[2]: Leaving directory `/mesos/mesos-1.4.0/_build/src' I0810 00:20:39.043727 19634 default_executor.cpp:185] Received SHUTDOWN event I0810 00:20:39.047870 19634 default_executor.cpp:904] Shutting down I0810 00:20:39.047899 19634 default_executor.cpp:960] Terminating after 1secs make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory `/mesos/mesos-1.4.0/_build' make: *** [distcheck] Error 1 + docker rmi mesos-1502318818-2338 Untagged: mesos-1502318818-2338:latest Deleted: sha256:b2524efbcde4dfe22226644697735c9ef5c69c973d0f694d9cc85d8e719d7f49 Deleted: sha256:a010f9a65e6d5ed894494f9772d2e483b81754dcd9a4265350abf98e7c8fc873 Deleted: sha256:8ed21cb95b48254d6bd85bf53cea72cd21b88a67b74f8b58a6aa67f6ef3813bd Deleted: sha256:f6356e9f911fd6b70a34a193b3aa9a32cbabedad1e99a1c9b5e2666d76d9d992 Deleted: sha256:5ae76af9f14974de9649190cebfb8a687554bbeb0a5b284aeec4cb4e6ada122a Deleted: sha256:8771ad282db02bdcab7a59198499e2c44238588e82907e6b930472745bd8d751 Deleted: sha256:76102d1e744e0fcd6c8703a6216126a9a8fa0fb00bca708f9e523e7541c3450a Deleted: sha256:8949b99dcf00663c89b79b8e23473b97afaeb755f723d8d73698c85f60a58fff Deleted: sha256:a9db5c132c5377614743a1dab32a3526fd4a04e8aaf92953ee83bb110dd23cf9 Deleted: sha256:94d02e85f42da871e6ebda076c04f1da0364a40643243d8a4cede67eef26d6af Deleted: sha256:30cc3f6ebcc898fecf85fa7ed5e437a70824bf9469647d5aefb0c6a5ce32b1b7 Deleted: sha256:13ad8c31ca90630f12bc741b109bbdc863e1fc51a9f43a42762402efdaf54391 Deleted: sha256:d709a0b9c72600b075d071b8114f4f743503d44127bb24de91d2c18dc6e66d7d Deleted: sha256:cafa8b0c3de07c651c6de176019b926357bf9da1490eafe207f872228100b0d3 Deleted: sha256:5c7b8b3603b2263d57c9b0b161030442b1593f541af642a0776f0903c86fc6e5 Deleted: sha256:bb894dec040e18fbc13334418fee025c879a7d70951a045b87bccf33a212d17f Deleted: sha256:cf3c51cc3c170f31e7f0b08b0864e8414b7ee93707afcb678aa2c04c50b85168 Deleted: sha256:248d48364ece4e1b1d5892217b7b3e0e7e8a4a8f698a52123f69fac4009c1a6c Deleted: sha256:6bd95a1d5dc246ea1830adccc56de1e5a1c5fad1e2529409360478670c8693b8 Deleted: sha256:39b599ee71f45e3ae3481cd1ed9ef29a83c1ac5c7ce4ad8d755f0c287a9376e4 Deleted: sha256:6f4e88adf2aeb54d0cadf71306b78546b5058fa74472d95f4c429ec089a15e8e Deleted: sha256:e6292759b46f1d2463b9fc5f6d7db96e129ba697f9bff66e5366a9f39ae20c2f Deleted: sha256:63fceeb70ba455128ac6a6baa985d849d89be9d1f9cbafa9e382dc5ac2abc8de Deleted: sha256:cbb42a2612b9cff328bc26dd5ecda39693e95c6fb231116816f68d291c798493 Build step 'Execute shell' marked build as failure Not sending mail to unregistered user gregorywm...@gmail.com