See
<https://builds.apache.org/job/Mesos-Buildbot/BUILDTOOL=cmake,COMPILER=gcc,CONFIGURATION=--verbose%20--disable-libtool-wrappers,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1,OS=ubuntu%3A14.04,label_exp=(ubuntu)&&(!ubuntu-us1)&&(!ubuntu-eu2)&&(!qnode3)&&(!H23)/4298/display/redirect?page=changes>
Changes:
[bbannier] Formatted 'synchronized' like loop instead of function.
------------------------------------------
[...truncated 3.51 MB...]
3: I1009 14:32:44.304908 17239 slave.cpp:944] Successfully attached
'/tmp/FaultToleranceTest_UpdateFrameworkInfoOnMasterFailover_MU8K9N/slaves/9b9b3770-d6be-4958-bc33-cff10ae0de17-S0/frameworks/9b9b3770-d6be-4958-bc33-cff10ae0de17-0000/executors/cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d/runs/26a5d7b2-5ad5-44d5-9c14-e574764a51f8'
to virtual path
'/tmp/FaultToleranceTest_UpdateFrameworkInfoOnMasterFailover_MU8K9N/slaves/9b9b3770-d6be-4958-bc33-cff10ae0de17-S0/frameworks/9b9b3770-d6be-4958-bc33-cff10ae0de17-0000/executors/cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d/runs/26a5d7b2-5ad5-44d5-9c14-e574764a51f8'
3: I1009 14:32:44.308506 17253 containerizer.cpp:1720] Launching
'mesos-containerizer' with flags '--help="false"
--launch_info="{"command":{"arguments":["mesos-executor","--launcher_dir=\/mesos\/build\/src"],"shell":false,"value":"\/mesos\/build\/src\/mesos-executor"},"environment":{"variables":[{"name":"LIBPROCESS_PORT","type":"VALUE","value":"0"},{"name":"MESOS_AGENT_ENDPOINT","type":"VALUE","value":"172.17.0.2:45196"},{"name":"MESOS_CHECKPOINT","type":"VALUE","value":"1"},{"name":"MESOS_DIRECTORY","type":"VALUE","value":"\/tmp\/FaultToleranceTest_UpdateFrameworkInfoOnMasterFailover_MU8K9N\/slaves\/9b9b3770-d6be-4958-bc33-cff10ae0de17-S0\/frameworks\/9b9b3770-d6be-4958-bc33-cff10ae0de17-0000\/executors\/cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d\/runs\/26a5d7b2-5ad5-44d5-9c14-e574764a51f8"},{"name":"MESOS_EXECUTOR_ID","type":"VALUE","value":"cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d"},{"name":"MESOS_EXECUTOR_SHUTDOWN_GRACE_PERIOD","type":"VALUE","value":"5secs"},{"name":"MESOS_FRAMEWORK_ID","type":"VALUE","value":"9b9b3770-d6be-4958-bc33-cff10ae0de17-0000"},{"name":"MESOS_HTTP_COMMAND_EXECUTOR","type":"VALUE","value":"0"},{"name":"MESOS_RECOVERY_TIMEOUT","type":"VALUE","value":"15mins"},{"name":"MESOS_SLAVE_ID","type":"VALUE","value":"9b9b3770-d6be-4958-bc33-cff10ae0de17-S0"},{"name":"MESOS_SLAVE_PID","type":"VALUE","value":"slave(59)@172.17.0.2:45196"},{"name":"MESOS_SUBSCRIPTION_BACKOFF_MAX","type":"VALUE","value":"2secs"},{"name":"MESOS_SANDBOX","type":"VALUE","value":"\/tmp\/FaultToleranceTest_UpdateFrameworkInfoOnMasterFailover_MU8K9N\/slaves\/9b9b3770-d6be-4958-bc33-cff10ae0de17-S0\/frameworks\/9b9b3770-d6be-4958-bc33-cff10ae0de17-0000\/executors\/cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d\/runs\/26a5d7b2-5ad5-44d5-9c14-e574764a51f8"}]},"task_environment":{},"user":"mesos","working_directory":"\/tmp\/FaultToleranceTest_UpdateFrameworkInfoOnMasterFailover_MU8K9N\/slaves\/9b9b3770-d6be-4958-bc33-cff10ae0de17-S0\/frameworks\/9b9b3770-d6be-4958-bc33-cff10ae0de17-0000\/executors\/cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d\/runs\/26a5d7b2-5ad5-44d5-9c14-e574764a51f8"}"
--pipe_read="7" --pipe_write="8"
--runtime_directory="/tmp/FaultToleranceTest_UpdateFrameworkInfoOnMasterFailover_j7yD9F/containers/26a5d7b2-5ad5-44d5-9c14-e574764a51f8"
--unshare_namespace_mnt="false"'
3: I1009 14:32:44.310649 17253 launcher.cpp:140] Forked child with pid '18173'
for container '26a5d7b2-5ad5-44d5-9c14-e574764a51f8'
3: I1009 14:32:44.310770 17253 containerizer.cpp:1812] Checkpointing
container's forked pid 18173 to
'/tmp/FaultToleranceTest_UpdateFrameworkInfoOnMasterFailover_MU8K9N/meta/slaves/9b9b3770-d6be-4958-bc33-cff10ae0de17-S0/frameworks/9b9b3770-d6be-4958-bc33-cff10ae0de17-0000/executors/cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d/runs/26a5d7b2-5ad5-44d5-9c14-e574764a51f8/pids/forked.pid'
3: I1009 14:32:44.311444 17253 containerizer.cpp:2751] Transitioning the state
of container 26a5d7b2-5ad5-44d5-9c14-e574764a51f8 from PREPARING to ISOLATING
3: I1009 14:32:44.312573 17257 containerizer.cpp:2751] Transitioning the state
of container 26a5d7b2-5ad5-44d5-9c14-e574764a51f8 from ISOLATING to FETCHING
3: I1009 14:32:44.312727 17252 fetcher.cpp:377] Starting to fetch URIs for
container: 26a5d7b2-5ad5-44d5-9c14-e574764a51f8, directory:
/tmp/FaultToleranceTest_UpdateFrameworkInfoOnMasterFailover_MU8K9N/slaves/9b9b3770-d6be-4958-bc33-cff10ae0de17-S0/frameworks/9b9b3770-d6be-4958-bc33-cff10ae0de17-0000/executors/cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d/runs/26a5d7b2-5ad5-44d5-9c14-e574764a51f8
3: I1009 14:32:44.313786 17239 containerizer.cpp:2751] Transitioning the state
of container 26a5d7b2-5ad5-44d5-9c14-e574764a51f8 from FETCHING to RUNNING
3: I1009 14:32:44.545111 18187 exec.cpp:162] Version: 1.5.0
3: I1009 14:32:44.556907 17250 slave.cpp:3957] Got registration for executor
'cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d' of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000 from executor(1)@172.17.0.2:36164
3: I1009 14:32:44.557358 17250 slave.cpp:4043] Checkpointing executor pid
'executor(1)@172.17.0.2:36164' to
'/tmp/FaultToleranceTest_UpdateFrameworkInfoOnMasterFailover_MU8K9N/meta/slaves/9b9b3770-d6be-4958-bc33-cff10ae0de17-S0/frameworks/9b9b3770-d6be-4958-bc33-cff10ae0de17-0000/executors/cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d/runs/26a5d7b2-5ad5-44d5-9c14-e574764a51f8/pids/libprocess.pid'
3: I1009 14:32:44.559736 17259 slave.cpp:2629] Sending queued task
'cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d' to executor
'cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d' of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000 at executor(1)@172.17.0.2:36164
3: I1009 14:32:44.561986 18193 exec.cpp:237] Executor registered on agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0
3: I1009 14:32:44.565585 18198 executor.cpp:171] Received SUBSCRIBED event
3: I1009 14:32:44.567385 18198 executor.cpp:175] Subscribed executor on
4c36cea139f4
3: I1009 14:32:44.567728 18198 executor.cpp:171] Received LAUNCH event
3: I1009 14:32:44.567924 18198 executor.cpp:633] Starting task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d
3: I1009 14:32:44.590138 18198 executor.cpp:477] Running
'/mesos/build/src/mesos-containerizer launch <POSSIBLY-SENSITIVE-DATA>'
3: I1009 14:32:44.593616 18198 executor.cpp:646] Forked command at 18200
3: I1009 14:32:44.602321 17253 slave.cpp:4411] Handling status update
TASK_RUNNING (UUID: 5903d32e-5574-45f8-91f8-1c385908dbc9) for task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000 from executor(1)@172.17.0.2:36164
3: I1009 14:32:44.605000 17261 status_update_manager.cpp:323] Received status
update TASK_RUNNING (UUID: 5903d32e-5574-45f8-91f8-1c385908dbc9) for task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000
3: I1009 14:32:44.605087 17261 status_update_manager.cpp:500] Creating
StatusUpdate stream for task cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000
3: I1009 14:32:44.606317 17261 status_update_manager.cpp:834] Checkpointing
UPDATE for status update TASK_RUNNING (UUID:
5903d32e-5574-45f8-91f8-1c385908dbc9) for task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000
3: I1009 14:32:44.606812 17261 status_update_manager.cpp:377] Forwarding update
TASK_RUNNING (UUID: 5903d32e-5574-45f8-91f8-1c385908dbc9) for task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000 to the agent
3: I1009 14:32:44.607204 17251 slave.cpp:4892] Forwarding the update
TASK_RUNNING (UUID: 5903d32e-5574-45f8-91f8-1c385908dbc9) for task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000 to [email protected]:45196
3: I1009 14:32:44.607499 17251 slave.cpp:4786] Status update manager
successfully handled status update TASK_RUNNING (UUID:
5903d32e-5574-45f8-91f8-1c385908dbc9) for task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000
3: I1009 14:32:44.607583 17251 slave.cpp:4802] Sending acknowledgement for
status update TASK_RUNNING (UUID: 5903d32e-5574-45f8-91f8-1c385908dbc9) for
task cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000 to executor(1)@172.17.0.2:36164
3: I1009 14:32:44.607857 17248 master.cpp:6993] Status update TASK_RUNNING
(UUID: 5903d32e-5574-45f8-91f8-1c385908dbc9) for task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000 from agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at slave(59)@172.17.0.2:45196
(4c36cea139f4)
3: I1009 14:32:44.607956 17248 master.cpp:7055] Forwarding status update
TASK_RUNNING (UUID: 5903d32e-5574-45f8-91f8-1c385908dbc9) for task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000
3: I1009 14:32:44.608155 17248 master.cpp:9157] Updating the state of task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000 (latest state: TASK_RUNNING, status
update state: TASK_RUNNING)
3: I1009 14:32:44.608521 17258 sched.cpp:1025] Scheduler::statusUpdate took
142398ns
3: I1009 14:32:44.608929 17245 master.cpp:5566] Processing ACKNOWLEDGE call
5903d32e-5574-45f8-91f8-1c385908dbc9 for task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000 (Framework 1) at
[email protected]:45196 on agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0
3: I1009 14:32:44.609356 17253 status_update_manager.cpp:395] Received status
update acknowledgement (UUID: 5903d32e-5574-45f8-91f8-1c385908dbc9) for task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000
3: I1009 14:32:44.609527 17253 status_update_manager.cpp:834] Checkpointing ACK
for status update TASK_RUNNING (UUID: 5903d32e-5574-45f8-91f8-1c385908dbc9) for
task cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000
3: I1009 14:32:44.609925 17253 slave.cpp:3695] Status update manager
successfully handled status update acknowledgement (UUID:
5903d32e-5574-45f8-91f8-1c385908dbc9) for task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d of framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000
3: I1009 14:32:44.610273 17239 master.cpp:1145] Master terminating
3: W1009 14:32:44.610399 17239 master.cpp:9237] Removing task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d with resources
[{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
of framework 9b9b3770-d6be-4958-bc33-cff10ae0de17-0000 on agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at slave(59)@172.17.0.2:45196
(4c36cea139f4) in non-removable state TASK_RUNNING
3: I1009 14:32:44.610939 17250 hierarchical.cpp:626] Removed agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0
3: I1009 14:32:44.611913 17250 hierarchical.cpp:355] Removed framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000
3: I1009 14:32:44.612026 17259 slave.cpp:5024] Got exited event for
[email protected]:45196
3: W1009 14:32:44.612049 17259 slave.cpp:5029] Master disconnected! Waiting for
a new master to be elected
3: I1009 14:32:44.615108 17237 sched.cpp:2005] Asked to stop the driver
3: I1009 14:32:44.615205 17251 sched.cpp:1187] Stopping framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000
3: I1009 14:32:44.617620 17237 cluster.cpp:162] Creating default 'local'
authorizer
3: I1009 14:32:44.620221 17240 master.cpp:445] Master
45991738-966f-4f70-8c5f-f555b5c45469 (4c36cea139f4) started on 172.17.0.2:45196
3: I1009 14:32:44.620241 17240 master.cpp:447] Flags at startup: --acls=""
--agent_ping_timeout="15secs" --agent_reregister_timeout="10mins"
--allocation_interval="1secs" --allocator="HierarchicalDRF"
--authenticate_agents="true" --authenticate_frameworks="true"
--authenticate_http_frameworks="true" --authenticate_http_readonly="true"
--authenticate_http_readwrite="true" --authenticators="crammd5"
--authorizers="local" --credentials="/tmp/H8OT9V/credentials"
--filter_gpu_resources="true" --framework_sorter="drf" --help="false"
--hostname_lookup="true" --http_authenticators="basic"
--http_framework_authenticators="basic" --initialize_driver_logging="true"
--log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO"
--max_agent_ping_timeouts="5" --max_completed_frameworks="50"
--max_completed_tasks_per_framework="1000"
--max_unreachable_tasks_per_framework="1000" --port="5050" --quiet="false"
--recovery_agent_removal_limit="100%" --registry="in_memory"
--registry_fetch_timeout="1mins" --registry_gc_interval="15mins"
--registry_max_agent_age="2weeks" --registry_max_agent_count="102400"
--registry_store_timeout="100secs" --registry_strict="false"
--root_submissions="true" --user_sorter="drf" --version="false"
--webui_dir="/usr/local/share/mesos/webui" --work_dir="/tmp/H8OT9V/master"
--zk_session_timeout="10secs"
3: I1009 14:32:44.620631 17240 master.cpp:496] Master only allowing
authenticated frameworks to register
3: I1009 14:32:44.620643 17240 master.cpp:502] Master only allowing
authenticated agents to register
3: I1009 14:32:44.620651 17240 master.cpp:508] Master only allowing
authenticated HTTP frameworks to register
3: I1009 14:32:44.620661 17240 credentials.hpp:37] Loading credentials for
authentication from '/tmp/H8OT9V/credentials'
3: I1009 14:32:44.621049 17240 master.cpp:552] Using default 'crammd5'
authenticator
3: I1009 14:32:44.621263 17240 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-master-readonly'
3: I1009 14:32:44.621451 17240 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-master-readwrite'
3: I1009 14:32:44.621611 17240 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-master-scheduler'
3: I1009 14:32:44.621762 17240 master.cpp:631] Authorization enabled
3: I1009 14:32:44.621953 17258 whitelist_watcher.cpp:77] No whitelist given
3: I1009 14:32:44.622021 17245 hierarchical.cpp:171] Initialized hierarchical
allocator process
3: I1009 14:32:44.625402 17244 master.cpp:2198] Elected as the leading master!
3: I1009 14:32:44.625428 17244 master.cpp:1687] Recovering from registrar
3: I1009 14:32:44.625560 17242 registrar.cpp:347] Recovering registrar
3: I1009 14:32:44.626109 17242 registrar.cpp:391] Successfully fetched the
registry (0B) in 515840ns
3: I1009 14:32:44.626219 17242 registrar.cpp:495] Applied 1 operations in
28313ns; attempting to update the registry
3: I1009 14:32:44.626760 17242 registrar.cpp:552] Successfully updated the
registry in 489728ns
3: I1009 14:32:44.626868 17242 registrar.cpp:424] Successfully recovered
registrar
3: I1009 14:32:44.627198 17261 master.cpp:1791] Recovered 0 agents from the
registry (129B); allowing 10mins for agents to re-register
3: I1009 14:32:44.627213 17258 hierarchical.cpp:209] Skipping recovery of
hierarchical allocator: nothing to recover
3: I1009 14:32:44.627843 17250 status_update_manager.cpp:177] Pausing sending
status updates
3: I1009 14:32:44.627868 17238 slave.cpp:993] New master detected at
[email protected]:45196
3: I1009 14:32:44.627955 17238 slave.cpp:1028] Detecting new master
3: I1009 14:32:44.634227 17239 slave.cpp:1055] Authenticating with master
[email protected]:45196
3: I1009 14:32:44.634287 17239 slave.cpp:1064] Using default CRAM-MD5
authenticatee
3: I1009 14:32:44.634569 17244 authenticatee.cpp:121] Creating new client SASL
connection
3: I1009 14:32:44.634912 17260 master.cpp:7936] Authenticating
slave(59)@172.17.0.2:45196
3: I1009 14:32:44.635037 17259 authenticator.cpp:414] Starting authentication
session for crammd5-authenticatee(137)@172.17.0.2:45196
3: I1009 14:32:44.635282 17255 authenticator.cpp:98] Creating new server SASL
connection
3: I1009 14:32:44.635511 17252 authenticatee.cpp:213] Received SASL
authentication mechanisms: CRAM-MD5
3: I1009 14:32:44.635537 17252 authenticatee.cpp:239] Attempting to
authenticate with mechanism 'CRAM-MD5'
3: I1009 14:32:44.635627 17252 authenticator.cpp:204] Received SASL
authentication start
3: I1009 14:32:44.635682 17252 authenticator.cpp:326] Authentication requires
more steps
3: I1009 14:32:44.635807 17249 authenticatee.cpp:259] Received SASL
authentication step
3: I1009 14:32:44.635953 17254 authenticator.cpp:232] Received SASL
authentication step
3: I1009 14:32:44.635988 17254 auxprop.cpp:109] Request to lookup properties
for user: 'test-principal' realm: '4c36cea139f4' server FQDN: '4c36cea139f4'
SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
SASL_AUXPROP_AUTHZID: false
3: I1009 14:32:44.636006 17254 auxprop.cpp:181] Looking up auxiliary property
'*userPassword'
3: I1009 14:32:44.636054 17254 auxprop.cpp:181] Looking up auxiliary property
'*cmusaslsecretCRAM-MD5'
3: I1009 14:32:44.636081 17254 auxprop.cpp:109] Request to lookup properties
for user: 'test-principal' realm: '4c36cea139f4' server FQDN: '4c36cea139f4'
SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
SASL_AUXPROP_AUTHZID: true
3: I1009 14:32:44.636096 17254 auxprop.cpp:131] Skipping auxiliary property
'*userPassword' since SASL_AUXPROP_AUTHZID == true
3: I1009 14:32:44.636104 17254 auxprop.cpp:131] Skipping auxiliary property
'*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
3: I1009 14:32:44.636124 17254 authenticator.cpp:318] Authentication success
3: I1009 14:32:44.636229 17246 authenticatee.cpp:299] Authentication success
3: I1009 14:32:44.636298 17241 master.cpp:7966] Successfully authenticated
principal 'test-principal' at slave(59)@172.17.0.2:45196
3: I1009 14:32:44.636328 17242 authenticator.cpp:432] Authentication session
cleanup for crammd5-authenticatee(137)@172.17.0.2:45196
3: I1009 14:32:44.636513 17251 slave.cpp:1147] Successfully authenticated with
master [email protected]:45196
3: I1009 14:32:44.637054 17251 slave.cpp:1642] Will retry registration in
1.416192ms if necessary
3: *** Aborted at 1507559564 (unix time) try "date -d @1507559564" if you are
using GNU date ***
3: I1009 14:32:44.637579 17248 master.cpp:6119] Received re-register agent
message from agent 9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at
slave(59)@172.17.0.2:45196 (4c36cea139f4)
3: I1009 14:32:44.637825 17248 master.cpp:3838] Authorizing agent with
principal 'test-principal'
3: I1009 14:32:44.638353 17253 master.cpp:6188] Authorized re-registration of
agent 9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at slave(59)@172.17.0.2:45196
(4c36cea139f4)
3: I1009 14:32:44.638433 17253 master.cpp:6324] Re-registering agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at slave(59)@172.17.0.2:45196
(4c36cea139f4)
3: W1009 14:32:44.638944 17256 master.hpp:2224] Allowing UNKNOWN agent to
reregister: hostname: "4c36cea139f4"
3: resources {
3: name: "cpus"
3: type: SCALAR
3: scalar {
3: value: 2
3: }
3: role: "*"
3: }
3: resources {
3: name: "mem"
3: type: SCALAR
3: scalar {
3: value: 1024
3: }
3: role: "*"
3: }
3: resources {
3: name: "disk"
3: type: SCALAR
3: scalar {
3: value: 1024
3: }
3: role: "*"
3: }
3: resources {
3: name: "ports"
3: type: RANGES
3: ranges {
3: range {
3: begin: 31000
3: end: 32000
3: }
3: }
3: role: "*"
3: }
3: id {
3: value: "9b9b3770-d6be-4958-bc33-cff10ae0de17-S0"
3: }
3: checkpoint: true
3: port: 45196
3: I1009 14:32:44.639232 17256 registrar.cpp:495] Applied 1 operations in
336929ns; attempting to update the registry
3: PC: @ 0x2b686836a104 process::EventQueue::Consumer::empty()
3: *** SIGSEGV (@0x8) received by PID 17237 (TID 0x2b687496e700) from PID 8;
stack trace: ***
3: I1009 14:32:44.639811 17250 slave.cpp:1642] Will retry registration in
21.825496ms if necessary
3: @ 0x2b6868ad5330 (unknown)
3: I1009 14:32:44.639966 17256 registrar.cpp:552] Successfully updated the
registry in 667136ns
3: I1009 14:32:44.640117 17260 master.cpp:6084] Ignoring re-register agent
message from agent 9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at
slave(59)@172.17.0.2:45196 (4c36cea139f4) as re-registration is already in
progress
3: I1009 14:32:44.640242 17260 master.cpp:6393] Re-admitted agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at slave(59)@172.17.0.2:45196
(4c36cea139f4)
3: I1009 14:32:44.640743 17260 master.cpp:10135] Adding task
cb78dc3a-717e-4a2d-b6f7-fb80c0ba9f9d with resources
[{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
on agent 9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at slave(59)@172.17.0.2:45196
(4c36cea139f4)
3: I1009 14:32:44.641433 17255 slave.cpp:4982] Received ping from
slave-observer(53)@172.17.0.2:45196
3: I1009 14:32:44.641490 17260 master.cpp:6571] Re-registered agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at slave(59)@172.17.0.2:45196
(4c36cea139f4) with
[{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
3: I1009 14:32:44.641749 17260 master.cpp:6654] Recovering framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000 from re-registering agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at slave(59)@172.17.0.2:45196
(4c36cea139f4)
3: I1009 14:32:44.641808 17255 slave.cpp:1313] Re-registered with master
[email protected]:45196
3: I1009 14:32:44.641847 17257 hierarchical.cpp:593] Added agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 (4c36cea139f4) with cpus:2; mem:1024;
disk:1024; ports:[31000-32000] (allocated: cpus(allocated: *):2; mem(allocated:
*):1024; disk(allocated: *):1024; ports(allocated: *):[31000-32000])
3: I1009 14:32:44.641917 17249 status_update_manager.cpp:184] Resuming sending
status updates
3: I1009 14:32:44.641906 17255 slave.cpp:1351] Forwarding total resources
cpus:2; mem:1024; disk:1024; ports:[31000-32000]
3: I1009 14:32:44.641985 17255 slave.cpp:1360] Forwarding total oversubscribed
resources {}
3: I1009 14:32:44.642164 17257 hierarchical.cpp:1943] No allocations performed
3: I1009 14:32:44.642222 17257 hierarchical.cpp:1486] Performed allocation for
1 agents in 176354ns
3: @ 0x2b686836a104 process::EventQueue::Consumer::empty()
3: I1009 14:32:44.642460 17260 master.cpp:6694] Sending updated checkpointed
resources {} to agent 9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at
slave(59)@172.17.0.2:45196 (4c36cea139f4)
3: I1009 14:32:44.642587 17242 slave.cpp:3462] Ignoring new checkpointed
resources identical to the current version: {}
3: W1009 14:32:44.642791 17237 process.cpp:3194] Attempted to spawn already
running process [email protected]:45196
3: I1009 14:32:44.642801 17260 master.cpp:6804] Received update of agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at slave(59)@172.17.0.2:45196
(4c36cea139f4) with total resources cpus:2; mem:1024; disk:1024;
ports:[31000-32000]
3: I1009 14:32:44.642875 17260 master.cpp:6817] Received update of agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at slave(59)@172.17.0.2:45196
(4c36cea139f4) with total oversubscribed resources {}
3: I1009 14:32:44.643102 17260 master.cpp:6828] Ignoring update on agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0 at slave(59)@172.17.0.2:45196
(4c36cea139f4) as it reports no changes
3: I1009 14:32:44.643549 17261 hierarchical.cpp:303] Added framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000
3: I1009 14:32:44.643568 17237 sched.cpp:232] Version: 1.5.0
3: I1009 14:32:44.643597 17261 hierarchical.cpp:412] Deactivated framework
9b9b3770-d6be-4958-bc33-cff10ae0de17-0000
3: @ 0x2b686834ffbe process::ProcessManager::resume()
3: I1009 14:32:44.644179 17250 sched.cpp:336] New master detected at
[email protected]:45196
3: I1009 14:32:44.644290 17250 sched.cpp:396] Authenticating with master
[email protected]:45196
3: I1009 14:32:44.644306 17250 sched.cpp:403] Using default CRAM-MD5
authenticatee
3: @ 0x2b686834c6f8
_ZZN7process14ProcessManager12init_threadsEvENKUlvE_clEv
3: I1009 14:32:44.644542 17256 authenticatee.cpp:121] Creating new client SASL
connection
3: I1009 14:32:44.644791 17252 master.cpp:7936] Authenticating
[email protected]:45196
3: @ 0x2b686835defa
_ZNSt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUlvE_vEE9_M_invokeIIEEEvSt12_Index_tupleIIXspT_EEE
3: I1009 14:32:44.644897 17247 authenticator.cpp:414] Starting authentication
session for crammd5-authenticatee(138)@172.17.0.2:45196
3: I1009 14:32:44.645148 17249 authenticator.cpp:98] Creating new server SASL
connection
3: @ 0x2b686835de51
_ZNSt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUlvE_vEEclEv
3: I1009 14:32:44.645354 17254 authenticatee.cpp:213] Received SASL
authentication mechanisms: CRAM-MD5
3: I1009 14:32:44.645380 17254 authenticatee.cpp:239] Attempting to
authenticate with mechanism 'CRAM-MD5'
3: I1009 14:32:44.645476 17255 authenticator.cpp:204] Received SASL
authentication start
3: I1009 14:32:44.645531 17255 authenticator.cpp:326] Authentication requires
more steps
3: @ 0x2b686835ddea
_ZNSt6thread5_ImplISt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvEUlvE_vEEE6_M_runEv
3: I1009 14:32:44.645639 17241 authenticatee.cpp:259] Received SASL
authentication step
3: @ 0x2b686ac92a60 (unknown)
3: I1009 14:32:44.645792 17243 authenticator.cpp:232] Received SASL
authentication step
3: I1009 14:32:44.645825 17243 auxprop.cpp:109] Request to lookup properties
for user: 'test-principal' realm: '4c36cea139f4' server FQDN: '4c36cea139f4'
SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
SASL_AUXPROP_AUTHZID: false
3: I1009 14:32:44.645843 17243 auxprop.cpp:181] Looking up auxiliary property
'*userPassword'
3: @ 0x2b6868acd184 start_thread
3: I1009 14:32:44.645891 17243 auxprop.cpp:181] Looking up auxiliary property
'*cmusaslsecretCRAM-MD5'
3: I1009 14:32:44.645920 17243 auxprop.cpp:109] Request to lookup properties
for user: 'test-principal' realm: '4c36cea139f4' server FQDN: '4c36cea139f4'
SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
SASL_AUXPROP_AUTHZID: true
3: I1009 14:32:44.645934 17243 auxprop.cpp:131] Skipping auxiliary property
'*userPassword' since SASL_AUXPROP_AUTHZID == true
3: I1009 14:32:44.645944 17243 auxprop.cpp:131] Skipping auxiliary property
'*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
3: I1009 14:32:44.645967 17243 authenticator.cpp:318] Authentication success
3: I1009 14:32:44.646044 17257 authenticatee.cpp:299] Authentication success
3: @ 0x2b686b4feffd (unknown)
3: I1009 14:32:44.646118 17258 master.cpp:7966] Successfully authenticated
principal 'test-principal' at
[email protected]:45196
3: I1009 14:32:44.695025 18181 exec.cpp:508] Agent exited, but framework has
checkpointing enabled. Waiting 15mins to reconnect with agent
9b9b3770-d6be-4958-bc33-cff10ae0de17-S0
3: I1009 14:33:44.792165 18186 executor.cpp:925] Command exited with status 0
(pid: 18200)
3: E1009 14:33:44.795965 18199 process.cpp:2577] Failed to shutdown socket with
fd 7, address 172.17.0.2:56170: Transport endpoint is not connected
3: I1009 14:33:45.796049 18199 process.cpp:1068] Failed to accept socket:
future discarded
3/3 Test #3: MesosTests .......................***Exception: SegFault107.37 sec
67% tests passed, 1 tests failed out of 3
Total Test time (real) = 126.60 sec
The following tests FAILED:
3 - MesosTests (SEGFAULT)
Errors while running CTest
make[3]: *** [CMakeFiles/check] Error 8
make[3]: Leaving directory `/mesos/build'
make[2]: *** [CMakeFiles/check.dir/all] Error 2
make[2]: Leaving directory `/mesos/build'
make[1]: *** [CMakeFiles/check.dir/rule] Error 2
make[1]: Leaving directory `/mesos/build'
make: *** [check] Error 2
+ docker rmi mesos-1507557282-9888
Untagged: mesos-1507557282-9888:latest
Deleted: sha256:565ae5087c22af01129c5acff1bb1dd9e2e93b6f0ef8285ff1d9c03f8bb6b84f
Deleted: sha256:5dca4c3cf9a4667ac163a296fe3adee14f95394811a5768c29e53a086520f65d
Deleted: sha256:409425f1957225472ada2507cbdf5cef7d0b9cf6893eb9287aeb638415dfc62e
Deleted: sha256:4ada94ed4a96c2f0704eb901c25b60d014d7699e79aee97516bbb432fdfde0fc
Deleted: sha256:2fce5778c6b3ab5ec2a6124952e9cbab58751d5806efc325ed66ef868120dd20
Deleted: sha256:436634cf6be5deb422a5204f13cd3990db58b9ad5f232be9ec83eedaa3d88a03
Deleted: sha256:7b9951a5b862012a7be46dbfe3cd5d68f1c229c1761ddf50b484396bc116e062
Deleted: sha256:d2f985ce49074c58d9fdfbd60d994b7a73c7e28219fb59d0efc12ce201347eb3
Deleted: sha256:c6d63b8056ede0357ca36ef8947cc910b2a1886e576e80902a3e159cdcdd9406
Deleted: sha256:fcb519c264702e2b2a2173e622d582ea5fd49cfb907b145f844304bd58b5d5ea
Deleted: sha256:be804dd1491bcf5716b7609104aef2546d5f5a6faf301489775610297720b1a6
Deleted: sha256:488d4f25bf57bc227bd77bf3f7158fc947db9f598ab85e4380d0cdd5c43c4559
Deleted: sha256:a204748fdfb7d9704fca8aadb55df58c379821ceb0f406e6963ad74d7270a1c3
Deleted: sha256:4673d17a746f001fe43c8dd327645483aef3afcbbddba301a81bd3bef5634f66
Deleted: sha256:a791eb15c43dc940630eb8f37c255030d6ca2a475069d7d84fead5d42bb770e4
Deleted: sha256:dce6c4482c9daa468b12e411d7c481c58a72fa29600c44d01b38b95bfa29f019
Deleted: sha256:7a19e2b79479a34ca2246885ac34f21fac793c3d27f70569dc67bf04af1a6962
Deleted: sha256:1bda4372762b6fc3edc83fcab0cab81c4c53a2ccfe1e4d01bc371dfd0dabc2f1
Deleted: sha256:61fd156d867b6025d24f4062ad14dc8f66e5126bebf34f4e3c76b1728f1906de
Deleted: sha256:74ae88f587cc59ed5a9d484b60964f85668a52b2d7f473d4985278fdea3cb100
Deleted: sha256:0c9f30a7f70beb0a8f64a00a4a744523b07579c9b6f1086a378b238cb40e90ae
Deleted: sha256:65ab04f3f7f58414e16c775bbb2e364a9fb0c07a6431b7734dd33590454d4e16
Deleted: sha256:52468487cbaf94460eb25f629e503c907f913871ed81108f6161284988e482ed
Deleted: sha256:21b5c5170ecdeca47c303592d3bd992f02b7c7067d31978e8f53bbf965ebd06e
Deleted: sha256:bf5cb5ab8800a91bb7dd86e8cbadb54683fe6ee8dd05c586c0cf810f142303d5
Deleted: sha256:a196a2739bac2a2c30de67a7e75c4cc5e82fc0ed5b65afab1f42195c08d851be
Deleted: sha256:81318b08864b1e54c1c0c25c73c16c426b745db88b71f8c26f520d2462ede4a0
Deleted: sha256:deb9c31e60117002ba401d0c41c35caa122a8d3ca07e46f6e6c7efb853a8872c
Build step 'Execute shell' marked build as failure
