See
<https://builds.apache.org/job/Mesos-Buildbot-ARM/BUILDTOOL=cmake,COMPILER=clang,CONFIGURATION=--verbose%20--disable-libtool-wrappers%20--disable-java%20--disable-python%20--disable-parallel-test-execution,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1%20%20MESOS_TEST_AWAIT_TIMEOUT=60secs%20JOBS=16%20GTEST_FILTER=-DiskQuotaTest.SlaveRecovery,label_exp=arm/1615/display/redirect?page=changes>
Changes:
[bmahler] Avoid double reaping race in the command executor.
------------------------------------------
[...truncated 38.20 MB...]
3: I1023 19:29:28.131732 18380 master.cpp:2741] Subscribing framework 'default'
with checkpointing disabled and capabilities [ MULTI_ROLE,
RESERVATION_REFINEMENT ]
3: I1023 19:29:28.139951 18380 master.cpp:10824] Adding framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default) with roles { } suppressed
3: I1023 19:29:28.142438 18369 hierarchical.cpp:700] Added framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000
3: I1023 19:29:28.145841 18369 hierarchical.cpp:1843] Performed allocation for
1 agents in 2.907875ms
3: I1023 19:29:28.146153 18320 scheduler.cpp:847] Enqueuing event SUBSCRIBED
received from http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.147341 18318 master.cpp:10409] Sending offers [
c6ad0cf5-223e-47b4-a28f-c545fd91329f-O0 ] to framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default)
3: I1023 19:29:28.147785 18320 scheduler.cpp:847] Enqueuing event HEARTBEAT
received from http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.153996 18352 scheduler.cpp:847] Enqueuing event OFFERS
received from http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.163339 18338 hierarchical.cpp:1843] Performed allocation for
1 agents in 762610ns
3: I1023 19:29:28.166307 18364 scheduler.cpp:246] Adding authentication headers
to ACCEPT call to http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.167755 18326 scheduler.cpp:600] Sending ACCEPT call to
http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.170730 18326 process.cpp:3671] Handling HTTP event for
process 'master' with path: '/master/api/v1/scheduler'
3: I1023 19:29:28.175668 18376 http.cpp:1115] HTTP POST for
/master/api/v1/scheduler from 172.17.0.2:44920
3: I1023 19:29:28.179292 18376 master.cpp:4719] Processing ACCEPT call for
offers: [ c6ad0cf5-223e-47b4-a28f-c545fd91329f-O0 ] on agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 at slave(1020)@172.17.0.2:44153
(e7ac6ac5fe01) for framework c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default)
3: I1023 19:29:28.179538 18376 master.cpp:4099] Authorizing principal
'test-principal' to create a MOUNT disk from 'disk(allocated:
default-role)[RAW(,,profile)]:200'
3: I1023 19:29:28.183080 18371 master.cpp:12706] Removing offer
c6ad0cf5-223e-47b4-a28f-c545fd91329f-O0
3: I1023 19:29:28.183591 18371 master.cpp:6011] Processing CREATE_DISK
operation with source disk(allocated: default-role)[RAW(,,profile)]:200 from
framework c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default) to agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 at slave(1020)@172.17.0.2:44153
(e7ac6ac5fe01)
3: I1023 19:29:28.184880 18371 master.cpp:12571] Sending operation 'operation'
(uuid: a209a738-3d33-4a81-80f5-2297babb8a8c) to agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 at slave(1020)@172.17.0.2:44153
(e7ac6ac5fe01)
3: I1023 19:29:28.185726 18377 hierarchical.cpp:1767] Allocation paused
3: I1023 19:29:28.186673 18346 slave.cpp:4352] Ignoring new checkpointed
resources and operations identical to the current version
3: I1023 19:29:28.186671 18377 hierarchical.cpp:1566] Recovered
ports(allocated: default-role):[31000-32000]; cpus(allocated: default-role):2;
mem(allocated: default-role):1024; disk(allocated: default-role):1024 (total:
cpus:2; mem:1024; disk:1024; ports:[31000-32000]; disk[RAW(,,profile)]:200,
offered or allocated: disk(allocated: default-role)[RAW(,,profile)]:200) on
agent c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 from framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000
3: I1023 19:29:28.188663 18377 hierarchical.cpp:1615] Framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 filtered agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 for 5secs
3: I1023 19:29:28.189416 18377 hierarchical.cpp:1777] Allocation resumed
3: I1023 19:29:28.200668 18294 master.cpp:1137] Master terminating
3: I1023 19:29:28.201587 18339 slave.cpp:1344] Lost leading master
3: I1023 19:29:28.201637 18339 slave.cpp:1416] Detecting new master
3: I1023 19:29:28.201696 18386 status_update_manager_process.hpp:379] Pausing
operation status update manager
3: I1023 19:29:28.202177 18355 scheduler.cpp:503] Lost leading master
3: I1023 19:29:28.202301 18335 task_status_update_manager.cpp:181] Pausing
sending task status updates
3: I1023 19:29:28.203656 18355 scheduler.cpp:450] Ignoring disconnection
attempt from stale connection
3: I1023 19:29:28.203773 18355 scheduler.cpp:450] Ignoring disconnection
attempt from stale connection
3: I1023 19:29:28.203934 18355 scheduler.cpp:801] Ignoring event from old stale
connection
3: I1023 19:29:28.204329 18347 hierarchical.cpp:1122] Removed all filters for
agent c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0
3: I1023 19:29:28.204432 18347 hierarchical.cpp:998] Removed agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0
3: I1023 19:29:28.207342 18347 hierarchical.cpp:757] Removed framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000
3: I1023 19:29:28.209647 18380 slave.cpp:6457] Got exited event for
[email protected]:44153
3: W1023 19:29:28.209733 18380 slave.cpp:6462] Master disconnected! Waiting for
a new master to be elected
3: I1023 19:29:28.232175 18294 cluster.cpp:177] Creating default 'local'
authorizer
3: I1023 19:29:28.247988 18374 master.cpp:440] Master
eceadd1a-ebf4-4970-8298-d5e2af91855d (e7ac6ac5fe01) started on 172.17.0.2:44153
3: I1023 19:29:28.248149 18374 master.cpp:443] Flags at startup: --acls=""
--agent_ping_timeout="15secs" --agent_reregister_timeout="10mins"
--allocation_interval="1secs" --allocator="hierarchical"
--authenticate_agents="true" --authenticate_frameworks="true"
--authenticate_http_frameworks="true" --authenticate_http_readonly="true"
--authenticate_http_readwrite="true" --authentication_v0_timeout="15secs"
--authenticators="crammd5" --authorizers="local"
--credentials="/tmp/jyLWLs/credentials" --filter_gpu_resources="true"
--framework_sorter="drf" --help="false" --hostname_lookup="true"
--http_authenticators="basic" --http_framework_authenticators="basic"
--initialize_driver_logging="true" --log_auto_initialize="true"
--logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5"
--max_completed_frameworks="50" --max_completed_tasks_per_framework="1000"
--max_operator_event_stream_subscribers="1000"
--max_unreachable_tasks_per_framework="1000" --memory_profiling="false"
--min_allocatable_resources="cpus:0.01|mem:32" --port="5050"
--publish_per_framework_metrics="true" --quiet="false"
--recovery_agent_removal_limit="100%" --registry="in_memory"
--registry_fetch_timeout="1mins" --registry_gc_interval="15mins"
--registry_max_agent_age="2weeks" --registry_max_agent_count="102400"
--registry_store_timeout="100secs" --registry_strict="false"
--require_agent_domain="false" --role_sorter="drf" --root_submissions="true"
--version="false" --webui_dir="/usr/local/share/mesos/webui"
--work_dir="/tmp/jyLWLs/master" --zk_session_timeout="10secs"
3: I1023 19:29:28.249464 18374 master.cpp:492] Master only allowing
authenticated frameworks to register
3: I1023 19:29:28.249511 18374 master.cpp:498] Master only allowing
authenticated agents to register
3: I1023 19:29:28.249569 18374 master.cpp:504] Master only allowing
authenticated HTTP frameworks to register
3: I1023 19:29:28.249627 18374 credentials.hpp:37] Loading credentials for
authentication from '/tmp/jyLWLs/credentials'
3: I1023 19:29:28.250298 18374 master.cpp:548] Using default 'crammd5'
authenticator
3: I1023 19:29:28.251142 18374 http.cpp:975] Creating default 'basic' HTTP
authenticator for realm 'mesos-master-readonly'
3: I1023 19:29:28.251826 18374 http.cpp:975] Creating default 'basic' HTTP
authenticator for realm 'mesos-master-readwrite'
3: I1023 19:29:28.252288 18374 http.cpp:975] Creating default 'basic' HTTP
authenticator for realm 'mesos-master-scheduler'
3: I1023 19:29:28.252645 18374 master.cpp:629] Authorization enabled
3: I1023 19:29:28.253876 18296 whitelist_watcher.cpp:77] No whitelist given
3: I1023 19:29:28.253912 18326 hierarchical.cpp:567] Initialized hierarchical
allocator process
3: I1023 19:29:28.265239 18345 master.cpp:2169] Elected as the leading master!
3: I1023 19:29:28.265358 18345 master.cpp:1665] Recovering from registrar
3: I1023 19:29:28.266254 18306 registrar.cpp:339] Recovering registrar
3: I1023 19:29:28.268180 18306 registrar.cpp:383] Successfully fetched the
registry (0B) in 0ns
3: I1023 19:29:28.268493 18306 registrar.cpp:487] Applied 1 operations in
108953ns; attempting to update the registry
3: I1023 19:29:28.269976 18306 registrar.cpp:544] Successfully updated the
registry in 0ns
3: I1023 19:29:28.270313 18306 registrar.cpp:416] Successfully recovered
registrar
3: I1023 19:29:28.271534 18363 hierarchical.cpp:606] Skipping recovery of
hierarchical allocator: nothing to recover
3: I1023 19:29:28.271524 18366 master.cpp:1818] Recovered 0 agents from the
registry (144B); allowing 10mins for agents to reregister
3: I1023 19:29:28.275988 18389 task_status_update_manager.cpp:181] Pausing
sending task status updates
3: I1023 19:29:28.275962 18358 scheduler.cpp:525] New master detected at
[email protected]:44153
3: I1023 19:29:28.276067 18356 slave.cpp:1351] New master detected at
[email protected]:44153
3: I1023 19:29:28.276362 18356 slave.cpp:1416] Detecting new master
3: I1023 19:29:28.276546 18358 scheduler.cpp:534] Waiting for 0ns before
initiating a re-(connection) attempt with the master
3: I1023 19:29:28.276125 18383 status_update_manager_process.hpp:379] Pausing
operation status update manager
3: I1023 19:29:28.282675 18310 slave.cpp:1443] Authenticating with master
[email protected]:44153
3: I1023 19:29:28.283257 18310 slave.cpp:1452] Using default CRAM-MD5
authenticatee
3: I1023 19:29:28.284922 18343 authenticatee.cpp:121] Creating new client SASL
connection
3: I1023 19:29:28.286044 18348 master.cpp:10594] Authenticating
slave(1020)@172.17.0.2:44153
3: I1023 19:29:28.286468 18335 authenticator.cpp:414] Starting authentication
session for crammd5-authenticatee(1763)@172.17.0.2:44153
3: I1023 19:29:28.287219 18390 authenticator.cpp:98] Creating new server SASL
connection
3: I1023 19:29:28.287991 18324 authenticatee.cpp:213] Received SASL
authentication mechanisms: CRAM-MD5
3: I1023 19:29:28.288090 18324 authenticatee.cpp:239] Attempting to
authenticate with mechanism 'CRAM-MD5'
3: I1023 19:29:28.288409 18332 authenticator.cpp:204] Received SASL
authentication start
3: I1023 19:29:28.288590 18332 authenticator.cpp:326] Authentication requires
more steps
3: I1023 19:29:28.288635 18328 scheduler.cpp:416] Connected with the master at
http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.288882 18304 authenticatee.cpp:259] Received SASL
authentication step
3: I1023 19:29:28.289177 18388 authenticator.cpp:232] Received SASL
authentication step
3: I1023 19:29:28.289294 18388 auxprop.cpp:109] Request to lookup properties
for user: 'test-principal' realm: 'e7ac6ac5fe01' server FQDN: 'e7ac6ac5fe01'
SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
SASL_AUXPROP_AUTHZID: false
3: I1023 19:29:28.289362 18388 auxprop.cpp:181] Looking up auxiliary property
'*userPassword'
3: I1023 19:29:28.289542 18388 auxprop.cpp:181] Looking up auxiliary property
'*cmusaslsecretCRAM-MD5'
3: I1023 19:29:28.289659 18388 auxprop.cpp:109] Request to lookup properties
for user: 'test-principal' realm: 'e7ac6ac5fe01' server FQDN: 'e7ac6ac5fe01'
SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
SASL_AUXPROP_AUTHZID: true
3: I1023 19:29:28.289775 18388 auxprop.cpp:131] Skipping auxiliary property
'*userPassword' since SASL_AUXPROP_AUTHZID == true
3: I1023 19:29:28.289830 18388 auxprop.cpp:131] Skipping auxiliary property
'*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
3: I1023 19:29:28.289916 18388 authenticator.cpp:318] Authentication success
3: I1023 19:29:28.290184 18313 authenticatee.cpp:299] Authentication success
3: I1023 19:29:28.290380 18355 master.cpp:10626] Successfully authenticated
principal 'test-principal' at slave(1020)@172.17.0.2:44153
3: I1023 19:29:28.290410 18312 authenticator.cpp:432] Authentication session
cleanup for crammd5-authenticatee(1763)@172.17.0.2:44153
3: I1023 19:29:28.291019 18298 scheduler.cpp:246] Adding authentication headers
to SUBSCRIBE call to http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.291076 18388 slave.cpp:1543] Successfully authenticated with
master [email protected]:44153
3: I1023 19:29:28.291955 18353 scheduler.cpp:600] Sending SUBSCRIBE call to
http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.292863 18388 slave.cpp:1993] Will retry registration in
17.70929ms if necessary
3: I1023 19:29:28.293473 18380 master.cpp:7434] Received reregister agent
message from agent c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 at
slave(1020)@172.17.0.2:44153 (e7ac6ac5fe01)
3: I1023 19:29:28.294467 18380 master.cpp:4189] Authorizing agent providing
resources 'cpus:2; mem:1024; disk:1024; ports:[31000-32000]' with principal
'test-principal'
3: I1023 19:29:28.296161 18380 process.cpp:3671] Handling HTTP event for
process 'master' with path: '/master/api/v1/scheduler'
3: I1023 19:29:28.297735 18380 master.cpp:7526] Authorized re-registration of
agent c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 at slave(1020)@172.17.0.2:44153
(e7ac6ac5fe01)
3: I1023 19:29:28.298000 18380 master.cpp:7698] Consulting registry about agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 at
slave(1020)@172.17.0.2:44153(e7ac6ac5fe01)
3: W1023 19:29:28.299048 18370 registry_operations.cpp:200] Allowing UNKNOWN
agent to reregister: hostname: "e7ac6ac5fe01"
3: resources {
3: name: "cpus"
3: type: SCALAR
3: scalar {
3: value: 2
3: }
3: }
3: resources {
3: name: "mem"
3: type: SCALAR
3: scalar {
3: value: 1024
3: }
3: }
3: resources {
3: name: "disk"
3: type: SCALAR
3: scalar {
3: value: 1024
3: }
3: }
3: resources {
3: name: "ports"
3: type: RANGES
3: ranges {
3: range {
3: begin: 31000
3: end: 32000
3: }
3: }
3: }
3: id {
3: value: "c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0"
3: }
3: checkpoint: true
3: port: 44153
3: I1023 19:29:28.300258 18370 registrar.cpp:487] Applied 1 operations in
1.454567ms; attempting to update the registry
3: I1023 19:29:28.301940 18370 registrar.cpp:544] Successfully updated the
registry in 1.495808ms
3: I1023 19:29:28.306037 18380 master.cpp:7754] Re-admitted agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 at slave(1020)@172.17.0.2:44153
(e7ac6ac5fe01)
3: I1023 19:29:28.308312 18380 master.cpp:7975] Re-registered agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 at slave(1020)@172.17.0.2:44153
(e7ac6ac5fe01) with cpus:2; mem:1024; disk:1024; ports:[31000-32000]
3: I1023 19:29:28.308840 18368 hierarchical.cpp:955] Added agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 (e7ac6ac5fe01) with cpus:2; mem:1024;
disk:1024; ports:[31000-32000] (offered or allocated: {})
3: I1023 19:29:28.309424 18323 slave.cpp:1700] Re-registered with master
[email protected]:44153
3: I1023 19:29:28.309775 18337 task_status_update_manager.cpp:188] Resuming
sending task status updates
3: I1023 19:29:28.309886 18300 status_update_manager_process.hpp:385] Resuming
operation status update manager
3: I1023 19:29:28.310716 18368 hierarchical.cpp:1843] Performed allocation for
1 agents in 314988ns
3: I1023 19:29:28.310796 18340 http.cpp:1115] HTTP POST for
/master/api/v1/scheduler from 172.17.0.2:44922
3: I1023 19:29:28.312388 18340 master.cpp:2669] Received subscription request
for HTTP framework 'default'
3: I1023 19:29:28.312575 18340 master.cpp:2241] Authorizing framework principal
'test-principal' to receive offers for roles '{ default-role }'
3: I1023 19:29:28.310592 18323 slave.cpp:1746] Forwarding agent update
{"operations":{},"resource_providers":{"providers":[{"info":{"id":{"value":"b2b36790-0d9c-40d2-aebf-b230aa124977"},"name":"test","type":"org.apache.mesos.rp.test"},"operations":{"operations":[{"framework_id":{"value":"c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000"},"info":{"create_disk":{"source":{"allocation_info":{"role":"default-role"},"disk":{"source":{"profile":"profile","type":"RAW"}},"name":"disk","provider_id":{"value":"b2b36790-0d9c-40d2-aebf-b230aa124977"},"scalar":{"value":200.0},"type":"SCALAR"},"target_type":"MOUNT"},"id":{"value":"operation"},"type":"CREATE_DISK"},"latest_status":{"operation_id":{"value":"operation"},"resource_provider_id":{"value":"b2b36790-0d9c-40d2-aebf-b230aa124977"},"slave_id":{"value":"c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0"},"state":"OPERATION_PENDING"},"slave_id":{"value":"c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0"},"uuid":{"value":"ogmnOD0zSoGA9SKXuruKjA=="}}]},"resource_version_uuid":{"value":"hhuXVWBKQV6AvvvqhT7rpA=="},"total_resources":[{"disk":{"source":{"profile":"profile","type":"RAW"}},"name":"disk","provider_id":{"value":"b2b36790-0d9c-40d2-aebf-b230aa124977"},"scalar":{"value":200.0},"type":"SCALAR"}]}]},"resource_version_uuid":{"value":"T7trAOYcTGm2dPgaBmYFlw=="},"slave_id":{"value":"c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0"},"update_oversubscribed_resources":false}
3: I1023 19:29:28.320204 18365 master.cpp:13672] Marking operation
a209a738-3d33-4a81-80f5-2297babb8a8c (ID: operation) (Agent:
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0) (Framework:
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000) in state OPERATION_PENDING as an
orphan
3: I1023 19:29:28.322115 18365 master.cpp:2741] Subscribing framework 'default'
with checkpointing disabled and capabilities [ MULTI_ROLE,
RESERVATION_REFINEMENT ]
3: I1023 19:29:28.322710 18311 hierarchical.cpp:1100] Grew agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 by disk[RAW(,,profile)]:200 (total), {
} (used)
3: I1023 19:29:28.324322 18311 hierarchical.cpp:1057] Agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 (e7ac6ac5fe01) updated with total
resources cpus:2; mem:1024; disk:1024; ports:[31000-32000]
3: I1023 19:29:28.325035 18311 hierarchical.cpp:1843] Performed allocation for
1 agents in 313098ns
3: I1023 19:29:28.328022 18365 master.cpp:10926] Recovered orphan operation
a209a738-3d33-4a81-80f5-2297babb8a8c (ID: operation) on agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 belonging to framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 in state OPERATION_PENDING
3: I1023 19:29:28.330056 18371 hierarchical.cpp:1100] Grew agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 by disk[RAW(,,profile)]:200 (total), {
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000: disk(allocated:
default-role)[RAW(,,profile)]:200 } (used)
3: I1023 19:29:28.330426 18365 master.cpp:10824] Adding framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default) with roles { } suppressed
3: I1023 19:29:28.331130 18365 master.cpp:8295] Updating framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default) with roles { } suppressed
3: I1023 19:29:28.334178 18306 hierarchical.cpp:700] Added framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000
3: I1023 19:29:28.334241 18359 slave.cpp:4222] Ignoring info update for
framework c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 because it does not exist
3: I1023 19:29:28.334312 18306 hierarchical.cpp:813] Deactivated framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000
3: I1023 19:29:28.334657 18306 hierarchical.cpp:1671] Suppressed offers for
roles { } of framework c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000
3: I1023 19:29:28.334733 18306 hierarchical.cpp:1711] Unsuppressed offers and
cleared filters for roles { } of framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000
3: I1023 19:29:28.334978 18306 hierarchical.cpp:783] Activated framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000
3: I1023 19:29:28.336144 18344 scheduler.cpp:847] Enqueuing event SUBSCRIBED
received from http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.337411 18344 scheduler.cpp:847] Enqueuing event HEARTBEAT
received from http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.338312 18306 hierarchical.cpp:1843] Performed allocation for
1 agents in 3.015178ms
3: I1023 19:29:28.340566 18382 master.cpp:10409] Sending offers [
eceadd1a-ebf4-4970-8298-d5e2af91855d-O0 ] to framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default)
3: I1023 19:29:28.342314 18348 scheduler.cpp:273] Sending RECONCILE_OPERATIONS
call to http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.346527 18331 process.cpp:3671] Handling HTTP event for
process 'master' with path: '/master/api/v1/scheduler'
3: I1023 19:29:28.347487 18385 scheduler.cpp:847] Enqueuing event OFFERS
received from http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.350656 18313 http.cpp:1115] HTTP POST for
/master/api/v1/scheduler from 172.17.0.2:44924
3: I1023 19:29:28.351425 18315 scheduler.cpp:246] Adding authentication headers
to DECLINE call to http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.352118 18313 master.cpp:10029] Performing explicit operation
state reconciliation for 1 operations of framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default)
3: I1023 19:29:28.352469 18330 scheduler.cpp:600] Sending DECLINE call to
http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.357215 18297 process.cpp:3671] Handling HTTP event for
process 'master' with path: '/master/api/v1/scheduler'
3: I1023 19:29:28.360199 18303 scheduler.cpp:847] Enqueuing event
UPDATE_OPERATION_STATUS received from
http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.362089 18378 http.cpp:1115] HTTP POST for
/master/api/v1/scheduler from 172.17.0.2:44924
3: I1023 19:29:28.363382 18378 master.cpp:6227] Processing DECLINE call for
offers: [ eceadd1a-ebf4-4970-8298-d5e2af91855d-O0 ] for framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default) with 5 seconds filter
3: I1023 19:29:28.365414 18327 hierarchical.cpp:1566] Recovered
ports(allocated: default-role):[31000-32000]; cpus(allocated: default-role):2;
mem(allocated: default-role):1024; disk(allocated: default-role):1024;
disk(allocated: default-role)[RAW(,,profile)]:200 (total: cpus:2; mem:1024;
disk:1024; ports:[31000-32000]; disk[RAW(,,profile)]:200, offered or allocated:
{}) on agent c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 from framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000
3: I1023 19:29:28.365644 18378 master.cpp:12706] Removing offer
eceadd1a-ebf4-4970-8298-d5e2af91855d-O0
3: I1023 19:29:28.368011 18327 hierarchical.cpp:1615] Framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 filtered agent
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0 for 5secs
3: I1023 19:29:28.371263 18333 scheduler.cpp:273] Sending RECONCILE_OPERATIONS
call to http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.375851 18337 process.cpp:3671] Handling HTTP event for
process 'master' with path: '/master/api/v1/scheduler'
3: I1023 19:29:28.420132 18305 http.cpp:1115] HTTP POST for
/master/api/v1/scheduler from 172.17.0.2:44924
3: I1023 19:29:28.421167 18305 master.cpp:10009] Performing implicit operation
state reconciliation for framework c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000
(default)
3: I1023 19:29:28.421993 18305 master.cpp:10029] Performing explicit operation
state reconciliation for 0 operations of framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default)
3: I1023 19:29:28.423950 18340 scheduler.cpp:847] Enqueuing event
UPDATE_OPERATION_STATUS received from
http://172.17.0.2:44153/master/api/v1/scheduler
3: I1023 19:29:28.429711 18366 master.cpp:1411] Framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default) disconnected
3: I1023 19:29:28.429775 18366 master.cpp:3356] Deactivating framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default)
3: I1023 19:29:28.429944 18366 master.cpp:3333] Disconnecting framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default)
3: I1023 19:29:28.430027 18366 master.cpp:1426] Giving framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default) 0ns to failover
3: I1023 19:29:28.430400 18381 hierarchical.cpp:813] Deactivated framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000
3: I1023 19:29:28.432461 18358 master.cpp:10195] Framework failover timeout,
removing framework c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default)
3: I1023 19:29:28.432521 18358 master.cpp:11197] Removing framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 (default)
3: I1023 19:29:28.432809 18358 master.cpp:13672] Marking operation
a209a738-3d33-4a81-80f5-2297babb8a8c (ID: operation) (Agent:
c6ad0cf5-223e-47b4-a28f-c545fd91329f-S0) (Framework:
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000) in state OPERATION_PENDING as an
orphan
3: I1023 19:29:28.432925 18341 slave.cpp:4062] Asked to shut down framework
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 by [email protected]:44153
3: I1023 19:29:28.433010 18341 slave.cpp:4077] Cannot shut down unknown
framework c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000
3: I1023 19:29:28.433949 18343 hierarchical.cpp:1767] Allocation paused
3: F1023 19:29:28.434351 18343 hierarchical.cpp:745] Check failed:
tryUntrackFrameworkUnderRole(framework, role) Framework:
c6ad0cf5-223e-47b4-a28f-c545fd91329f-0000 role: default-role
3: *** Check failure stack trace: ***
3: @ 0xffffb1125d0c google::LogMessage::Fail()
3: @ 0xffffb1124ef0 google::LogMessage::SendToLog()
3: @ 0xffffb112593c google::LogMessage::Flush()
3: @ 0xffffb1129548 google::LogMessageFatal::~LogMessageFatal()
3: @ 0xffffbb3e5048
mesos::internal::master::allocator::internal::HierarchicalAllocatorProcess::removeFramework()
3: @ 0x11cf930
_ZZN7process8dispatchIN5mesos8internal6master9allocator21MesosAllocatorProcessERKNS1_11FrameworkIDES8_EEvRKNS_3PIDIT_EEMSA_FvT0_EOT1_ENKUlOS6_PNS_11ProcessBaseEE_clESJ_SL_
3: @ 0x11cf60c
_ZN5cpp176invokeIZN7process8dispatchIN5mesos8internal6master9allocator21MesosAllocatorProcessERKNS3_11FrameworkIDESA_EEvRKNS1_3PIDIT_EEMSC_FvT0_EOT1_EUlOS8_PNS1_11ProcessBaseEE_JS8_SN_EEEDTclclsr3stdE7forwardISC_Efp_Espclsr3stdE7forwardIT0_Efp0_EEEOSC_DpOSP_
3: @ 0x11cf59c
_ZN6lambda8internal7PartialIZN7process8dispatchIN5mesos8internal6master9allocator21MesosAllocatorProcessERKNS4_11FrameworkIDESB_EEvRKNS2_3PIDIT_EEMSD_FvT0_EOT1_EUlOS9_PNS2_11ProcessBaseEE_JS9_St12_PlaceholderILi1EEEE13invoke_expandISP_St5tupleIJS9_SR_EESU_IJOSO_EEJLm0ELm1EEEEDTclsr5cpp17E6invokeclsr3stdE7forwardISD_Efp_Espcl6expandclsr3stdE3getIXT2_EEclsr3stdE7forwardISH_Efp0_EEclsr3stdE7forwardISK_Efp2_EEEEOSD_OSH_N5cpp1416integer_sequenceImJXspT2_EEEESL_
3: @ 0x11cf4bc
_ZNO6lambda8internal7PartialIZN7process8dispatchIN5mesos8internal6master9allocator21MesosAllocatorProcessERKNS4_11FrameworkIDESB_EEvRKNS2_3PIDIT_EEMSD_FvT0_EOT1_EUlOS9_PNS2_11ProcessBaseEE_JS9_St12_PlaceholderILi1EEEEclIJSO_EEEDTcl13invoke_expandclL_ZSt4moveIRSP_EONSt16remove_referenceISD_E4typeEOSD_EdtdefpT1fEclL_ZSU_IRSt5tupleIJS9_SR_EEESZ_S10_EdtdefpT10bound_argsEcvN5cpp1416integer_sequenceImJLm0ELm1EEEE_Eclsr3stdE16forward_as_tuplespclsr3stdE7forwardIT_Efp_EEEEDpOS17_
3: @ 0x11cf418
_ZN5cpp176invokeIN6lambda8internal7PartialIZN7process8dispatchIN5mesos8internal6master9allocator21MesosAllocatorProcessERKNS6_11FrameworkIDESD_EEvRKNS4_3PIDIT_EEMSF_FvT0_EOT1_EUlOSB_PNS4_11ProcessBaseEE_JSB_St12_PlaceholderILi1EEEEEJSQ_EEEDTclclsr3stdE7forwardISF_Efp_Espclsr3stdE7forwardIT0_Efp0_EEEOSF_DpOSV_
3: @ 0x11cf3cc
_ZN6lambda8internal6InvokeIvEclINS0_7PartialIZN7process8dispatchIN5mesos8internal6master9allocator21MesosAllocatorProcessERKNS7_11FrameworkIDESE_EEvRKNS5_3PIDIT_EEMSG_FvT0_EOT1_EUlOSC_PNS5_11ProcessBaseEE_JSC_St12_PlaceholderILi1EEEEEJSR_EEEvOSG_DpOT0_
3: @ 0x11cf280
_ZNO6lambda12CallableOnceIFvPN7process11ProcessBaseEEE10CallableFnINS_8internal7PartialIZNS1_8dispatchIN5mesos8internal6master9allocator21MesosAllocatorProcessERKNSA_11FrameworkIDESH_EEvRKNS1_3PIDIT_EEMSJ_FvT0_EOT1_EUlOSF_S3_E_JSF_St12_PlaceholderILi1EEEEEEclEOS3_
3: @ 0xffffb1f60968
_ZNO6lambda12CallableOnceIFvPN7process11ProcessBaseEEEclES3_
3: @ 0xffffb1f1cd8c process::ProcessBase::consume()
3: @ 0xffffb1fcb944
_ZNO7process13DispatchEvent7consumeEPNS_13EventConsumerE
3: @ 0x11a6174 process::ProcessBase::serve()
3: @ 0xffffb1f195fc process::ProcessManager::resume()
3: @ 0xffffb1f45448
process::ProcessManager::init_threads()::$_7::operator()()
3: @ 0xffffb1f4521c
_ZNSt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvE3$_7vEE9_M_invokeIJEEEvSt12_Index_tupleIJXspT_EEE
3: @ 0xffffb1f451e4 std::_Bind_simple<>::operator()()
3: @ 0xffffb1f450ac std::thread::_Impl<>::_M_run()
3: @ 0xffffae231280 (unknown)
3: @ 0xffffb107bfc4 start_thread
3/3 Test #3: MesosTests .......................Child aborted***Exception:
1088.97 sec
67% tests passed, 1 tests failed out of 3
Total Test time (real) = 1175.42 sec
The following tests FAILED:
3 - MesosTests (Child aborted)
Errors while running CTest
CMakeFiles/check.dir/build.make:60: recipe for target 'CMakeFiles/check' failed
make[3]: *** [CMakeFiles/check] Error 8
make[3]: Leaving directory '/tmp/SRC/build'
CMakeFiles/Makefile2:255: recipe for target 'CMakeFiles/check.dir/all' failed
make[2]: *** [CMakeFiles/check.dir/all] Error 2
make[2]: Leaving directory '/tmp/SRC/build'
CMakeFiles/Makefile2:262: recipe for target 'CMakeFiles/check.dir/rule' failed
make[1]: *** [CMakeFiles/check.dir/rule] Error 2
make[1]: Leaving directory '/tmp/SRC/build'
Makefile:232: recipe for target 'check' failed
make: *** [check] Error 2
real 111m44.740s
user 0m20.562s
sys 0m14.311s
Build step 'Execute shell' marked build as failure
Recording test results