[
https://issues.apache.org/jira/browse/MESOS-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16718130#comment-16718130
]
Meng Zhu commented on MESOS-9468:
---------------------------------
The problem is the executor was not able to reregister as expected in time
after the agent recovery and got killed:
{noformat}
I1210 16:20:13.512616 237449216 slave.cpp:7164] Recovering executors
I1210 16:20:13.512668 237449216 slave.cpp:7251] Waiting for executor 'default'
of framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (via HTTP) to subscribe
I1210 16:20:14.307296 237985792 hierarchical.cpp:1566] Performed allocation for
1 agents in 86244ns
I1210 16:20:22.002549 236912640 slave.cpp:5223] Cleaning up un-reregistered
executors
I1210 16:20:22.002619 236912640 slave.cpp:5241] Killing un-reregistered
executor 'default' of framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (via
HTTP)
{noformat}
Note there is an 8 seconds gap before the executor got killed.
while in the good run the executor re-registered in time:
{noformat}
I1211 14:09:45.939278 28047 slave.cpp:7164] Recovering executors
I1211 14:09:45.939385 28047 slave.cpp:7251] Waiting for executor 'default' of
framework 4a19bf42-1ea3-4676-bf5a-1dab6bc8299f-0000 (via HTTP) to subscribe
I1211 14:09:46.498638 28051 hierarchical.cpp:2129] No allocations performed
I1211 14:09:46.498737 28051 hierarchical.cpp:2229] No inverse offers to send
out!
I1211 14:09:46.498776 28051 hierarchical.cpp:1566] Performed allocation for 1
agents in 316562ns
I1211 14:09:46.907271 28058 process.cpp:3588] Handling HTTP event for process
'slave(1)' with path: '/slave(1)/api/v1/executor'
W1211 14:09:46.923003 28218 executor.cpp:781] Dropping SUBSCRIBE: Executor is
in state SUBSCRIBING
I1211 14:09:46.946848 28071 authenticator_manager.cpp:84] Request for
'/slave(1)/api/v1/executor' requires authentication in realm
'mesos-agent-executor' but no authenticator found
I1211 14:09:46.947571 28048 http.cpp:1157] HTTP POST for
/slave(1)/api/v1/executor from 10.0.49.2:52894
I1211 14:09:46.947835 28048 slave.cpp:4633] Received Subscribe request for HTTP
executor 'default' of framework 4a19bf42-1ea3-4676-bf5a-1dab6bc8299f-0000 (via
HTTP)
{noformat}
Looks like the executor did send out the SUBSCRIBE event, but somehow agent
failed to process it. There is a weird eight seconds silent gap where nothing
happened--not even the allocation cycle (should be performed once per second).
Wonder if there is anything weird going with the kenrel or the box.
Specifically, I see this suspious message earlier:
{noformat}
[warn] kq_init: detected broken kqueue; not using.: Undefined error: 0
{noformat}
Googling shows it is specifically caused by libevent on MacOS (sounds even
suspicous) and the fix is to brew reinstall libevent -- a small effort worth
trying?
https://www.safematix.com/system/os-x/macos-sierra-warn-kq_init-detected-broken-kqueue-not-using-undefined-error-0/
> SlaveTest.AgentFailoverTerminatesHTTPExecutorWithNoTask is flaky
> ----------------------------------------------------------------
>
> Key: MESOS-9468
> URL: https://issues.apache.org/jira/browse/MESOS-9468
> Project: Mesos
> Issue Type: Bug
> Environment: Mac OSX with ssl enabled
> Reporter: Benno Evers
> Priority: Major
>
> The following test failure was observed in an internal CI run:
> {noformat}
> ../../src/tests/slave_tests.cpp:6341: Failure
> Actual function call count doesn't match EXPECT_CALL(*slave.get()->mock(),
> _shutdownExecutor(_, _))...
> Expected: to be called once
> Actual: never called - unsatisfied and active
> {noformat}
> Full log:
> {noformat}
> [ RUN ] SlaveTest.AgentFailoverTerminatesHTTPExecutorWithNoTask
> I1210 16:20:13.298667 338650560 cluster.cpp:173] Creating default 'local'
> authorizer
> I1210 16:20:13.300006 238522368 master.cpp:414] Master
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801 (Jenkinss-Mac-mini.local) started on
> 10.0.49.4:54069
> I1210 16:20:13.300034 238522368 master.cpp:417] Flags at startup: --acls=""
> --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins"
> --allocation_interval="1secs" --allocator="hierarchical"
> --authenticate_agents="true" --authenticate_frameworks="true"
> --authenticate_http_frameworks="true" --authenticate_http_readonly="true"
> --authenticate_http_readwrite="true" --authentication_v0_timeout="15secs"
> --authenticators="crammd5" --authorizers="local"
> --credentials="/private/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/ntg04w/credentials"
> --filter_gpu_resources="true" --framework_sorter="drf" --help="false"
> --hostname_lookup="true" --http_authenticators="basic"
> --http_framework_authenticators="basic" --initialize_driver_logging="true"
> --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO"
> --max_agent_ping_timeouts="5" --max_completed_frameworks="50"
> --max_completed_tasks_per_framework="1000"
> --max_unreachable_tasks_per_framework="1000" --memory_profiling="false"
> --min_allocatable_resources="cpus:0.01|mem:32" --port="5050"
> --publish_per_framework_metrics="true" --quiet="false"
> --recovery_agent_removal_limit="100%" --registry="in_memory"
> --registry_fetch_timeout="1mins" --registry_gc_interval="15mins"
> --registry_max_agent_age="2weeks" --registry_max_agent_count="102400"
> --registry_store_timeout="100secs" --registry_strict="false"
> --require_agent_domain="false" --role_sorter="drf" --root_submissions="true"
> --version="false" --webui_dir="/usr/local/share/mesos/webui"
> --work_dir="/private/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/ntg04w/master"
> --zk_session_timeout="10secs"
> I1210 16:20:13.300215 238522368 master.cpp:466] Master only allowing
> authenticated frameworks to register
> I1210 16:20:13.300227 238522368 master.cpp:472] Master only allowing
> authenticated agents to register
> I1210 16:20:13.300237 238522368 master.cpp:478] Master only allowing
> authenticated HTTP frameworks to register
> I1210 16:20:13.300246 238522368 credentials.hpp:37] Loading credentials for
> authentication from
> '/private/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/ntg04w/credentials'
> I1210 16:20:13.300427 238522368 master.cpp:522] Using default 'crammd5'
> authenticator
> I1210 16:20:13.300489 238522368 http.cpp:1017] Creating default 'basic' HTTP
> authenticator for realm 'mesos-master-readonly'
> I1210 16:20:13.300559 238522368 http.cpp:1017] Creating default 'basic' HTTP
> authenticator for realm 'mesos-master-readwrite'
> I1210 16:20:13.300607 238522368 http.cpp:1017] Creating default 'basic' HTTP
> authenticator for realm 'mesos-master-scheduler'
> I1210 16:20:13.300657 238522368 master.cpp:603] Authorization enabled
> I1210 16:20:13.300863 237985792 whitelist_watcher.cpp:77] No whitelist given
> I1210 16:20:13.300884 239058944 hierarchical.cpp:175] Initialized
> hierarchical allocator process
> I1210 16:20:13.302809 235302912 master.cpp:2089] Elected as the leading
> master!
> I1210 16:20:13.302834 235302912 master.cpp:1644] Recovering from registrar
> I1210 16:20:13.302875 237985792 registrar.cpp:339] Recovering registrar
> I1210 16:20:13.303133 237985792 registrar.cpp:383] Successfully fetched the
> registry (0B) in 222208ns
> I1210 16:20:13.303207 237985792 registrar.cpp:487] Applied 1 operations in
> 24653ns; attempting to update the registry
> I1210 16:20:13.303490 237985792 registrar.cpp:544] Successfully updated the
> registry in 258048ns
> I1210 16:20:13.303539 237985792 registrar.cpp:416] Successfully recovered
> registrar
> I1210 16:20:13.303692 236376064 master.cpp:1758] Recovered 0 agents from the
> registry (155B); allowing 10mins for agents to reregister
> I1210 16:20:13.303723 235839488 hierarchical.cpp:215] Skipping recovery of
> hierarchical allocator: nothing to recover
> W1210 16:20:13.306483 338650560 process.cpp:2829] Attempted to spawn already
> running process files@10.0.49.4:54069
> I1210 16:20:13.307142 338650560 containerizer.cpp:305] Using isolation {
> environment_secret, filesystem/posix, posix/mem, posix/cpu }
> I1210 16:20:13.307371 338650560 provisioner.cpp:298] Using default backend
> 'copy'
> I1210 16:20:13.308158 338650560 cluster.cpp:485] Creating default 'local'
> authorizer
> I1210 16:20:13.309432 235302912 slave.cpp:268] Mesos agent started on
> (623)@10.0.49.4:54069
> I1210 16:20:13.309470 235302912 slave.cpp:269] Flags at startup: --acls=""
> --appc_simple_discovery_uri_prefix="http://";
> --appc_store_dir="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/store/appc"
> --authenticate_http_executors="true" --authenticate_http_readonly="true"
> --authenticate_http_readwrite="true" --authenticatee="crammd5"
> --authentication_backoff_factor="1secs" --authentication_timeout_max="1mins"
> --authentication_timeout_min="5secs" --authorizer="local"
> --container_disk_watch_interval="15secs" --containerizers="mesos"
> --credential="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/credential"
> --default_role="*" --disk_watch_interval="1mins" --docker="docker"
> --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io";
> --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock"
> --docker_stop_timeout="0ns"
> --docker_store_dir="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/store/docker"
> --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume"
> --enforce_container_disk_quota="false"
> --executor_registration_timeout="1mins"
> --executor_reregistration_timeout="2secs"
> --executor_shutdown_grace_period="5secs"
> --fetcher_cache_dir="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/fetch"
> --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins"
> --frameworks_home="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/frameworks"
> --gc_delay="1weeks" --gc_disk_headroom="0.1"
> --gc_non_executor_container_sandboxes="false" --help="false"
> --hostname_lookup="true" --http_command_executor="false"
> --http_credentials="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/http_credentials"
> --http_heartbeat_interval="30secs" --initialize_driver_logging="true"
> --isolation="posix/cpu,posix/mem"
> --jwt_secret_key="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/jwt_secret_key"
> --launcher="posix"
> --launcher_dir="/Users/jenkins/workspace/workspace/mesos/Mesos_CI-build/FLAG/SSL/label/mac/mesos/build/src"
> --logbufsecs="0" --logging_level="INFO"
> --max_completed_executors_per_framework="150" --memory_profiling="false"
> --network_cni_metrics="true" --oversubscribed_resources_interval="15secs"
> --port="5051" --qos_correction_interval_min="0ns" --quiet="false"
> --reconfiguration_policy="equal" --recover="reconnect"
> --recovery_timeout="15mins" --registration_backoff_factor="10ms"
> --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]"
> --runtime_dir="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N"
> --sandbox_directory="/mnt/mesos/sandbox" --strict="true"
> --switch_user="true" --version="false"
> --work_dir="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2"
> --zk_session_timeout="10secs"
> I1210 16:20:13.309794 235302912 credentials.hpp:86] Loading credential for
> authentication from
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/credential'
> I1210 16:20:13.309950 235302912 slave.cpp:301] Agent using credential for:
> test-principal
> I1210 16:20:13.309963 235302912 credentials.hpp:37] Loading credentials for
> authentication from
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/http_credentials'
> I1210 16:20:13.310129 338650560 scheduler.cpp:189] Version: 1.8.0
> I1210 16:20:13.310158 235302912 http.cpp:1017] Creating default 'basic' HTTP
> authenticator for realm 'mesos-agent-executor'
> I1210 16:20:13.310223 235302912 http.cpp:1038] Creating default 'jwt' HTTP
> authenticator for realm 'mesos-agent-executor'
> I1210 16:20:13.310271 236912640 scheduler.cpp:355] Using default 'basic' HTTP
> authenticatee
> I1210 16:20:13.310405 235302912 http.cpp:1017] Creating default 'basic' HTTP
> authenticator for realm 'mesos-agent-readonly'
> I1210 16:20:13.310474 235302912 http.cpp:1038] Creating default 'jwt' HTTP
> authenticator for realm 'mesos-agent-readonly'
> I1210 16:20:13.310503 237985792 scheduler.cpp:538] New master detected at
> master@10.0.49.4:54069
> I1210 16:20:13.310524 237985792 scheduler.cpp:547] Waiting for 0ns before
> initiating a re-(connection) attempt with the master
> I1210 16:20:13.310590 235302912 http.cpp:1017] Creating default 'basic' HTTP
> authenticator for realm 'mesos-agent-readwrite'
> I1210 16:20:13.310649 235302912 http.cpp:1038] Creating default 'jwt' HTTP
> authenticator for realm 'mesos-agent-readwrite'
> I1210 16:20:13.310837 235302912 disk_profile_adaptor.cpp:80] Creating default
> disk profile adaptor module
> I1210 16:20:13.311209 237985792 scheduler.cpp:429] Connected with the master
> at http://10.0.49.4:54069/master/api/v1/scheduler
> I1210 16:20:13.311234 235302912 slave.cpp:616] Agent resources:
> [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
> I1210 16:20:13.311501 235302912 slave.cpp:624] Agent attributes: [ ]
> I1210 16:20:13.311518 235302912 slave.cpp:633] Agent hostname:
> Jenkinss-Mac-mini.local
> I1210 16:20:13.311641 238522368 task_status_update_manager.cpp:181] Pausing
> sending task status updates
> I1210 16:20:13.312055 236912640 scheduler.cpp:248] Sending SUBSCRIBE call to
> http://10.0.49.4:54069/master/api/v1/scheduler
> I1210 16:20:13.312305 239058944 state.cpp:66] Recovering state from
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta'
> I1210 16:20:13.312409 237449216 slave.cpp:6935] Finished recovering
> checkpointed state from
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta',
> beginning agent recovery
> I1210 16:20:13.312495 235302912 task_status_update_manager.cpp:207]
> Recovering task status update manager
> I1210 16:20:13.312628 235839488 containerizer.cpp:727] Recovering Mesos
> containers
> I1210 16:20:13.312793 235839488 containerizer.cpp:1053] Recovering isolators
> I1210 16:20:13.312952 235302912 process.cpp:3588] Handling HTTP event for
> process 'master' with path: '/master/api/v1/scheduler'
> I1210 16:20:13.313247 237449216 containerizer.cpp:1092] Recovering provisioner
> I1210 16:20:13.313549 235839488 provisioner.cpp:494] Provisioner recovery
> complete
> I1210 16:20:13.313792 236376064 http.cpp:1157] HTTP POST for
> /master/api/v1/scheduler from 10.0.49.4:55784
> I1210 16:20:13.313971 236376064 master.cpp:2513] Received subscription
> request for HTTP framework 'default'
> I1210 16:20:13.314003 236376064 master.cpp:2161] Authorizing framework
> principal 'test-principal' to receive offers for roles '{ * }'
> I1210 16:20:13.314047 235302912 composing.cpp:339] Finished recovering all
> containerizers
> I1210 16:20:13.314271 235839488 slave.cpp:7164] Recovering executors
> I1210 16:20:13.314354 236376064 master.cpp:2648] Subscribing framework
> 'default' with checkpointing enabled and capabilities [ MULTI_ROLE,
> RESERVATION_REFINEMENT ]
> I1210 16:20:13.314404 235839488 slave.cpp:7317] Finished recovery
> I1210 16:20:13.315390 236376064 master.cpp:9913] Adding framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default) with roles { } suppressed
> I1210 16:20:13.315688 235839488 slave.cpp:1259] New master detected at
> master@10.0.49.4:54069
> I1210 16:20:13.315742 235839488 slave.cpp:1324] Detecting new master
> I1210 16:20:13.315796 239058944 hierarchical.cpp:304] Added framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:13.315914 239058944 hierarchical.cpp:1566] Performed allocation
> for 0 agents in 56731ns
> I1210 16:20:13.315963 237449216 task_status_update_manager.cpp:181] Pausing
> sending task status updates
> I1210 16:20:13.316321 235302912 scheduler.cpp:845] Enqueuing event SUBSCRIBED
> received from http://10.0.49.4:54069/master/api/v1/scheduler
> I1210 16:20:13.316606 235302912 scheduler.cpp:845] Enqueuing event HEARTBEAT
> received from http://10.0.49.4:54069/master/api/v1/scheduler
> I1210 16:20:13.322548 236376064 slave.cpp:1351] Authenticating with master
> master@10.0.49.4:54069
> I1210 16:20:13.322607 236376064 slave.cpp:1360] Using default CRAM-MD5
> authenticatee
> I1210 16:20:13.322696 238522368 authenticatee.cpp:121] Creating new client
> SASL connection
> I1210 16:20:13.322827 235302912 master.cpp:9683] Authenticating
> slave(623)@10.0.49.4:54069
> I1210 16:20:13.322893 237449216 authenticator.cpp:414] Starting
> authentication session for crammd5-authenticatee(1211)@10.0.49.4:54069
> I1210 16:20:13.322999 239058944 authenticator.cpp:98] Creating new server
> SASL connection
> I1210 16:20:13.323076 235839488 authenticatee.cpp:213] Received SASL
> authentication mechanisms: CRAM-MD5
> I1210 16:20:13.323098 235839488 authenticatee.cpp:239] Attempting to
> authenticate with mechanism 'CRAM-MD5'
> I1210 16:20:13.323149 236912640 authenticator.cpp:204] Received SASL
> authentication start
> I1210 16:20:13.323228 236912640 authenticator.cpp:326] Authentication
> requires more steps
> I1210 16:20:13.323295 237985792 authenticatee.cpp:259] Received SASL
> authentication step
> I1210 16:20:13.323345 236376064 authenticator.cpp:232] Received SASL
> authentication step
> I1210 16:20:13.323372 236376064 auxprop.cpp:109] Request to lookup properties
> for user: 'test-principal' realm: 'Jenkinss-Mac-mini.local' server FQDN:
> 'Jenkinss-Mac-mini.local' SASL_AUXPROP_VERIFY_AGAINST_HASH: false
> SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false
> I1210 16:20:13.323403 236376064 auxprop.cpp:181] Looking up auxiliary
> property '*userPassword'
> I1210 16:20:13.323432 236376064 auxprop.cpp:181] Looking up auxiliary
> property '*cmusaslsecretCRAM-MD5'
> I1210 16:20:13.323443 236376064 auxprop.cpp:109] Request to lookup properties
> for user: 'test-principal' realm: 'Jenkinss-Mac-mini.local' server FQDN:
> 'Jenkinss-Mac-mini.local' SASL_AUXPROP_VERIFY_AGAINST_HASH: false
> SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true
> I1210 16:20:13.323451 236376064 auxprop.cpp:131] Skipping auxiliary property
> '*userPassword' since SASL_AUXPROP_AUTHZID == true
> I1210 16:20:13.323459 236376064 auxprop.cpp:131] Skipping auxiliary property
> '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
> I1210 16:20:13.323472 236376064 authenticator.cpp:318] Authentication success
> I1210 16:20:13.323549 238522368 authenticatee.cpp:299] Authentication success
> I1210 16:20:13.323550 235302912 master.cpp:9715] Successfully authenticated
> principal 'test-principal' at slave(623)@10.0.49.4:54069
> I1210 16:20:13.323561 237449216 authenticator.cpp:432] Authentication session
> cleanup for crammd5-authenticatee(1211)@10.0.49.4:54069
> I1210 16:20:13.323797 239058944 slave.cpp:1451] Successfully authenticated
> with master master@10.0.49.4:54069
> I1210 16:20:13.324003 239058944 slave.cpp:1882] Will retry registration in
> 17.343375ms if necessary
> I1210 16:20:13.324040 236912640 master.cpp:6605] Received register agent
> message from slave(623)@10.0.49.4:54069 (Jenkinss-Mac-mini.local)
> I1210 16:20:13.324174 236912640 master.cpp:3935] Authorizing agent providing
> resources 'cpus:2; mem:1024; disk:1024; ports:[31000-32000]' with principal
> 'test-principal'
> I1210 16:20:13.324479 238522368 master.cpp:6672] Authorized registration of
> agent at slave(623)@10.0.49.4:54069 (Jenkinss-Mac-mini.local)
> I1210 16:20:13.324535 238522368 master.cpp:6787] Registering agent at
> slave(623)@10.0.49.4:54069 (Jenkinss-Mac-mini.local) with id
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0
> I1210 16:20:13.324790 237449216 registrar.cpp:487] Applied 1 operations in
> 123675ns; attempting to update the registry
> I1210 16:20:13.325073 237449216 registrar.cpp:544] Successfully updated the
> registry in 250112ns
> I1210 16:20:13.325143 235302912 master.cpp:6835] Admitted agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local)
> I1210 16:20:13.325477 238522368 slave.cpp:1484] Registered with master
> master@10.0.49.4:54069; given agent ID 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0
> I1210 16:20:13.325418 235302912 master.cpp:6880] Registered agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local) with cpus:2; mem:1024; disk:1024;
> ports:[31000-32000]
> I1210 16:20:13.325599 236912640 task_status_update_manager.cpp:188] Resuming
> sending task status updates
> I1210 16:20:13.325606 235839488 hierarchical.cpp:603] Added agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 (Jenkinss-Mac-mini.local) with
> cpus:2; mem:1024; disk:1024; ports:[31000-32000] (allocated: {})
> I1210 16:20:13.325888 238522368 slave.cpp:1504] Checkpointing SlaveInfo to
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/slave.info'
> I1210 16:20:13.325969 235839488 hierarchical.cpp:1566] Performed allocation
> for 1 agents in 251270ns
> I1210 16:20:13.326122 236376064 master.cpp:9498] Sending offers [
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-O0 ] to framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default)
> I1210 16:20:13.326700 238522368 slave.cpp:1553] Forwarding agent update
> {"operations":{},"resource_version_uuid":{"value":"TL/Jc4gZSxylS/eID+11GA=="},"slave_id":{"value":"4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0"},"update_oversubscribed_resources":false}
> I1210 16:20:13.326958 236376064 scheduler.cpp:845] Enqueuing event OFFERS
> received from http://10.0.49.4:54069/master/api/v1/scheduler
> I1210 16:20:13.327227 237985792 master.cpp:7939] Ignoring update on agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local) as it reports no changes
> I1210 16:20:13.327847 237985792 scheduler.cpp:248] Sending ACCEPT call to
> http://10.0.49.4:54069/master/api/v1/scheduler
> I1210 16:20:13.328619 236912640 process.cpp:3588] Handling HTTP event for
> process 'master' with path: '/master/api/v1/scheduler'
> I1210 16:20:13.329180 235839488 http.cpp:1157] HTTP POST for
> /master/api/v1/scheduler from 10.0.49.4:55785
> I1210 16:20:13.329612 235839488 master.cpp:11501] Removing offer
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-O0
> I1210 16:20:13.329852 235839488 master.cpp:4456] Processing ACCEPT call for
> offers: [ 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-O0 ] on agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local) for framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default)
> I1210 16:20:13.329936 235839488 master.cpp:3552] Authorizing framework
> principal 'test-principal' to launch task 82580022-d138-44b1-92f5-fd4aca745388
> I1210 16:20:13.330086 235839488 master.cpp:3552] Authorizing framework
> principal 'test-principal' to launch task 93bb5fe3-618b-4fb1-a039-7cad34b2cae9
> I1210 16:20:13.331593 235839488 master.cpp:4007] Adding executor 'default'
> with resources cpus(allocated: *):0.1; mem(allocated: *):32; disk(allocated:
> *):32 of framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default) on
> agent 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local)
> I1210 16:20:13.331724 235839488 master.cpp:4033] Adding task
> 82580022-d138-44b1-92f5-fd4aca745388 with resources cpus(allocated: *):0.1;
> mem(allocated: *):32; disk(allocated: *):32 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default) on agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local)
> I1210 16:20:13.331821 235839488 master.cpp:4033] Adding task
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 with resources cpus(allocated: *):0.1;
> mem(allocated: *):32; disk(allocated: *):32 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default) on agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local)
> I1210 16:20:13.331935 235839488 master.cpp:5652] Launching task group {
> 82580022-d138-44b1-92f5-fd4aca745388, 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 }
> of framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default) with
> resources cpus(allocated: *):0.2; mem(allocated: *):64; disk(allocated: *):64
> on agent 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at
> slave(623)@10.0.49.4:54069 (Jenkinss-Mac-mini.local) on new executor
> I1210 16:20:13.332350 238522368 hierarchical.cpp:1238] Recovered
> cpus(allocated: *):1.7; mem(allocated: *):928; disk(allocated: *):928;
> ports(allocated: *):[31000-32000] (total: cpus:2; mem:1024; disk:1024;
> ports:[31000-32000], allocated: cpus(allocated: *):0.3; mem(allocated: *):96;
> disk(allocated: *):96) on agent 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 from
> framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:13.332384 238522368 hierarchical.cpp:1284] Framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 filtered agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 for 5secs
> I1210 16:20:13.332582 237449216 slave.cpp:2019] Got assigned task group
> containing tasks [ 82580022-d138-44b1-92f5-fd4aca745388,
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 ] for framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:13.332801 237449216 slave.cpp:8918] Checkpointing FrameworkInfo
> to
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/framework.info'
> I1210 16:20:13.333813 237449216 slave.cpp:8929] Checkpointing framework pid
> '@0.0.0.0:0' to
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/framework.pid'
> I1210 16:20:13.334977 237449216 slave.cpp:2393] Authorizing task group
> containing tasks [ 82580022-d138-44b1-92f5-fd4aca745388,
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 ] for framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:13.335026 237449216 slave.cpp:8494] Authorizing framework
> principal 'test-principal' to launch task 82580022-d138-44b1-92f5-fd4aca745388
> I1210 16:20:13.335105 237449216 slave.cpp:8494] Authorizing framework
> principal 'test-principal' to launch task 93bb5fe3-618b-4fb1-a039-7cad34b2cae9
> I1210 16:20:13.336659 237449216 slave.cpp:2836] Launching task group
> containing tasks [ 82580022-d138-44b1-92f5-fd4aca745388,
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 ] for framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:13.336752 237449216 paths.cpp:752] Creating sandbox
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> for user 'jenkins'
> I1210 16:20:13.337780 237449216 slave.cpp:9704] Checkpointing ExecutorInfo to
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/executor.info'
> I1210 16:20:13.338752 237449216 paths.cpp:755] Creating sandbox
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> I1210 16:20:13.339140 237449216 slave.cpp:9004] Launching executor 'default'
> of framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 with resources
> [{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":32.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"disk","scalar":{"value":32.0},"type":"SCALAR"}]
> in work directory
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> I1210 16:20:13.339587 237449216 slave.cpp:9735] Checkpointing TaskInfo to
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39/tasks/82580022-d138-44b1-92f5-fd4aca745388/task.info'
> I1210 16:20:13.340756 237449216 slave.cpp:9735] Checkpointing TaskInfo to
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39/tasks/93bb5fe3-618b-4fb1-a039-7cad34b2cae9/task.info'
> I1210 16:20:13.341496 237449216 slave.cpp:3033] Queued task group containing
> tasks [ 82580022-d138-44b1-92f5-fd4aca745388,
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 ] for executor 'default' of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:13.341591 237449216 slave.cpp:993] Successfully attached
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> to virtual path
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/latest'
> I1210 16:20:13.341872 237449216 slave.cpp:3514] Launching container
> 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39 for executor 'default' of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:13.342103 237449216 slave.cpp:993] Successfully attached
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> to virtual path
> '/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/latest'
> I1210 16:20:13.342164 237449216 slave.cpp:993] Successfully attached
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> to virtual path
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> I1210 16:20:13.342419 236376064 containerizer.cpp:1288] Starting container
> 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39
> I1210 16:20:13.343714 236376064 containerizer.cpp:1454] Checkpointed
> ContainerConfig at
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/containers/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39/config'
> I1210 16:20:13.343752 236376064 containerizer.cpp:3130] Transitioning the
> state of container 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39 from PROVISIONING to
> PREPARING
> I1210 16:20:13.345352 236912640 containerizer.cpp:1947] Launching
> 'mesos-containerizer' with flags '--help="false"
> --launch_info="{"command":{"arguments":["mesos-default-executor","--launcher_dir=/Users/jenkins/workspace/workspace/mesos/Mesos_CI-build/FLAG/SSL/label/mac/mesos/build/src"],"shell":false,"value":"/Users/jenkins/workspace/workspace/mesos/Mesos_CI-build/FLAG/SSL/label/mac/mesos/build/src/mesos-default-executor"},"environment":{"variables":[{"name":"LIBPROCESS_PORT","type":"VALUE","value":"0"},{"name":"MESOS_AGENT_ENDPOINT","type":"VALUE","value":"10.0.49.4:54069"},{"name":"MESOS_CHECKPOINT","type":"VALUE","value":"1"},{"name":"MESOS_DIRECTORY","type":"VALUE","value":"/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39"},{"name":"MESOS_EXECUTOR_AUTHENTICATION_TOKEN","type":"VALUE","value":"eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJjaWQiOiIwYTFkZDM5NC1kNGU2LTRlNjctYjkwYS1jYTVmZDUxNWVkMzkiLCJlaWQiOiJkZWZhdWx0IiwiZmlkIjoiNGM0NzBkZGQtZGMyOS00ZDljLTliNDYtOGU3YThiNmM3ODAxLTAwMDAifQ.Ljk2TzNupcilupxOLA6qRWEJNWtkCD9F02TDgao62ic"},{"name":"MESOS_EXECUTOR_ID","type":"VALUE","value":"default"},{"name":"MESOS_EXECUTOR_SHUTDOWN_GRACE_PERIOD","type":"VALUE","value":"5secs"},{"name":"MESOS_FRAMEWORK_ID","type":"VALUE","value":"4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000"},{"name":"MESOS_HTTP_COMMAND_EXECUTOR","type":"VALUE","value":"0"},{"name":"MESOS_RECOVERY_TIMEOUT","type":"VALUE","value":"15mins"},{"name":"MESOS_SLAVE_ID","type":"VALUE","value":"4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0"},{"name":"MESOS_SLAVE_PID","type":"VALUE","value":"slave(623)@10.0.49.4:54069"},{"name":"MESOS_SUBSCRIPTION_BACKOFF_MAX","type":"VALUE","value":"2secs"},{"name":"MESOS_SANDBOX","type":"VALUE","value":"/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39"}]},"task_environment":{},"user":"jenkins","working_directory":"/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39"}"
> --pipe_read="28" --pipe_write="31"
> --runtime_directory="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/containers/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39"'
> I1210 16:20:13.347401 236912640 launcher.cpp:145] Forked child with pid
> '38430' for container '0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> I1210 16:20:13.347640 236912640 containerizer.cpp:2052] Checkpointing
> container's forked pid 38430 to
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39/pids/forked.pid'
> I1210 16:20:13.349002 236912640 containerizer.cpp:3130] Transitioning the
> state of container 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39 from PREPARING to
> ISOLATING
> I1210 16:20:13.350615 236912640 containerizer.cpp:3130] Transitioning the
> state of container 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39 from ISOLATING to
> FETCHING
> I1210 16:20:13.350728 236376064 fetcher.cpp:369] Starting to fetch URIs for
> container: 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39, directory:
> /var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39
> I1210 16:20:13.351436 235302912 containerizer.cpp:3130] Transitioning the
> state of container 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39 from FETCHING to
> RUNNING
> [warn] kq_init: detected broken kqueue; not using.: Undefined error: 0
> I1210 16:20:13.483670 213319680 executor.cpp:201] Version: 1.8.0
> I1210 16:20:13.491480 237985792 process.cpp:3588] Handling HTTP event for
> process 'slave(623)' with path: '/slave(623)/api/v1/executor'
> I1210 16:20:13.492733 237449216 http.cpp:1157] HTTP POST for
> /slave(623)/api/v1/executor from 10.0.49.4:55787
> I1210 16:20:13.492856 237449216 slave.cpp:4633] Received Subscribe request
> for HTTP executor 'default' of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:13.492897 237449216 slave.cpp:4696] Creating a marker file for
> HTTP based executor 'default' of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (via HTTP) at path
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39/http.marker'
> I1210 16:20:13.494416 237449216 slave.cpp:914] Agent terminating
> I1210 16:20:13.494870 235302912 master.cpp:1275] Agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local) disconnected
> I1210 16:20:13.494896 235302912 master.cpp:3278] Disconnecting agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local)
> I1210 16:20:13.494930 235302912 master.cpp:3297] Deactivating agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local)
> I1210 16:20:13.495144 237985792 hierarchical.cpp:801] Agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 deactivated
> E1210 16:20:13.495967 211709952 executor.cpp:714] End-Of-File received from
> agent. The agent closed the event stream
> I1210 16:20:13.495613 210100224 default_executor.cpp:204] Received SUBSCRIBED
> event
> I1210 16:20:13.496700 210100224 default_executor.cpp:208] Subscribed executor
> on Jenkinss-Mac-mini.local
> I1210 16:20:13.499964 209563648 default_executor.cpp:176] Disconnected from
> agent
> I1210 16:20:13.501919 338650560 containerizer.cpp:305] Using isolation {
> environment_secret, filesystem/posix, posix/mem, posix/cpu }
> I1210 16:20:13.502089 338650560 provisioner.cpp:298] Using default backend
> 'copy'
> I1210 16:20:13.502879 338650560 cluster.cpp:485] Creating default 'local'
> authorizer
> I1210 16:20:13.503680 239595520 process.cpp:2754] Returning '404 Not Found'
> for '/slave(623)/api/v1/executor'
> I1210 16:20:13.504453 235302912 slave.cpp:268] Mesos agent started on
> (623)@10.0.49.4:54069
> I1210 16:20:13.504480 235302912 slave.cpp:269] Flags at startup: --acls=""
> --appc_simple_discovery_uri_prefix="http://";
> --appc_store_dir="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/store/appc"
> --authenticate_http_executors="true" --authenticate_http_readonly="true"
> --authenticate_http_readwrite="true" --authenticatee="crammd5"
> --authentication_backoff_factor="1secs" --authentication_timeout_max="1mins"
> --authentication_timeout_min="5secs" --authorizer="local"
> --container_disk_watch_interval="15secs" --containerizers="mesos"
> --credential="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/credential"
> --default_role="*" --disk_watch_interval="1mins" --docker="docker"
> --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io";
> --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock"
> --docker_stop_timeout="0ns"
> --docker_store_dir="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/store/docker"
> --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume"
> --enforce_container_disk_quota="false"
> --executor_registration_timeout="1mins"
> --executor_reregistration_timeout="2secs"
> --executor_shutdown_grace_period="5secs"
> --fetcher_cache_dir="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/fetch"
> --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins"
> --frameworks_home="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/frameworks"
> --gc_delay="1weeks" --gc_disk_headroom="0.1"
> --gc_non_executor_container_sandboxes="false" --help="false"
> --hostname_lookup="true" --http_command_executor="false"
> --http_credentials="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/http_credentials"
> --http_heartbeat_interval="30secs" --initialize_driver_logging="true"
> --isolation="posix/cpu,posix/mem"
> --jwt_secret_key="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/jwt_secret_key"
> --launcher="posix"
> --launcher_dir="/Users/jenkins/workspace/workspace/mesos/Mesos_CI-build/FLAG/SSL/label/mac/mesos/build/src"
> --logbufsecs="0" --logging_level="INFO"
> --max_completed_executors_per_framework="150" --memory_profiling="false"
> --network_cni_metrics="true" --oversubscribed_resources_interval="15secs"
> --port="5051" --qos_correction_interval_min="0ns" --quiet="false"
> --reconfiguration_policy="equal" --recover="reconnect"
> --recovery_timeout="15mins" --registration_backoff_factor="10ms"
> --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]"
> --runtime_dir="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N"
> --sandbox_directory="/mnt/mesos/sandbox" --strict="true"
> --switch_user="true" --version="false"
> --work_dir="/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2"
> --zk_session_timeout="10secs"
> I1210 16:20:13.504766 235302912 credentials.hpp:86] Loading credential for
> authentication from
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/credential'
> I1210 16:20:13.504931 235302912 slave.cpp:301] Agent using credential for:
> test-principal
> I1210 16:20:13.504947 235302912 credentials.hpp:37] Loading credentials for
> authentication from
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_msIF5N/http_credentials'
> W1210 16:20:13.504299 212246528 executor.cpp:666] Received '404 Not Found' ()
> for SUBSCRIBE
> I1210 16:20:13.505218 235302912 http.cpp:1017] Creating default 'basic' HTTP
> authenticator for realm 'mesos-agent-executor'
> I1210 16:20:13.505275 235302912 http.cpp:1038] Creating default 'jwt' HTTP
> authenticator for realm 'mesos-agent-executor'
> I1210 16:20:13.505345 235302912 http.cpp:1017] Creating default 'basic' HTTP
> authenticator for realm 'mesos-agent-readonly'
> I1210 16:20:13.505388 235302912 http.cpp:1038] Creating default 'jwt' HTTP
> authenticator for realm 'mesos-agent-readonly'
> I1210 16:20:13.505463 235302912 http.cpp:1017] Creating default 'basic' HTTP
> authenticator for realm 'mesos-agent-readwrite'
> I1210 16:20:13.505494 235302912 http.cpp:1038] Creating default 'jwt' HTTP
> authenticator for realm 'mesos-agent-readwrite'
> I1210 16:20:13.505656 235302912 disk_profile_adaptor.cpp:80] Creating default
> disk profile adaptor module
> I1210 16:20:13.506040 235302912 slave.cpp:616] Agent resources:
> [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
> I1210 16:20:13.506165 235302912 slave.cpp:624] Agent attributes: [ ]
> I1210 16:20:13.506180 235302912 slave.cpp:633] Agent hostname:
> Jenkinss-Mac-mini.local
> I1210 16:20:13.506239 237985792 task_status_update_manager.cpp:181] Pausing
> sending task status updates
> I1210 16:20:13.506757 235839488 state.cpp:66] Recovering state from
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta'
> I1210 16:20:13.506821 235839488 state.cpp:711] No committed checkpointed
> resources found at
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/resources/resources.info'
> W1210 16:20:13.508056 235839488 state.cpp:618] Failed to find status updates
> file
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39/tasks/93bb5fe3-618b-4fb1-a039-7cad34b2cae9/task.updates'
> W1210 16:20:13.508483 235839488 state.cpp:618] Failed to find status updates
> file
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39/tasks/82580022-d138-44b1-92f5-fd4aca745388/task.updates'
> I1210 16:20:13.509327 239058944 slave.cpp:6935] Finished recovering
> checkpointed state from
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta',
> beginning agent recovery
> I1210 16:20:13.509505 239058944 slave.cpp:7414] Recovering framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:13.509544 239058944 slave.cpp:9122] Recovering executor 'default'
> of framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:13.509923 236912640 task_status_update_manager.cpp:207]
> Recovering task status update manager
> I1210 16:20:13.509943 236912640 task_status_update_manager.cpp:215]
> Recovering executor 'default' of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> W1210 16:20:13.510011 236912640 task_status_update_manager.cpp:254] No status
> updates found for task 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> W1210 16:20:13.510057 236912640 task_status_update_manager.cpp:254] No status
> updates found for task 82580022-d138-44b1-92f5-fd4aca745388 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:13.510068 239058944 slave.cpp:993] Successfully attached
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> to virtual path
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/latest'
> I1210 16:20:13.510404 236376064 slave.cpp:993] Successfully attached
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> to virtual path
> '/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/latest'
> I1210 16:20:13.510478 235302912 containerizer.cpp:727] Recovering Mesos
> containers
> I1210 16:20:13.510505 235839488 slave.cpp:993] Successfully attached
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> to virtual path
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> I1210 16:20:13.510538 235302912 containerizer.cpp:784] Recovering container
> 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39 for executor 'default' of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:13.511154 235302912 containerizer.cpp:1053] Recovering isolators
> I1210 16:20:13.511585 236912640 containerizer.cpp:1092] Recovering provisioner
> I1210 16:20:13.511898 235839488 provisioner.cpp:494] Provisioner recovery
> complete
> I1210 16:20:13.512567 239058944 composing.cpp:339] Finished recovering all
> containerizers
> I1210 16:20:13.512616 237449216 slave.cpp:7164] Recovering executors
> I1210 16:20:13.512668 237449216 slave.cpp:7251] Waiting for executor
> 'default' of framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (via HTTP)
> to subscribe
> I1210 16:20:14.307296 237985792 hierarchical.cpp:1566] Performed allocation
> for 1 agents in 86244ns
> I1210 16:20:22.002549 236912640 slave.cpp:5223] Cleaning up un-reregistered
> executors
> I1210 16:20:22.002619 236912640 slave.cpp:5241] Killing un-reregistered
> executor 'default' of framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> (via HTTP)
> I1210 16:20:22.002976 236912640 slave.cpp:7317] Finished recovery
> W1210 16:20:22.003154 209563648 executor.cpp:781] Dropping SUBSCRIBE:
> Executor is in state SUBSCRIBING
> I1210 16:20:22.003417 237449216 hierarchical.cpp:1566] Performed allocation
> for 1 agents in 134690ns
> I1210 16:20:22.005040 238522368 containerizer.cpp:2463] Destroying container
> 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39 in RUNNING state
> I1210 16:20:22.005077 238522368 containerizer.cpp:3130] Transitioning the
> state of container 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39 from RUNNING to
> DESTROYING
> I1210 16:20:22.005249 238522368 launcher.cpp:161] Asked to destroy container
> 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39
> I1210 16:20:23.004274 235839488 hierarchical.cpp:1566] Performed allocation
> for 1 agents in 79636ns
> I1210 16:20:24.004747 237449216 hierarchical.cpp:1566] Performed allocation
> for 1 agents in 79877ns
> I1210 16:20:25.013471 239058944 hierarchical.cpp:1566] Performed allocation
> for 1 agents in 80594ns
> I1210 16:20:25.273720 236912640 process.cpp:3588] Handling HTTP event for
> process 'slave(623)' with path: '/slave(623)/api/v1/executor'
> I1210 16:20:25.274073 236912640 slave.cpp:1259] New master detected at
> master@10.0.49.4:54069
> I1210 16:20:25.274127 236912640 slave.cpp:1324] Detecting new master
> I1210 16:20:25.274938 239058944 task_status_update_manager.cpp:181] Pausing
> sending task status updates
> I1210 16:20:25.275763 237985792 process.cpp:3650] Failed to process request
> for '/slave(623)/api/v1/executor': discarded
> I1210 16:20:25.284792 237449216 slave.cpp:1351] Authenticating with master
> master@10.0.49.4:54069
> I1210 16:20:25.284873 237449216 slave.cpp:1360] Using default CRAM-MD5
> authenticatee
> I1210 16:20:25.285085 236376064 authenticatee.cpp:121] Creating new client
> SASL connection
> I1210 16:20:25.285269 237985792 master.cpp:9683] Authenticating
> slave(623)@10.0.49.4:54069
> I1210 16:20:25.285357 239058944 authenticator.cpp:414] Starting
> authentication session for crammd5-authenticatee(1212)@10.0.49.4:54069
> I1210 16:20:25.285522 235839488 authenticator.cpp:98] Creating new server
> SASL connection
> I1210 16:20:25.285624 236912640 authenticatee.cpp:213] Received SASL
> authentication mechanisms: CRAM-MD5
> I1210 16:20:25.285647 236912640 authenticatee.cpp:239] Attempting to
> authenticate with mechanism 'CRAM-MD5'
> I1210 16:20:25.285727 238522368 authenticator.cpp:204] Received SASL
> authentication start
> I1210 16:20:25.285845 238522368 authenticator.cpp:326] Authentication
> requires more steps
> I1210 16:20:25.285907 237449216 authenticatee.cpp:259] Received SASL
> authentication step
> I1210 16:20:25.285989 235302912 authenticator.cpp:232] Received SASL
> authentication step
> I1210 16:20:25.286013 235302912 auxprop.cpp:109] Request to lookup properties
> for user: 'test-principal' realm: 'Jenkinss-Mac-mini.local' server FQDN:
> 'Jenkinss-Mac-mini.local' SASL_AUXPROP_VERIFY_AGAINST_HASH: false
> SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false
> I1210 16:20:25.286041 235302912 auxprop.cpp:181] Looking up auxiliary
> property '*userPassword'
> I1210 16:20:25.286064 235302912 auxprop.cpp:181] Looking up auxiliary
> property '*cmusaslsecretCRAM-MD5'
> I1210 16:20:25.286079 235302912 auxprop.cpp:109] Request to lookup properties
> for user: 'test-principal' realm: 'Jenkinss-Mac-mini.local' server FQDN:
> 'Jenkinss-Mac-mini.local' SASL_AUXPROP_VERIFY_AGAINST_HASH: false
> SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true
> I1210 16:20:25.286090 235302912 auxprop.cpp:131] Skipping auxiliary property
> '*userPassword' since SASL_AUXPROP_AUTHZID == true
> I1210 16:20:25.286098 235302912 auxprop.cpp:131] Skipping auxiliary property
> '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
> I1210 16:20:25.286113 235302912 authenticator.cpp:318] Authentication success
> I1210 16:20:25.286207 236376064 authenticatee.cpp:299] Authentication success
> I1210 16:20:25.286283 237985792 master.cpp:9715] Successfully authenticated
> principal 'test-principal' at slave(623)@10.0.49.4:54069
> I1210 16:20:25.286303 239058944 authenticator.cpp:432] Authentication session
> cleanup for crammd5-authenticatee(1212)@10.0.49.4:54069
> I1210 16:20:25.286533 235839488 slave.cpp:1451] Successfully authenticated
> with master master@10.0.49.4:54069
> I1210 16:20:25.286942 235839488 slave.cpp:1882] Will retry registration in
> 224688ns if necessary
> I1210 16:20:25.287168 236376064 master.cpp:6959] Received reregister agent
> message from agent 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at
> slave(623)@10.0.49.4:54069 (Jenkinss-Mac-mini.local)
> I1210 16:20:25.287384 236376064 master.cpp:3935] Authorizing agent providing
> resources 'cpus:2; mem:1024; disk:1024; ports:[31000-32000]' with principal
> 'test-principal'
> I1210 16:20:25.287750 237449216 master.cpp:7051] Authorized re-registration
> of agent 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at
> slave(623)@10.0.49.4:54069 (Jenkinss-Mac-mini.local)
> I1210 16:20:25.287808 237449216 master.cpp:7135] Agent is already marked as
> registered: 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at
> slave(623)@10.0.49.4:54069 (Jenkinss-Mac-mini.local)
> I1210 16:20:25.287889 237449216 master.cpp:7503] Registry updated for slave
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at
> slave(623)@10.0.49.4:54069(Jenkinss-Mac-mini.local)
> I1210 16:20:25.288169 238522368 hierarchical.cpp:703] Agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 (Jenkinss-Mac-mini.local) updated
> with total resources cpus:2; mem:1024; disk:1024; ports:[31000-32000]
> I1210 16:20:25.288252 236912640 slave.cpp:1590] Re-registered with master
> master@10.0.49.4:54069
> I1210 16:20:25.288409 237985792 hierarchical.cpp:789] Agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 reactivated
> I1210 16:20:25.288360 236912640 slave.cpp:1635] Forwarding agent update
> {"operations":{},"resource_version_uuid":{"value":"wSWYHeJETsmGlz155Zp5/g=="},"slave_id":{"value":"4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0"},"update_oversubscribed_resources":false}
> I1210 16:20:25.288456 236376064 task_status_update_manager.cpp:188] Resuming
> sending task status updates
> I1210 16:20:25.288568 236912640 slave.cpp:4072] Updating info for framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:25.288614 236912640 slave.cpp:8918] Checkpointing FrameworkInfo
> to
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/framework.info'
> I1210 16:20:25.288733 235302912 master.cpp:7939] Ignoring update on agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local) as it reports no changes
> I1210 16:20:25.289389 236912640 slave.cpp:8929] Checkpointing framework pid
> '@0.0.0.0:0' to
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/framework.pid'
> I1210 16:20:25.289863 238522368 task_status_update_manager.cpp:188] Resuming
> sending task status updates
> I1210 16:20:25.368932 235839488 containerizer.cpp:2969] Container
> 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39 has exited
> I1210 16:20:25.369688 237449216 provisioner.cpp:597] Ignoring destroy request
> for unknown container 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39
> I1210 16:20:25.370327 236912640 slave.cpp:6315] Executor 'default' of
> framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 terminated with signal
> Killed: 9
> I1210 16:20:25.370404 236912640 slave.cpp:5295] Handling status update
> TASK_LOST (Status UUID: 595eaccb-c786-43f2-ad4b-11857d05b0fe) for task
> 82580022-d138-44b1-92f5-fd4aca745388 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 from @0.0.0.0:0
> I1210 16:20:25.370594 236912640 slave.cpp:5295] Handling status update
> TASK_LOST (Status UUID: b9c220cc-0b02-4beb-822e-f900b248a2c3) for task
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 from @0.0.0.0:0
> E1210 16:20:25.370746 236912640 slave.cpp:5626] Failed to update resources
> for container 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39 of executor 'default'
> running task 82580022-d138-44b1-92f5-fd4aca745388 on status update for
> terminal task, destroying container: Container not found
> W1210 16:20:25.370793 237985792 composing.cpp:609] Attempted to destroy
> unknown container 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39
> I1210 16:20:25.370798 235302912 master.cpp:8618] Executor 'default' of
> framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 on agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local): terminated with signal Killed: 9
> E1210 16:20:25.370839 236912640 slave.cpp:5626] Failed to update resources
> for container 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39 of executor 'default'
> running task 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 on status update for
> terminal task, destroying container: Container not found
> I1210 16:20:25.370860 235302912 master.cpp:11097] Removing executor 'default'
> with resources cpus(allocated: *):0.1; mem(allocated: *):32; disk(allocated:
> *):32 of framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 on agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local)
> I1210 16:20:25.370884 236376064 task_status_update_manager.cpp:328] Received
> task status update TASK_LOST (Status UUID:
> 595eaccb-c786-43f2-ad4b-11857d05b0fe) for task
> 82580022-d138-44b1-92f5-fd4aca745388 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> W1210 16:20:25.370932 239058944 composing.cpp:609] Attempted to destroy
> unknown container 0a1dd394-d4e6-4e67-b90a-ca5fd515ed39
> I1210 16:20:25.370951 236376064 task_status_update_manager.cpp:507] Creating
> StatusUpdate stream for task 82580022-d138-44b1-92f5-fd4aca745388 of
> framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:25.371124 238522368 hierarchical.cpp:1238] Recovered
> cpus(allocated: *):0.1; mem(allocated: *):32; disk(allocated: *):32 (total:
> cpus:2; mem:1024; disk:1024; ports:[31000-32000], allocated: cpus(allocated:
> *):0.2; mem(allocated: *):64; disk(allocated: *):64) on agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 from framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:25.371512 236376064 task_status_update_manager.cpp:842]
> Checkpointing UPDATE for task status update TASK_LOST (Status UUID:
> 595eaccb-c786-43f2-ad4b-11857d05b0fe) for task
> 82580022-d138-44b1-92f5-fd4aca745388 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:25.371547 236912640 scheduler.cpp:845] Enqueuing event FAILURE
> received from http://10.0.49.4:54069/master/api/v1/scheduler
> I1210 16:20:25.371671 236376064 task_status_update_manager.cpp:383]
> Forwarding task status update TASK_LOST (Status UUID:
> 595eaccb-c786-43f2-ad4b-11857d05b0fe) for task
> 82580022-d138-44b1-92f5-fd4aca745388 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 to the agent
> I1210 16:20:25.371742 238522368 slave.cpp:5787] Forwarding the update
> TASK_LOST (Status UUID: 595eaccb-c786-43f2-ad4b-11857d05b0fe) for task
> 82580022-d138-44b1-92f5-fd4aca745388 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 to master@10.0.49.4:54069
> I1210 16:20:25.371809 236376064 task_status_update_manager.cpp:328] Received
> task status update TASK_LOST (Status UUID:
> b9c220cc-0b02-4beb-822e-f900b248a2c3) for task
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> GMOCK WARNING:
> Uninteresting mock function call - returning directly.
> Function call: failure(0x7ffeec2a4c70, @0x7fd3887565f0 48-byte object
> <20-01 69-19 01-00 00-00 00-00 00-00 00-00 00-00 07-00 00-00 00-00 00-00
> C0-C8 7E-88 D3-7F 00-00 60-93 76-88 D3-7F 00-00 09-00 00-00 00-00 00-00>)
> I1210 16:20:25.371843 236376064 task_status_update_manager.cpp:507] Creating
> StatusUpdate stream for task 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 of
> framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> NOTE: You can safely ignore the above warning unless this call should not
> happen. Do not suppress it by blindly adding an EXPECT_CALL() if you don't
> mean to enforce the call. See
> https://github.com/google/googletest/blob/master/googlemock/docs/CookBook.md#knowing-when-to-expect
> for details.
> I1210 16:20:25.371840 238522368 slave.cpp:5680] Task status update manager
> successfully handled status update TASK_LOST (Status UUID:
> 595eaccb-c786-43f2-ad4b-11857d05b0fe) for task
> 82580022-d138-44b1-92f5-fd4aca745388 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:25.372014 237449216 master.cpp:8375] Status update TASK_LOST
> (Status UUID: 595eaccb-c786-43f2-ad4b-11857d05b0fe) for task
> 82580022-d138-44b1-92f5-fd4aca745388 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 from agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local)
> I1210 16:20:25.372041 237449216 master.cpp:8432] Forwarding status update
> TASK_LOST (Status UUID: 595eaccb-c786-43f2-ad4b-11857d05b0fe) for task
> 82580022-d138-44b1-92f5-fd4aca745388 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:25.372180 237449216 master.cpp:10962] Updating the state of task
> 82580022-d138-44b1-92f5-fd4aca745388 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (latest state: TASK_LOST, status
> update state: TASK_LOST)
> I1210 16:20:25.372332 236376064 task_status_update_manager.cpp:842]
> Checkpointing UPDATE for task status update TASK_LOST (Status UUID:
> b9c220cc-0b02-4beb-822e-f900b248a2c3) for task
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:25.372436 235302912 hierarchical.cpp:1238] Recovered
> cpus(allocated: *):0.1; mem(allocated: *):32; disk(allocated: *):32 (total:
> cpus:2; mem:1024; disk:1024; ports:[31000-32000], allocated: cpus(allocated:
> *):0.1; mem(allocated: *):32; disk(allocated: *):32) on agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 from framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:25.372503 236376064 task_status_update_manager.cpp:383]
> Forwarding task status update TASK_LOST (Status UUID:
> b9c220cc-0b02-4beb-822e-f900b248a2c3) for task
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 to the agent
> I1210 16:20:25.372606 235839488 slave.cpp:5787] Forwarding the update
> TASK_LOST (Status UUID: b9c220cc-0b02-4beb-822e-f900b248a2c3) for task
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 to master@10.0.49.4:54069
> I1210 16:20:25.372720 235839488 slave.cpp:5680] Task status update manager
> successfully handled status update TASK_LOST (Status UUID:
> b9c220cc-0b02-4beb-822e-f900b248a2c3) for task
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:25.372752 239058944 scheduler.cpp:845] Enqueuing event UPDATE
> received from http://10.0.49.4:54069/master/api/v1/scheduler
> I1210 16:20:25.372757 237449216 master.cpp:8375] Status update TASK_LOST
> (Status UUID: b9c220cc-0b02-4beb-822e-f900b248a2c3) for task
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 from agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local)
> I1210 16:20:25.372786 237449216 master.cpp:8432] Forwarding status update
> TASK_LOST (Status UUID: b9c220cc-0b02-4beb-822e-f900b248a2c3) for task
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:25.372923 237449216 master.cpp:10962] Updating the state of task
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (latest state: TASK_LOST, status
> update state: TASK_LOST)
> GMOCK WARNING:
> Uninteresting mock function call - returning directly.
> Function call: update(0x7ffeec2a4c70, @0x7fd3887102b0 TASK_LOST (Status
> UUID: 595eaccb-c786-43f2-ad4b-11857d05b0fe) Source: SOURCE_AGENT Reason:
> REASON_EXECUTOR_REREGISTRATION_TIMEOUT Message: 'Executor did not reregister
> within 2secs' for task '82580022-d138-44b1-92f5-fd4aca745388' on agent:
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0)
> NOTE: You can safely ignore the above warning unless this call should not
> happen. Do not suppress it by blindly adding an EXPECT_CALL() if you don't
> mean to enforce the call. See
> https://github.com/google/googletest/blob/master/googlemock/docs/CookBook.md#knowing-when-to-expect
> for details.
> I1210 16:20:25.373216 235839488 hierarchical.cpp:1238] Recovered
> cpus(allocated: *):0.1; mem(allocated: *):32; disk(allocated: *):32 (total:
> cpus:2; mem:1024; disk:1024; ports:[31000-32000], allocated: {}) on agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 from framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:25.373327 239058944 scheduler.cpp:845] Enqueuing event UPDATE
> received from http://10.0.49.4:54069/master/api/v1/scheduler
> GMOCK WARNING:
> Uninteresting mock function call - returning directly.
> Function call: update(0x7ffeec2a4c70, @0x7fd38867e1b0 TASK_LOST (Status
> UUID: b9c220cc-0b02-4beb-822e-f900b248a2c3) Source: SOURCE_AGENT Reason:
> REASON_EXECUTOR_REREGISTRATION_TIMEOUT Message: 'Executor did not reregister
> within 2secs' for task '93bb5fe3-618b-4fb1-a039-7cad34b2cae9' on agent:
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0)
> NOTE: You can safely ignore the above warning unless this call should not
> happen. Do not suppress it by blindly adding an EXPECT_CALL() if you don't
> mean to enforce the call. See
> https://github.com/google/googletest/blob/master/googlemock/docs/CookBook.md#knowing-when-to-expect
> for details.
> I1210 16:20:26.019500 239058944 hierarchical.cpp:1566] Performed allocation
> for 1 agents in 277057ns
> I1210 16:20:26.019677 238522368 master.cpp:9498] Sending offers [
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-O1 ] to framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default)
> I1210 16:20:26.020336 236376064 scheduler.cpp:845] Enqueuing event OFFERS
> received from http://10.0.49.4:54069/master/api/v1/scheduler
> I1210 16:20:27.026796 235839488 hierarchical.cpp:1566] Performed allocation
> for 1 agents in 110569ns
> I1210 16:20:28.033782 237449216 hierarchical.cpp:1566] Performed allocation
> for 1 agents in 109876ns
> I1210 16:20:28.319780 236912640 scheduler.cpp:845] Enqueuing event HEARTBEAT
> received from http://10.0.49.4:54069/master/api/v1/scheduler
> ../../src/tests/slave_tests.cpp:6346: Failure
> Failed to wait 15secs for _shutdownExecutor
> I1210 16:20:28.515616 237985792 master.cpp:1390] Framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default) disconnected
> I1210 16:20:28.515662 237985792 master.cpp:3241] Deactivating framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default)
> I1210 16:20:28.515851 238522368 hierarchical.cpp:418] Deactivated framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> W1210 16:20:28.516037 237985792 master.hpp:2615] Unable to send message to
> framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default): connection
> closed
> I1210 16:20:28.516057 237985792 master.cpp:11501] Removing offer
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-O1
> I1210 16:20:28.516090 237985792 master.cpp:3218] Disconnecting framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default)
> I1210 16:20:28.516119 237985792 master.cpp:1405] Giving framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default) 0ns to failover
> I1210 16:20:28.516222 237449216 master.cpp:9290] Framework failover timeout,
> removing framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default)
> I1210 16:20:28.516211 238522368 hierarchical.cpp:1238] Recovered
> cpus(allocated: *):2; mem(allocated: *):1024; disk(allocated: *):1024;
> ports(allocated: *):[31000-32000] (total: cpus:2; mem:1024; disk:1024;
> ports:[31000-32000], allocated: {}) on agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 from framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:28.516238 237449216 master.cpp:10227] Removing framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (default)
> I1210 16:20:28.516330 237449216 master.cpp:10962] Updating the state of task
> 82580022-d138-44b1-92f5-fd4aca745388 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (latest state: TASK_LOST, status
> update state: TASK_KILLED)
> I1210 16:20:28.516376 235302912 slave.cpp:3901] Asked to shut down framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 by master@10.0.49.4:54069
> I1210 16:20:28.516362 237449216 master.cpp:11060] Removing task
> 82580022-d138-44b1-92f5-fd4aca745388 with resources cpus(allocated: *):0.1;
> mem(allocated: *):32; disk(allocated: *):32 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 on agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local)
> I1210 16:20:28.516400 235302912 slave.cpp:3926] Shutting down framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:28.516422 235302912 slave.cpp:6413] Cleaning up executor
> 'default' of framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:28.516505 237449216 master.cpp:10962] Updating the state of task
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 (latest state: TASK_LOST, status
> update state: TASK_KILLED)
> I1210 16:20:28.516559 237449216 master.cpp:11060] Removing task
> 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 with resources cpus(allocated: *):0.1;
> mem(allocated: *):32; disk(allocated: *):32 of framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000 on agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local)
> I1210 16:20:28.516865 236376064 hierarchical.cpp:357] Removed framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:28.516922 239058944 gc.cpp:95] Scheduling
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> for gc 6.99999403393482days in the future
> I1210 16:20:28.517097 235839488 gc.cpp:95] Scheduling
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default'
> for gc 6.99999403393482days in the future
> I1210 16:20:28.517204 237985792 gc.cpp:95] Scheduling
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default/runs/0a1dd394-d4e6-4e67-b90a-ca5fd515ed39'
> for gc 6.99999403393482days in the future
> I1210 16:20:28.517334 238522368 gc.cpp:95] Scheduling
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000/executors/default'
> for gc 6.99999403393482days in the future
> I1210 16:20:28.517354 235302912 slave.cpp:6542] Cleaning up framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:28.517402 237449216 task_status_update_manager.cpp:289] Closing
> task status update streams for framework
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:28.517457 237449216 task_status_update_manager.cpp:538] Cleaning
> up status update stream for task 82580022-d138-44b1-92f5-fd4aca745388 of
> framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:28.517541 236912640 gc.cpp:95] Scheduling
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000'
> for gc 6.99999403393482days in the future
> I1210 16:20:28.517648 236912640 gc.cpp:95] Scheduling
> '/var/folders/6w/rw03zh013y38ys6cyn8qppf80000gn/T/SlaveTest_AgentFailoverTerminatesHTTPExecutorWithNoTask_HmuAD2/meta/slaves/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0/frameworks/4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000'
> for gc 6.99999403393482days in the future
> I1210 16:20:28.517736 237449216 task_status_update_manager.cpp:538] Cleaning
> up status update stream for task 93bb5fe3-618b-4fb1-a039-7cad34b2cae9 of
> framework 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-0000
> I1210 16:20:28.518105 238522368 slave.cpp:914] Agent terminating
> I1210 16:20:28.518571 237985792 master.cpp:1275] Agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local) disconnected
> I1210 16:20:28.518592 237985792 master.cpp:3278] Disconnecting agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local)
> I1210 16:20:28.518617 237985792 master.cpp:3297] Deactivating agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 at slave(623)@10.0.49.4:54069
> (Jenkinss-Mac-mini.local)
> I1210 16:20:28.518719 235839488 hierarchical.cpp:801] Agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0 deactivated
> ../../src/tests/slave_tests.cpp:6341: Failure
> Actual function call count doesn't match EXPECT_CALL(*slave.get()->mock(),
> _shutdownExecutor(_, _))...
> Expected: to be called once
> Actual: never called - unsatisfied and active
> I1210 16:20:28.521852 338650560 master.cpp:1117] Master terminating
> I1210 16:20:28.522091 236912640 hierarchical.cpp:643] Removed agent
> 4c470ddd-dc29-4d9c-9b46-8e7a8b6c7801-S0
> [ FAILED ] SlaveTest.AgentFailoverTerminatesHTTPExecutorWithNoTask (15227
> ms)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
