[
https://issues.apache.org/jira/browse/MESOS-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15238522#comment-15238522
]
Yongqiao Wang commented on MESOS-5146:
--------------------------------------
Append the RR: https://reviews.apache.org/r/46135/
> MasterAllocatorTest/1.RebalancedForUpdatedWeights is flaky
> ----------------------------------------------------------
>
> Key: MESOS-5146
> URL: https://issues.apache.org/jira/browse/MESOS-5146
> Project: Mesos
> Issue Type: Bug
> Components: allocation, tests
> Affects Versions: 0.28.0
> Environment: Ubuntu 14.04 using clang, without libevent or SSL
> Reporter: Greg Mann
> Assignee: Yongqiao Wang
> Labels: mesosphere
> Fix For: 0.29.0
>
>
> Observed on the ASF CI:
> {code}
> [ RUN ] MasterAllocatorTest/1.RebalancedForUpdatedWeights
> I0407 22:34:10.330394 29278 cluster.cpp:149] Creating default 'local'
> authorizer
> I0407 22:34:10.466182 29278 leveldb.cpp:174] Opened db in 135.608207ms
> I0407 22:34:10.516398 29278 leveldb.cpp:181] Compacted db in 50.159558ms
> I0407 22:34:10.516464 29278 leveldb.cpp:196] Created db iterator in 34959ns
> I0407 22:34:10.516484 29278 leveldb.cpp:202] Seeked to beginning of db in
> 10195ns
> I0407 22:34:10.516496 29278 leveldb.cpp:271] Iterated through 0 keys in the
> db in 7324ns
> I0407 22:34:10.516547 29278 replica.cpp:779] Replica recovered with log
> positions 0 -> 0 with 1 holes and 0 unlearned
> I0407 22:34:10.517277 29298 recover.cpp:447] Starting replica recovery
> I0407 22:34:10.517693 29300 recover.cpp:473] Replica is in EMPTY status
> I0407 22:34:10.520251 29310 replica.cpp:673] Replica in EMPTY status received
> a broadcasted recover request from (4775)@172.17.0.3:35855
> I0407 22:34:10.520611 29311 recover.cpp:193] Received a recover response from
> a replica in EMPTY status
> I0407 22:34:10.521164 29299 recover.cpp:564] Updating replica status to
> STARTING
> I0407 22:34:10.523435 29298 master.cpp:382] Master
> f59f9057-a5c7-43e1-b129-96862e640a12 (129e11060069) started on
> 172.17.0.3:35855
> I0407 22:34:10.523473 29298 master.cpp:384] Flags at startup: --acls=""
> --allocation_interval="1secs" --allocator="HierarchicalDRF"
> --authenticate="true" --authenticate_http="true" --authenticate_slaves="true"
> --authenticators="crammd5" --authorizers="local"
> --credentials="/tmp/3rZY8C/credentials" --framework_sorter="drf"
> --help="false" --hostname_lookup="true" --http_authenticators="basic"
> --initialize_driver_logging="true" --log_auto_initialize="true"
> --logbufsecs="0" --logging_level="INFO" --max_completed_frameworks="50"
> --max_completed_tasks_per_framework="1000" --max_slave_ping_timeouts="5"
> --quiet="false" --recovery_slave_removal_limit="100%"
> --registry="replicated_log" --registry_fetch_timeout="1mins"
> --registry_store_timeout="100secs" --registry_strict="true"
> --root_submissions="true" --slave_ping_timeout="15secs"
> --slave_reregister_timeout="10mins" --user_sorter="drf" --version="false"
> --webui_dir="/mesos/mesos-0.29.0/_inst/share/mesos/webui"
> --work_dir="/tmp/3rZY8C/master" --zk_session_timeout="10secs"
> I0407 22:34:10.523885 29298 master.cpp:433] Master only allowing
> authenticated frameworks to register
> I0407 22:34:10.523901 29298 master.cpp:438] Master only allowing
> authenticated agents to register
> I0407 22:34:10.523913 29298 credentials.hpp:37] Loading credentials for
> authentication from '/tmp/3rZY8C/credentials'
> I0407 22:34:10.524298 29298 master.cpp:480] Using default 'crammd5'
> authenticator
> I0407 22:34:10.524441 29298 master.cpp:551] Using default 'basic' HTTP
> authenticator
> I0407 22:34:10.524564 29298 master.cpp:589] Authorization enabled
> I0407 22:34:10.525269 29305 hierarchical.cpp:145] Initialized hierarchical
> allocator process
> I0407 22:34:10.525333 29305 whitelist_watcher.cpp:77] No whitelist given
> I0407 22:34:10.527331 29298 master.cpp:1832] The newly elected leader is
> master@172.17.0.3:35855 with id f59f9057-a5c7-43e1-b129-96862e640a12
> I0407 22:34:10.527441 29298 master.cpp:1845] Elected as the leading master!
> I0407 22:34:10.527545 29298 master.cpp:1532] Recovering from registrar
> I0407 22:34:10.527889 29298 registrar.cpp:331] Recovering registrar
> I0407 22:34:10.549734 29299 leveldb.cpp:304] Persisting metadata (8 bytes) to
> leveldb took 28.25177ms
> I0407 22:34:10.549782 29299 replica.cpp:320] Persisted replica status to
> STARTING
> I0407 22:34:10.550010 29299 recover.cpp:473] Replica is in STARTING status
> I0407 22:34:10.551352 29299 replica.cpp:673] Replica in STARTING status
> received a broadcasted recover request from (4777)@172.17.0.3:35855
> I0407 22:34:10.551676 29299 recover.cpp:193] Received a recover response from
> a replica in STARTING status
> I0407 22:34:10.552315 29308 recover.cpp:564] Updating replica status to VOTING
> I0407 22:34:10.574865 29308 leveldb.cpp:304] Persisting metadata (8 bytes) to
> leveldb took 22.413614ms
> I0407 22:34:10.574928 29308 replica.cpp:320] Persisted replica status to
> VOTING
> I0407 22:34:10.575103 29308 recover.cpp:578] Successfully joined the Paxos
> group
> I0407 22:34:10.575346 29308 recover.cpp:462] Recover process terminated
> I0407 22:34:10.575913 29308 log.cpp:659] Attempting to start the writer
> I0407 22:34:10.577512 29308 replica.cpp:493] Replica received implicit
> promise request from (4778)@172.17.0.3:35855 with proposal 1
> I0407 22:34:10.599984 29308 leveldb.cpp:304] Persisting metadata (8 bytes) to
> leveldb took 22.453613ms
> I0407 22:34:10.600026 29308 replica.cpp:342] Persisted promised to 1
> I0407 22:34:10.601773 29304 coordinator.cpp:238] Coordinator attempting to
> fill missing positions
> I0407 22:34:10.603757 29307 replica.cpp:388] Replica received explicit
> promise request from (4779)@172.17.0.3:35855 for position 0 with proposal 2
> I0407 22:34:10.634392 29307 leveldb.cpp:341] Persisting action (8 bytes) to
> leveldb took 30.269987ms
> I0407 22:34:10.634829 29307 replica.cpp:712] Persisted action at 0
> I0407 22:34:10.637017 29297 replica.cpp:537] Replica received write request
> for position 0 from (4780)@172.17.0.3:35855
> I0407 22:34:10.637099 29297 leveldb.cpp:436] Reading position from leveldb
> took 52948ns
> I0407 22:34:10.676170 29297 leveldb.cpp:341] Persisting action (14 bytes) to
> leveldb took 38.917487ms
> I0407 22:34:10.676352 29297 replica.cpp:712] Persisted action at 0
> I0407 22:34:10.677564 29306 replica.cpp:691] Replica received learned notice
> for position 0 from @0.0.0.0:0
> I0407 22:34:10.717959 29306 leveldb.cpp:341] Persisting action (16 bytes) to
> leveldb took 40.306229ms
> I0407 22:34:10.718202 29306 replica.cpp:712] Persisted action at 0
> I0407 22:34:10.718399 29306 replica.cpp:697] Replica learned NOP action at
> position 0
> I0407 22:34:10.719883 29306 log.cpp:675] Writer started with ending position 0
> I0407 22:34:10.721688 29305 leveldb.cpp:436] Reading position from leveldb
> took 75934ns
> I0407 22:34:10.723640 29306 registrar.cpp:364] Successfully fetched the
> registry (0B) in 195648us
> I0407 22:34:10.723999 29306 registrar.cpp:463] Applied 1 operations in
> 108099ns; attempting to update the 'registry'
> I0407 22:34:10.725077 29311 log.cpp:683] Attempting to append 170 bytes to
> the log
> I0407 22:34:10.725328 29308 coordinator.cpp:348] Coordinator attempting to
> write APPEND action at position 1
> I0407 22:34:10.726552 29299 replica.cpp:537] Replica received write request
> for position 1 from (4781)@172.17.0.3:35855
> I0407 22:34:10.759747 29299 leveldb.cpp:341] Persisting action (189 bytes) to
> leveldb took 33.089719ms
> I0407 22:34:10.759976 29299 replica.cpp:712] Persisted action at 1
> I0407 22:34:10.761739 29299 replica.cpp:691] Replica received learned notice
> for position 1 from @0.0.0.0:0
> I0407 22:34:10.801522 29299 leveldb.cpp:341] Persisting action (191 bytes) to
> leveldb took 39.694064ms
> I0407 22:34:10.801602 29299 replica.cpp:712] Persisted action at 1
> I0407 22:34:10.801638 29299 replica.cpp:697] Replica learned APPEND action at
> position 1
> I0407 22:34:10.803371 29311 registrar.cpp:508] Successfully updated the
> 'registry' in 79.163904ms
> I0407 22:34:10.803829 29311 registrar.cpp:394] Successfully recovered
> registrar
> I0407 22:34:10.804585 29311 master.cpp:1640] Recovered 0 agents from the
> Registry (131B) ; allowing 10mins for agents to re-register
> I0407 22:34:10.805269 29308 log.cpp:702] Attempting to truncate the log to 1
> I0407 22:34:10.805721 29310 coordinator.cpp:348] Coordinator attempting to
> write TRUNCATE action at position 2
> I0407 22:34:10.805276 29296 hierarchical.cpp:172] Skipping recovery of
> hierarchical allocator: nothing to recover
> I0407 22:34:10.806529 29307 replica.cpp:537] Replica received write request
> for position 2 from (4782)@172.17.0.3:35855
> I0407 22:34:10.843320 29307 leveldb.cpp:341] Persisting action (16 bytes) to
> leveldb took 36.77593ms
> I0407 22:34:10.843531 29307 replica.cpp:712] Persisted action at 2
> I0407 22:34:10.845369 29311 replica.cpp:691] Replica received learned notice
> for position 2 from @0.0.0.0:0
> I0407 22:34:10.885098 29311 leveldb.cpp:341] Persisting action (18 bytes) to
> leveldb took 39.641102ms
> I0407 22:34:10.885401 29311 leveldb.cpp:399] Deleting ~1 keys from leveldb
> took 88701ns
> I0407 22:34:10.885745 29311 replica.cpp:712] Persisted action at 2
> I0407 22:34:10.885862 29311 replica.cpp:697] Replica learned TRUNCATE action
> at position 2
> I0407 22:34:10.900660 29278 containerizer.cpp:155] Using isolation:
> posix/cpu,posix/mem,filesystem/posix
> W0407 22:34:10.901793 29278 backend.cpp:66] Failed to create 'bind' backend:
> BindBackend requires root privileges
> I0407 22:34:10.905488 29302 slave.cpp:201] Agent started on
> 111)@172.17.0.3:35855
> I0407 22:34:10.905553 29302 slave.cpp:202] Flags at startup:
> --appc_simple_discovery_uri_prefix="http://";
> --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http="true"
> --authenticatee="crammd5" --cgroups_cpu_enable_pids_and_tids_count="false"
> --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup"
> --cgroups_limit_swap="false" --cgroups_root="mesos"
> --container_disk_watch_interval="15secs" --containerizers="mesos"
> --credential="/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_9aCAYa/credential"
> --default_role="*" --disk_watch_interval="1mins" --docker="docker"
> --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io";
> --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock"
> --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker"
> --enforce_container_disk_quota="false"
> --executor_registration_timeout="1mins"
> --executor_shutdown_grace_period="5secs"
> --fetcher_cache_dir="/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_9aCAYa/fetch"
> --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
> --gc_disk_headroom="0.1" --hadoop_home="" --help="false"
> --hostname_lookup="true" --http_authenticators="basic"
> --http_credentials="/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_9aCAYa/http_credentials"
> --image_provisioner_backend="copy" --initialize_driver_logging="true"
> --isolation="posix/cpu,posix/mem"
> --launcher_dir="/mesos/mesos-0.29.0/_build/src" --logbufsecs="0"
> --logging_level="INFO" --oversubscribed_resources_interval="15secs"
> --perf_duration="10secs" --perf_interval="1mins"
> --qos_correction_interval_min="0ns" --quiet="false" --recover="reconnect"
> --recovery_timeout="15mins" --registration_backoff_factor="10ms"
> --resources="cpus:2;mem:1024;disk:4096;ports:[31000-32000]"
> --revocable_cpu_low_priority="true" --sandbox_directory="/mnt/mesos/sandbox"
> --strict="true" --switch_user="true" --systemd_enable_support="true"
> --systemd_runtime_directory="/run/systemd/system" --version="false"
> --work_dir="/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_9aCAYa"
> I0407 22:34:10.906365 29302 credentials.hpp:86] Loading credential for
> authentication from
> '/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_9aCAYa/credential'
> I0407 22:34:10.906787 29302 slave.cpp:339] Agent using credential for:
> test-principal
> I0407 22:34:10.907202 29302 credentials.hpp:37] Loading credentials for
> authentication from
> '/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_9aCAYa/http_credentials'
> I0407 22:34:10.907713 29302 slave.cpp:391] Using default 'basic' HTTP
> authenticator
> I0407 22:34:10.908499 29302 resources.cpp:572] Parsing resources as JSON
> failed: cpus:2;mem:1024;disk:4096;ports:[31000-32000]
> Trying semicolon-delimited string format instead
> I0407 22:34:10.910189 29302 slave.cpp:590] Agent resources: cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000]
> I0407 22:34:10.910362 29302 slave.cpp:598] Agent attributes: [ ]
> I0407 22:34:10.910465 29302 slave.cpp:603] Agent hostname: 129e11060069
> I0407 22:34:10.913280 29303 state.cpp:57] Recovering state from
> '/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_9aCAYa/meta'
> I0407 22:34:10.914621 29303 status_update_manager.cpp:200] Recovering status
> update manager
> I0407 22:34:10.915226 29303 containerizer.cpp:416] Recovering containerizer
> I0407 22:34:10.917246 29301 provisioner.cpp:245] Provisioner recovery complete
> I0407 22:34:10.917733 29301 slave.cpp:4784] Finished recovery
> I0407 22:34:10.918226 29301 slave.cpp:4956] Querying resource estimator for
> oversubscribable resources
> I0407 22:34:10.918529 29301 slave.cpp:4970] Received oversubscribable
> resources from the resource estimator
> I0407 22:34:10.918908 29304 slave.cpp:939] New master detected at
> master@172.17.0.3:35855
> I0407 22:34:10.918988 29304 slave.cpp:1002] Authenticating with master
> master@172.17.0.3:35855
> I0407 22:34:10.919098 29301 status_update_manager.cpp:174] Pausing sending
> status updates
> I0407 22:34:10.919309 29304 slave.cpp:1007] Using default CRAM-MD5
> authenticatee
> I0407 22:34:10.919535 29304 slave.cpp:975] Detecting new master
> I0407 22:34:10.919747 29308 authenticatee.cpp:121] Creating new client SASL
> connection
> I0407 22:34:10.920413 29308 master.cpp:5695] Authenticating
> slave(111)@172.17.0.3:35855
> I0407 22:34:10.920650 29308 authenticator.cpp:413] Starting authentication
> session for crammd5_authenticatee(278)@172.17.0.3:35855
> I0407 22:34:10.921020 29308 authenticator.cpp:98] Creating new server SASL
> connection
> I0407 22:34:10.921308 29308 authenticatee.cpp:212] Received SASL
> authentication mechanisms: CRAM-MD5
> I0407 22:34:10.921424 29308 authenticatee.cpp:238] Attempting to authenticate
> with mechanism 'CRAM-MD5'
> I0407 22:34:10.921596 29308 authenticator.cpp:203] Received SASL
> authentication start
> I0407 22:34:10.921752 29308 authenticator.cpp:325] Authentication requires
> more steps
> I0407 22:34:10.921957 29307 authenticatee.cpp:258] Received SASL
> authentication step
> I0407 22:34:10.922178 29308 authenticator.cpp:231] Received SASL
> authentication step
> I0407 22:34:10.922214 29308 auxprop.cpp:107] Request to lookup properties for
> user: 'test-principal' realm: '129e11060069' server FQDN: '129e11060069'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: false
> I0407 22:34:10.922229 29308 auxprop.cpp:179] Looking up auxiliary property
> '*userPassword'
> I0407 22:34:10.922281 29308 auxprop.cpp:179] Looking up auxiliary property
> '*cmusaslsecretCRAM-MD5'
> I0407 22:34:10.922309 29308 auxprop.cpp:107] Request to lookup properties for
> user: 'test-principal' realm: '129e11060069' server FQDN: '129e11060069'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: true
> I0407 22:34:10.922322 29308 auxprop.cpp:129] Skipping auxiliary property
> '*userPassword' since SASL_AUXPROP_AUTHZID == true
> I0407 22:34:10.922332 29308 auxprop.cpp:129] Skipping auxiliary property
> '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
> I0407 22:34:10.922353 29308 authenticator.cpp:317] Authentication success
> I0407 22:34:10.922436 29307 authenticatee.cpp:298] Authentication success
> I0407 22:34:10.922587 29308 master.cpp:5725] Successfully authenticated
> principal 'test-principal' at slave(111)@172.17.0.3:35855
> I0407 22:34:10.922668 29299 authenticator.cpp:431] Authentication session
> cleanup for crammd5_authenticatee(278)@172.17.0.3:35855
> I0407 22:34:10.923256 29307 slave.cpp:1072] Successfully authenticated with
> master master@172.17.0.3:35855
> I0407 22:34:10.923429 29307 slave.cpp:1468] Will retry registration in
> 3.220345ms if necessary
> I0407 22:34:10.923707 29302 master.cpp:4406] Registering agent at
> slave(111)@172.17.0.3:35855 (129e11060069) with id
> f59f9057-a5c7-43e1-b129-96862e640a12-S0
> I0407 22:34:10.924239 29309 registrar.cpp:463] Applied 1 operations in
> 105794ns; attempting to update the 'registry'
> I0407 22:34:10.925787 29309 log.cpp:683] Attempting to append 339 bytes to
> the log
> I0407 22:34:10.926028 29309 coordinator.cpp:348] Coordinator attempting to
> write APPEND action at position 3
> I0407 22:34:10.927139 29309 replica.cpp:537] Replica received write request
> for position 3 from (4797)@172.17.0.3:35855
> I0407 22:34:10.929083 29305 slave.cpp:1468] Will retry registration in
> 39.293556ms if necessary
> I0407 22:34:10.929363 29305 master.cpp:4394] Ignoring register agent message
> from slave(111)@172.17.0.3:35855 (129e11060069) as admission is already in
> progress
> I0407 22:34:10.968843 29309 leveldb.cpp:341] Persisting action (358 bytes) to
> leveldb took 41.68025ms
> I0407 22:34:10.969005 29309 replica.cpp:712] Persisted action at 3
> I0407 22:34:10.969741 29309 slave.cpp:1468] Will retry registration in
> 54.852242ms if necessary
> I0407 22:34:10.970118 29309 master.cpp:4394] Ignoring register agent message
> from slave(111)@172.17.0.3:35855 (129e11060069) as admission is already in
> progress
> I0407 22:34:10.970852 29306 replica.cpp:691] Replica received learned notice
> for position 3 from @0.0.0.0:0
> I0407 22:34:11.010634 29306 leveldb.cpp:341] Persisting action (360 bytes) to
> leveldb took 39.680272ms
> I0407 22:34:11.010840 29306 replica.cpp:712] Persisted action at 3
> I0407 22:34:11.011014 29306 replica.cpp:697] Replica learned APPEND action at
> position 3
> I0407 22:34:11.014020 29306 registrar.cpp:508] Successfully updated the
> 'registry' in 89.684224ms
> I0407 22:34:11.014181 29296 log.cpp:702] Attempting to truncate the log to 3
> I0407 22:34:11.014606 29296 coordinator.cpp:348] Coordinator attempting to
> write TRUNCATE action at position 4
> I0407 22:34:11.015836 29298 replica.cpp:537] Replica received write request
> for position 4 from (4798)@172.17.0.3:35855
> I0407 22:34:11.016973 29296 master.cpp:4474] Registered agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S0 at slave(111)@172.17.0.3:35855
> (129e11060069) with cpus(*):2; mem(*):1024; disk(*):4096;
> ports(*):[31000-32000]
> I0407 22:34:11.017518 29304 hierarchical.cpp:476] Added agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S0 (129e11060069) with cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000] (allocated: )
> I0407 22:34:11.017763 29311 slave.cpp:1116] Registered with master
> master@172.17.0.3:35855; given agent ID
> f59f9057-a5c7-43e1-b129-96862e640a12-S0
> I0407 22:34:11.018362 29311 fetcher.cpp:81] Clearing fetcher cache
> I0407 22:34:11.018870 29311 slave.cpp:1139] Checkpointing SlaveInfo to
> '/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_9aCAYa/meta/slaves/f59f9057-a5c7-43e1-b129-96862e640a12-S0/slave.info'
> I0407 22:34:11.018890 29307 status_update_manager.cpp:181] Resuming sending
> status updates
> I0407 22:34:11.019182 29304 hierarchical.cpp:1491] No resources available to
> allocate!
> I0407 22:34:11.019304 29304 hierarchical.cpp:1165] Performed allocation for
> agent f59f9057-a5c7-43e1-b129-96862e640a12-S0 in 1.077349ms
> I0407 22:34:11.019493 29311 slave.cpp:1176] Forwarding total oversubscribed
> resources
> I0407 22:34:11.019726 29311 slave.cpp:3675] Received ping from
> slave-observer(112)@172.17.0.3:35855
> I0407 22:34:11.019878 29299 master.cpp:4818] Received update of agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S0 at slave(111)@172.17.0.3:35855
> (129e11060069) with total oversubscribed resources
> I0407 22:34:11.020845 29305 hierarchical.cpp:534] Agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S0 (129e11060069) updated with
> oversubscribed resources (total: cpus(*):2; mem(*):1024; disk(*):4096;
> ports(*):[31000-32000], allocated: )
> I0407 22:34:11.021005 29305 hierarchical.cpp:1491] No resources available to
> allocate!
> I0407 22:34:11.021065 29305 hierarchical.cpp:1165] Performed allocation for
> agent f59f9057-a5c7-43e1-b129-96862e640a12-S0 in 173907ns
> I0407 22:34:11.022289 29278 containerizer.cpp:155] Using isolation:
> posix/cpu,posix/mem,filesystem/posix
> W0407 22:34:11.023422 29278 backend.cpp:66] Failed to create 'bind' backend:
> BindBackend requires root privileges
> I0407 22:34:11.026309 29309 slave.cpp:201] Agent started on
> 112)@172.17.0.3:35855
> I0407 22:34:11.026410 29309 slave.cpp:202] Flags at startup:
> --appc_simple_discovery_uri_prefix="http://";
> --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http="true"
> --authenticatee="crammd5" --cgroups_cpu_enable_pids_and_tids_count="false"
> --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup"
> --cgroups_limit_swap="false" --cgroups_root="mesos"
> --container_disk_watch_interval="15secs" --containerizers="mesos"
> --credential="/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_h8KW9O/credential"
> --default_role="*" --disk_watch_interval="1mins" --docker="docker"
> --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io";
> --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock"
> --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker"
> --enforce_container_disk_quota="false"
> --executor_registration_timeout="1mins"
> --executor_shutdown_grace_period="5secs"
> --fetcher_cache_dir="/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_h8KW9O/fetch"
> --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
> --gc_disk_headroom="0.1" --hadoop_home="" --help="false"
> --hostname_lookup="true" --http_authenticators="basic"
> --http_credentials="/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_h8KW9O/http_credentials"
> --image_provisioner_backend="copy" --initialize_driver_logging="true"
> --isolation="posix/cpu,posix/mem"
> --launcher_dir="/mesos/mesos-0.29.0/_build/src" --logbufsecs="0"
> --logging_level="INFO" --oversubscribed_resources_interval="15secs"
> --perf_duration="10secs" --perf_interval="1mins"
> --qos_correction_interval_min="0ns" --quiet="false" --recover="reconnect"
> --recovery_timeout="15mins" --registration_backoff_factor="10ms"
> --resources="cpus:2;mem:1024;disk:4096;ports:[31000-32000]"
> --revocable_cpu_low_priority="true" --sandbox_directory="/mnt/mesos/sandbox"
> --strict="true" --switch_user="true" --systemd_enable_support="true"
> --systemd_runtime_directory="/run/systemd/system" --version="false"
> --work_dir="/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_h8KW9O"
> I0407 22:34:11.027070 29309 credentials.hpp:86] Loading credential for
> authentication from
> '/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_h8KW9O/credential'
> I0407 22:34:11.027308 29309 slave.cpp:339] Agent using credential for:
> test-principal
> I0407 22:34:11.027354 29309 credentials.hpp:37] Loading credentials for
> authentication from
> '/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_h8KW9O/http_credentials'
> I0407 22:34:11.027698 29309 slave.cpp:391] Using default 'basic' HTTP
> authenticator
> I0407 22:34:11.028147 29309 resources.cpp:572] Parsing resources as JSON
> failed: cpus:2;mem:1024;disk:4096;ports:[31000-32000]
> Trying semicolon-delimited string format instead
> I0407 22:34:11.028854 29309 slave.cpp:590] Agent resources: cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000]
> I0407 22:34:11.028998 29309 slave.cpp:598] Agent attributes: [ ]
> I0407 22:34:11.029064 29309 slave.cpp:603] Agent hostname: 129e11060069
> I0407 22:34:11.031188 29309 state.cpp:57] Recovering state from
> '/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_h8KW9O/meta'
> I0407 22:34:11.031844 29300 status_update_manager.cpp:200] Recovering status
> update manager
> I0407 22:34:11.032091 29300 containerizer.cpp:416] Recovering containerizer
> I0407 22:34:11.033805 29300 provisioner.cpp:245] Provisioner recovery complete
> I0407 22:34:11.034364 29300 slave.cpp:4784] Finished recovery
> I0407 22:34:11.061807 29300 slave.cpp:4956] Querying resource estimator for
> oversubscribable resources
> I0407 22:34:11.062371 29300 slave.cpp:939] New master detected at
> master@172.17.0.3:35855
> I0407 22:34:11.062450 29300 slave.cpp:1002] Authenticating with master
> master@172.17.0.3:35855
> I0407 22:34:11.062469 29300 slave.cpp:1007] Using default CRAM-MD5
> authenticatee
> I0407 22:34:11.062630 29300 slave.cpp:975] Detecting new master
> I0407 22:34:11.062737 29300 slave.cpp:4970] Received oversubscribable
> resources from the resource estimator
> I0407 22:34:11.062820 29300 status_update_manager.cpp:174] Pausing sending
> status updates
> I0407 22:34:11.062952 29300 authenticatee.cpp:121] Creating new client SASL
> connection
> I0407 22:34:11.063413 29300 master.cpp:5695] Authenticating
> slave(112)@172.17.0.3:35855
> I0407 22:34:11.063591 29300 authenticator.cpp:413] Starting authentication
> session for crammd5_authenticatee(279)@172.17.0.3:35855
> I0407 22:34:11.063907 29300 authenticator.cpp:98] Creating new server SASL
> connection
> I0407 22:34:11.064159 29300 authenticatee.cpp:212] Received SASL
> authentication mechanisms: CRAM-MD5
> I0407 22:34:11.064201 29300 authenticatee.cpp:238] Attempting to authenticate
> with mechanism 'CRAM-MD5'
> I0407 22:34:11.064296 29300 authenticator.cpp:203] Received SASL
> authentication start
> I0407 22:34:11.064363 29300 authenticator.cpp:325] Authentication requires
> more steps
> I0407 22:34:11.064443 29300 authenticatee.cpp:258] Received SASL
> authentication step
> I0407 22:34:11.064537 29300 authenticator.cpp:231] Received SASL
> authentication step
> I0407 22:34:11.064569 29300 auxprop.cpp:107] Request to lookup properties for
> user: 'test-principal' realm: '129e11060069' server FQDN: '129e11060069'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: false
> I0407 22:34:11.064584 29300 auxprop.cpp:179] Looking up auxiliary property
> '*userPassword'
> I0407 22:34:11.064640 29300 auxprop.cpp:179] Looking up auxiliary property
> '*cmusaslsecretCRAM-MD5'
> I0407 22:34:11.064668 29300 auxprop.cpp:107] Request to lookup properties for
> user: 'test-principal' realm: '129e11060069' server FQDN: '129e11060069'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: true
> I0407 22:34:11.064680 29300 auxprop.cpp:129] Skipping auxiliary property
> '*userPassword' since SASL_AUXPROP_AUTHZID == true
> I0407 22:34:11.064689 29300 auxprop.cpp:129] Skipping auxiliary property
> '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
> I0407 22:34:11.064708 29300 authenticator.cpp:317] Authentication success
> I0407 22:34:11.064856 29300 authenticatee.cpp:298] Authentication success
> I0407 22:34:11.064941 29300 master.cpp:5725] Successfully authenticated
> principal 'test-principal' at slave(112)@172.17.0.3:35855
> I0407 22:34:11.065019 29300 authenticator.cpp:431] Authentication session
> cleanup for crammd5_authenticatee(279)@172.17.0.3:35855
> I0407 22:34:11.065431 29305 slave.cpp:1072] Successfully authenticated with
> master master@172.17.0.3:35855
> I0407 22:34:11.065580 29305 slave.cpp:1468] Will retry registration in
> 14.268351ms if necessary
> I0407 22:34:11.065948 29305 master.cpp:4406] Registering agent at
> slave(112)@172.17.0.3:35855 (129e11060069) with id
> f59f9057-a5c7-43e1-b129-96862e640a12-S1
> I0407 22:34:11.066653 29296 registrar.cpp:463] Applied 1 operations in
> 190813ns; attempting to update the 'registry'
> I0407 22:34:11.075197 29298 leveldb.cpp:341] Persisting action (16 bytes) to
> leveldb took 59.338116ms
> I0407 22:34:11.075359 29298 replica.cpp:712] Persisted action at 4
> I0407 22:34:11.076177 29301 replica.cpp:691] Replica received learned notice
> for position 4 from @0.0.0.0:0
> I0407 22:34:11.080481 29309 slave.cpp:1468] Will retry registration in
> 23.018984ms if necessary
> I0407 22:34:11.080770 29309 master.cpp:4394] Ignoring register agent message
> from slave(112)@172.17.0.3:35855 (129e11060069) as admission is already in
> progress
> I0407 22:34:11.100519 29301 leveldb.cpp:341] Persisting action (18 bytes) to
> leveldb took 24.288152ms
> I0407 22:34:11.100792 29301 leveldb.cpp:399] Deleting ~2 keys from leveldb
> took 98264ns
> I0407 22:34:11.100883 29301 replica.cpp:712] Persisted action at 4
> I0407 22:34:11.101002 29301 replica.cpp:697] Replica learned TRUNCATE action
> at position 4
> I0407 22:34:11.102180 29309 log.cpp:683] Attempting to append 505 bytes to
> the log
> I0407 22:34:11.102334 29301 coordinator.cpp:348] Coordinator attempting to
> write APPEND action at position 5
> I0407 22:34:11.103551 29309 replica.cpp:537] Replica received write request
> for position 5 from (4813)@172.17.0.3:35855
> I0407 22:34:11.105705 29305 slave.cpp:1468] Will retry registration in
> 49.972787ms if necessary
> I0407 22:34:11.106020 29305 master.cpp:4394] Ignoring register agent message
> from slave(112)@172.17.0.3:35855 (129e11060069) as admission is already in
> progress
> I0407 22:34:11.126212 29309 leveldb.cpp:341] Persisting action (524 bytes) to
> leveldb took 22.638848ms
> I0407 22:34:11.126296 29309 replica.cpp:712] Persisted action at 5
> I0407 22:34:11.127374 29305 replica.cpp:691] Replica received learned notice
> for position 5 from @0.0.0.0:0
> I0407 22:34:11.150754 29305 leveldb.cpp:341] Persisting action (526 bytes) to
> leveldb took 23.376079ms
> I0407 22:34:11.150952 29305 replica.cpp:712] Persisted action at 5
> I0407 22:34:11.150992 29305 replica.cpp:697] Replica learned APPEND action at
> position 5
> I0407 22:34:11.154031 29305 registrar.cpp:508] Successfully updated the
> 'registry' in 87.26784ms
> I0407 22:34:11.154491 29305 log.cpp:702] Attempting to truncate the log to 5
> I0407 22:34:11.154824 29305 coordinator.cpp:348] Coordinator attempting to
> write TRUNCATE action at position 6
> I0407 22:34:11.155413 29308 slave.cpp:3675] Received ping from
> slave-observer(113)@172.17.0.3:35855
> I0407 22:34:11.155467 29303 master.cpp:4474] Registered agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S1 at slave(112)@172.17.0.3:35855
> (129e11060069) with cpus(*):2; mem(*):1024; disk(*):4096;
> ports(*):[31000-32000]
> I0407 22:34:11.155580 29308 slave.cpp:1116] Registered with master
> master@172.17.0.3:35855; given agent ID
> f59f9057-a5c7-43e1-b129-96862e640a12-S1
> I0407 22:34:11.155606 29308 fetcher.cpp:81] Clearing fetcher cache
> I0407 22:34:11.155856 29304 status_update_manager.cpp:181] Resuming sending
> status updates
> I0407 22:34:11.156281 29308 slave.cpp:1139] Checkpointing SlaveInfo to
> '/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_h8KW9O/meta/slaves/f59f9057-a5c7-43e1-b129-96862e640a12-S1/slave.info'
> I0407 22:34:11.156661 29304 replica.cpp:537] Replica received write request
> for position 6 from (4814)@172.17.0.3:35855
> I0407 22:34:11.156949 29305 hierarchical.cpp:476] Added agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S1 (129e11060069) with cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000] (allocated: )
> I0407 22:34:11.157217 29305 hierarchical.cpp:1491] No resources available to
> allocate!
> I0407 22:34:11.157346 29305 hierarchical.cpp:1165] Performed allocation for
> agent f59f9057-a5c7-43e1-b129-96862e640a12-S1 in 304432ns
> I0407 22:34:11.157224 29308 slave.cpp:1176] Forwarding total oversubscribed
> resources
> I0407 22:34:11.157788 29303 master.cpp:4818] Received update of agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S1 at slave(112)@172.17.0.3:35855
> (129e11060069) with total oversubscribed resources
> I0407 22:34:11.158424 29303 hierarchical.cpp:534] Agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S1 (129e11060069) updated with
> oversubscribed resources (total: cpus(*):2; mem(*):1024; disk(*):4096;
> ports(*):[31000-32000], allocated: )
> I0407 22:34:11.158633 29303 hierarchical.cpp:1491] No resources available to
> allocate!
> I0407 22:34:11.158699 29303 hierarchical.cpp:1165] Performed allocation for
> agent f59f9057-a5c7-43e1-b129-96862e640a12-S1 in 178482ns
> I0407 22:34:11.162139 29278 containerizer.cpp:155] Using isolation:
> posix/cpu,posix/mem,filesystem/posix
> W0407 22:34:11.192978 29278 backend.cpp:66] Failed to create 'bind' backend:
> BindBackend requires root privileges
> I0407 22:34:11.197527 29307 slave.cpp:201] Agent started on
> 113)@172.17.0.3:35855
> I0407 22:34:11.197581 29307 slave.cpp:202] Flags at startup:
> --appc_simple_discovery_uri_prefix="http://";
> --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http="true"
> --authenticatee="crammd5" --cgroups_cpu_enable_pids_and_tids_count="false"
> --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup"
> --cgroups_limit_swap="false" --cgroups_root="mesos"
> --container_disk_watch_interval="15secs" --containerizers="mesos"
> --credential="/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_EG5sru/credential"
> --default_role="*" --disk_watch_interval="1mins" --docker="docker"
> --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io";
> --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock"
> --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker"
> --enforce_container_disk_quota="false"
> --executor_registration_timeout="1mins"
> --executor_shutdown_grace_period="5secs"
> --fetcher_cache_dir="/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_EG5sru/fetch"
> --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
> --gc_disk_headroom="0.1" --hadoop_home="" --help="false"
> --hostname_lookup="true" --http_authenticators="basic"
> --http_credentials="/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_EG5sru/http_credentials"
> --image_provisioner_backend="copy" --initialize_driver_logging="true"
> --isolation="posix/cpu,posix/mem"
> --launcher_dir="/mesos/mesos-0.29.0/_build/src" --logbufsecs="0"
> --logging_level="INFO" --oversubscribed_resources_interval="15secs"
> --perf_duration="10secs" --perf_interval="1mins"
> --qos_correction_interval_min="0ns" --quiet="false" --recover="reconnect"
> --recovery_timeout="15mins" --registration_backoff_factor="10ms"
> --resources="cpus:2;mem:1024;disk:4096;ports:[31000-32000]"
> --revocable_cpu_low_priority="true" --sandbox_directory="/mnt/mesos/sandbox"
> --strict="true" --switch_user="true" --systemd_enable_support="true"
> --systemd_runtime_directory="/run/systemd/system" --version="false"
> --work_dir="/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_EG5sru"
> I0407 22:34:11.198328 29307 credentials.hpp:86] Loading credential for
> authentication from
> '/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_EG5sru/credential'
> I0407 22:34:11.198562 29307 slave.cpp:339] Agent using credential for:
> test-principal
> I0407 22:34:11.198598 29307 credentials.hpp:37] Loading credentials for
> authentication from
> '/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_EG5sru/http_credentials'
> I0407 22:34:11.198884 29307 slave.cpp:391] Using default 'basic' HTTP
> authenticator
> I0407 22:34:11.199286 29307 resources.cpp:572] Parsing resources as JSON
> failed: cpus:2;mem:1024;disk:4096;ports:[31000-32000]
> Trying semicolon-delimited string format instead
> I0407 22:34:11.199820 29307 slave.cpp:590] Agent resources: cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000]
> I0407 22:34:11.199905 29307 slave.cpp:598] Agent attributes: [ ]
> I0407 22:34:11.199920 29307 slave.cpp:603] Agent hostname: 129e11060069
> I0407 22:34:11.201535 29297 state.cpp:57] Recovering state from
> '/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_EG5sru/meta'
> I0407 22:34:11.201773 29309 status_update_manager.cpp:200] Recovering status
> update manager
> I0407 22:34:11.202081 29307 containerizer.cpp:416] Recovering containerizer
> I0407 22:34:11.202180 29304 leveldb.cpp:341] Persisting action (16 bytes) to
> leveldb took 45.487899ms
> I0407 22:34:11.202221 29304 replica.cpp:712] Persisted action at 6
> I0407 22:34:11.203219 29302 replica.cpp:691] Replica received learned notice
> for position 6 from @0.0.0.0:0
> I0407 22:34:11.205412 29301 provisioner.cpp:245] Provisioner recovery complete
> I0407 22:34:11.205984 29301 slave.cpp:4784] Finished recovery
> I0407 22:34:11.206735 29301 slave.cpp:4956] Querying resource estimator for
> oversubscribable resources
> I0407 22:34:11.207351 29301 slave.cpp:4970] Received oversubscribable
> resources from the resource estimator
> I0407 22:34:11.207679 29301 slave.cpp:939] New master detected at
> master@172.17.0.3:35855
> I0407 22:34:11.207804 29309 status_update_manager.cpp:174] Pausing sending
> status updates
> I0407 22:34:11.208039 29301 slave.cpp:1002] Authenticating with master
> master@172.17.0.3:35855
> I0407 22:34:11.208072 29301 slave.cpp:1007] Using default CRAM-MD5
> authenticatee
> I0407 22:34:11.208431 29301 slave.cpp:975] Detecting new master
> I0407 22:34:11.208650 29309 authenticatee.cpp:121] Creating new client SASL
> connection
> I0407 22:34:11.208976 29309 master.cpp:5695] Authenticating
> slave(113)@172.17.0.3:35855
> I0407 22:34:11.209081 29307 authenticator.cpp:413] Starting authentication
> session for crammd5_authenticatee(280)@172.17.0.3:35855
> I0407 22:34:11.209432 29304 authenticator.cpp:98] Creating new server SASL
> connection
> I0407 22:34:11.209971 29304 authenticatee.cpp:212] Received SASL
> authentication mechanisms: CRAM-MD5
> I0407 22:34:11.210103 29304 authenticatee.cpp:238] Attempting to authenticate
> with mechanism 'CRAM-MD5'
> I0407 22:34:11.210382 29304 authenticator.cpp:203] Received SASL
> authentication start
> I0407 22:34:11.210515 29304 authenticator.cpp:325] Authentication requires
> more steps
> I0407 22:34:11.210726 29304 authenticatee.cpp:258] Received SASL
> authentication step
> I0407 22:34:11.210940 29305 authenticator.cpp:231] Received SASL
> authentication step
> I0407 22:34:11.210980 29305 auxprop.cpp:107] Request to lookup properties for
> user: 'test-principal' realm: '129e11060069' server FQDN: '129e11060069'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: false
> I0407 22:34:11.210997 29305 auxprop.cpp:179] Looking up auxiliary property
> '*userPassword'
> I0407 22:34:11.211060 29305 auxprop.cpp:179] Looking up auxiliary property
> '*cmusaslsecretCRAM-MD5'
> I0407 22:34:11.211100 29305 auxprop.cpp:107] Request to lookup properties for
> user: 'test-principal' realm: '129e11060069' server FQDN: '129e11060069'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: true
> I0407 22:34:11.211175 29305 auxprop.cpp:129] Skipping auxiliary property
> '*userPassword' since SASL_AUXPROP_AUTHZID == true
> I0407 22:34:11.211244 29305 auxprop.cpp:129] Skipping auxiliary property
> '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
> I0407 22:34:11.211272 29305 authenticator.cpp:317] Authentication success
> I0407 22:34:11.211462 29305 authenticatee.cpp:298] Authentication success
> I0407 22:34:11.211575 29305 master.cpp:5725] Successfully authenticated
> principal 'test-principal' at slave(113)@172.17.0.3:35855
> I0407 22:34:11.211673 29305 authenticator.cpp:431] Authentication session
> cleanup for crammd5_authenticatee(280)@172.17.0.3:35855
> I0407 22:34:11.212026 29305 slave.cpp:1072] Successfully authenticated with
> master master@172.17.0.3:35855
> I0407 22:34:11.212280 29305 slave.cpp:1468] Will retry registration in
> 6.415977ms if necessary
> I0407 22:34:11.212704 29304 master.cpp:4406] Registering agent at
> slave(113)@172.17.0.3:35855 (129e11060069) with id
> f59f9057-a5c7-43e1-b129-96862e640a12-S2
> I0407 22:34:11.213373 29311 registrar.cpp:463] Applied 1 operations in
> 154555ns; attempting to update the 'registry'
> I0407 22:34:11.223568 29303 master.cpp:4394] Ignoring register agent message
> from slave(113)@172.17.0.3:35855 (129e11060069) as admission is already in
> progress
> I0407 22:34:11.224171 29300 slave.cpp:1468] Will retry registration in
> 22.418267ms if necessary
> I0407 22:34:11.243433 29302 leveldb.cpp:341] Persisting action (18 bytes) to
> leveldb took 40.20863ms
> I0407 22:34:11.243851 29302 leveldb.cpp:399] Deleting ~2 keys from leveldb
> took 204965ns
> I0407 22:34:11.243980 29302 replica.cpp:712] Persisted action at 6
> I0407 22:34:11.244148 29302 replica.cpp:697] Replica learned TRUNCATE action
> at position 6
> I0407 22:34:11.245827 29302 log.cpp:683] Attempting to append 671 bytes to
> the log
> I0407 22:34:11.246206 29310 coordinator.cpp:348] Coordinator attempting to
> write APPEND action at position 7
> I0407 22:34:11.247114 29296 replica.cpp:537] Replica received write request
> for position 7 from (4829)@172.17.0.3:35855
> I0407 22:34:11.248457 29304 slave.cpp:1468] Will retry registration in
> 14.981599ms if necessary
> I0407 22:34:11.248837 29302 master.cpp:4394] Ignoring register agent message
> from slave(113)@172.17.0.3:35855 (129e11060069) as admission is already in
> progress
> I0407 22:34:11.265728 29301 slave.cpp:1468] Will retry registration in
> 117.285894ms if necessary
> I0407 22:34:11.266026 29301 master.cpp:4394] Ignoring register agent message
> from slave(113)@172.17.0.3:35855 (129e11060069) as admission is already in
> progress
> I0407 22:34:11.278012 29296 leveldb.cpp:341] Persisting action (690 bytes) to
> leveldb took 30.789344ms
> I0407 22:34:11.278064 29296 replica.cpp:712] Persisted action at 7
> I0407 22:34:11.278990 29303 replica.cpp:691] Replica received learned notice
> for position 7 from @0.0.0.0:0
> I0407 22:34:11.337220 29303 leveldb.cpp:341] Persisting action (692 bytes) to
> leveldb took 58.231676ms
> I0407 22:34:11.337312 29303 replica.cpp:712] Persisted action at 7
> I0407 22:34:11.337347 29303 replica.cpp:697] Replica learned APPEND action at
> position 7
> I0407 22:34:11.340283 29305 registrar.cpp:508] Successfully updated the
> 'registry' in 126.71616ms
> I0407 22:34:11.340703 29309 log.cpp:702] Attempting to truncate the log to 7
> I0407 22:34:11.341044 29309 coordinator.cpp:348] Coordinator attempting to
> write TRUNCATE action at position 8
> I0407 22:34:11.341847 29309 slave.cpp:3675] Received ping from
> slave-observer(114)@172.17.0.3:35855
> I0407 22:34:11.342489 29309 slave.cpp:1116] Registered with master
> master@172.17.0.3:35855; given agent ID
> f59f9057-a5c7-43e1-b129-96862e640a12-S2
> I0407 22:34:11.342532 29309 fetcher.cpp:81] Clearing fetcher cache
> I0407 22:34:11.341804 29303 master.cpp:4474] Registered agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S2 at slave(113)@172.17.0.3:35855
> (129e11060069) with cpus(*):2; mem(*):1024; disk(*):4096;
> ports(*):[31000-32000]
> I0407 22:34:11.342871 29297 status_update_manager.cpp:181] Resuming sending
> status updates
> I0407 22:34:11.342267 29300 hierarchical.cpp:476] Added agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S2 (129e11060069) with cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000] (allocated: )
> I0407 22:34:11.342963 29299 replica.cpp:537] Replica received write request
> for position 8 from (4830)@172.17.0.3:35855
> I0407 22:34:11.343101 29300 hierarchical.cpp:1491] No resources available to
> allocate!
> I0407 22:34:11.343178 29300 hierarchical.cpp:1165] Performed allocation for
> agent f59f9057-a5c7-43e1-b129-96862e640a12-S2 in 242921ns
> I0407 22:34:11.342921 29309 slave.cpp:1139] Checkpointing SlaveInfo to
> '/tmp/MasterAllocatorTest_1_RebalancedForUpdatedWeights_EG5sru/meta/slaves/f59f9057-a5c7-43e1-b129-96862e640a12-S2/slave.info'
> I0407 22:34:11.343636 29309 slave.cpp:1176] Forwarding total oversubscribed
> resources
> I0407 22:34:11.343863 29309 master.cpp:4818] Received update of agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S2 at slave(113)@172.17.0.3:35855
> (129e11060069) with total oversubscribed resources
> I0407 22:34:11.344173 29278 sched.cpp:224] Version: 0.29.0
> I0407 22:34:11.344425 29309 hierarchical.cpp:534] Agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S2 (129e11060069) updated with
> oversubscribed resources (total: cpus(*):2; mem(*):1024; disk(*):4096;
> ports(*):[31000-32000], allocated: )
> I0407 22:34:11.344568 29309 hierarchical.cpp:1491] No resources available to
> allocate!
> I0407 22:34:11.344621 29309 hierarchical.cpp:1165] Performed allocation for
> agent f59f9057-a5c7-43e1-b129-96862e640a12-S2 in 155620ns
> I0407 22:34:11.345155 29303 sched.cpp:328] New master detected at
> master@172.17.0.3:35855
> I0407 22:34:11.345387 29303 sched.cpp:384] Authenticating with master
> master@172.17.0.3:35855
> I0407 22:34:11.345479 29303 sched.cpp:391] Using default CRAM-MD5
> authenticatee
> I0407 22:34:11.346035 29303 authenticatee.cpp:121] Creating new client SASL
> connection
> I0407 22:34:11.346884 29303 master.cpp:5695] Authenticating
> scheduler-72944dc9-e3cc-4ebc-bca6-d72c77ad6721@172.17.0.3:35855
> I0407 22:34:11.347530 29303 authenticator.cpp:413] Starting authentication
> session for crammd5_authenticatee(281)@172.17.0.3:35855
> I0407 22:34:11.349140 29303 authenticator.cpp:98] Creating new server SASL
> connection
> I0407 22:34:11.349580 29303 authenticatee.cpp:212] Received SASL
> authentication mechanisms: CRAM-MD5
> I0407 22:34:11.349707 29303 authenticatee.cpp:238] Attempting to authenticate
> with mechanism 'CRAM-MD5'
> I0407 22:34:11.349957 29309 authenticator.cpp:203] Received SASL
> authentication start
> I0407 22:34:11.350040 29309 authenticator.cpp:325] Authentication requires
> more steps
> I0407 22:34:11.350168 29309 authenticatee.cpp:258] Received SASL
> authentication step
> I0407 22:34:11.350275 29309 authenticator.cpp:231] Received SASL
> authentication step
> I0407 22:34:11.350309 29309 auxprop.cpp:107] Request to lookup properties for
> user: 'test-principal' realm: '129e11060069' server FQDN: '129e11060069'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: false
> I0407 22:34:11.350323 29309 auxprop.cpp:179] Looking up auxiliary property
> '*userPassword'
> I0407 22:34:11.350375 29309 auxprop.cpp:179] Looking up auxiliary property
> '*cmusaslsecretCRAM-MD5'
> I0407 22:34:11.350407 29309 auxprop.cpp:107] Request to lookup properties for
> user: 'test-principal' realm: '129e11060069' server FQDN: '129e11060069'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: true
> I0407 22:34:11.350420 29309 auxprop.cpp:129] Skipping auxiliary property
> '*userPassword' since SASL_AUXPROP_AUTHZID == true
> I0407 22:34:11.350430 29309 auxprop.cpp:129] Skipping auxiliary property
> '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
> I0407 22:34:11.350450 29309 authenticator.cpp:317] Authentication success
> I0407 22:34:11.350550 29303 authenticatee.cpp:298] Authentication success
> I0407 22:34:11.350647 29309 master.cpp:5725] Successfully authenticated
> principal 'test-principal' at
> scheduler-72944dc9-e3cc-4ebc-bca6-d72c77ad6721@172.17.0.3:35855
> I0407 22:34:11.350803 29303 authenticator.cpp:431] Authentication session
> cleanup for crammd5_authenticatee(281)@172.17.0.3:35855
> I0407 22:34:11.350986 29309 sched.cpp:474] Successfully authenticated with
> master master@172.17.0.3:35855
> I0407 22:34:11.351011 29309 sched.cpp:779] Sending SUBSCRIBE call to
> master@172.17.0.3:35855
> I0407 22:34:11.351109 29309 sched.cpp:812] Will retry registration in
> 82.651114ms if necessary
> I0407 22:34:11.351313 29296 master.cpp:2362] Received SUBSCRIBE call for
> framework 'default' at
> scheduler-72944dc9-e3cc-4ebc-bca6-d72c77ad6721@172.17.0.3:35855
> I0407 22:34:11.351343 29296 master.cpp:1871] Authorizing framework principal
> 'test-principal' to receive offers for role 'role1'
> I0407 22:34:11.351662 29310 master.cpp:2433] Subscribing framework default
> with checkpointing disabled and capabilities [ ]
> I0407 22:34:11.352442 29311 hierarchical.cpp:267] Added framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000
> I0407 22:34:11.353435 29309 sched.cpp:706] Framework registered with
> f59f9057-a5c7-43e1-b129-96862e640a12-0000
> I0407 22:34:11.353519 29309 sched.cpp:720] Scheduler::registered took 66350ns
> I0407 22:34:11.355201 29311 hierarchical.cpp:1586] No inverse offers to send
> out!
> I0407 22:34:11.355293 29311 hierarchical.cpp:1142] Performed allocation for 3
> agents in 2.836617ms
> I0407 22:34:11.356238 29301 master.cpp:5524] Sending 3 offers to framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000 (default) at
> scheduler-72944dc9-e3cc-4ebc-bca6-d72c77ad6721@172.17.0.3:35855
> I0407 22:34:11.357260 29311 sched.cpp:876] Scheduler::resourceOffers took
> 327028ns
> I0407 22:34:11.357628 29278 resources.cpp:572] Parsing resources as JSON
> failed: cpus:2;mem:1024;disk:4096;ports:[31000-32000]
> Trying semicolon-delimited string format instead
> I0407 22:34:11.358330 29278 resources.cpp:572] Parsing resources as JSON
> failed: cpus:2;mem:1024;disk:4096;ports:[31000-32000]
> Trying semicolon-delimited string format instead
> I0407 22:34:11.358959 29278 resources.cpp:572] Parsing resources as JSON
> failed: cpus:2;mem:1024;disk:4096;ports:[31000-32000]
> Trying semicolon-delimited string format instead
> I0407 22:34:11.360607 29278 sched.cpp:224] Version: 0.29.0
> I0407 22:34:11.361264 29307 sched.cpp:328] New master detected at
> master@172.17.0.3:35855
> I0407 22:34:11.361342 29307 sched.cpp:384] Authenticating with master
> master@172.17.0.3:35855
> I0407 22:34:11.361366 29307 sched.cpp:391] Using default CRAM-MD5
> authenticatee
> I0407 22:34:11.361670 29307 authenticatee.cpp:121] Creating new client SASL
> connection
> I0407 22:34:11.361959 29307 master.cpp:5695] Authenticating
> scheduler-37080386-2aa8-4592-bf09-8288bd04727a@172.17.0.3:35855
> I0407 22:34:11.362195 29307 authenticator.cpp:413] Starting authentication
> session for crammd5_authenticatee(282)@172.17.0.3:35855
> I0407 22:34:11.362535 29311 authenticator.cpp:98] Creating new server SASL
> connection
> I0407 22:34:11.362890 29307 authenticatee.cpp:212] Received SASL
> authentication mechanisms: CRAM-MD5
> I0407 22:34:11.362926 29307 authenticatee.cpp:238] Attempting to authenticate
> with mechanism 'CRAM-MD5'
> I0407 22:34:11.363021 29307 authenticator.cpp:203] Received SASL
> authentication start
> I0407 22:34:11.363082 29307 authenticator.cpp:325] Authentication requires
> more steps
> I0407 22:34:11.363199 29311 authenticatee.cpp:258] Received SASL
> authentication step
> I0407 22:34:11.363313 29311 authenticator.cpp:231] Received SASL
> authentication step
> I0407 22:34:11.363406 29311 auxprop.cpp:107] Request to lookup properties for
> user: 'test-principal' realm: '129e11060069' server FQDN: '129e11060069'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: false
> I0407 22:34:11.363512 29311 auxprop.cpp:179] Looking up auxiliary property
> '*userPassword'
> I0407 22:34:11.363605 29311 auxprop.cpp:179] Looking up auxiliary property
> '*cmusaslsecretCRAM-MD5'
> I0407 22:34:11.363651 29311 auxprop.cpp:107] Request to lookup properties for
> user: 'test-principal' realm: '129e11060069' server FQDN: '129e11060069'
> SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
> SASL_AUXPROP_AUTHZID: true
> I0407 22:34:11.363673 29311 auxprop.cpp:129] Skipping auxiliary property
> '*userPassword' since SASL_AUXPROP_AUTHZID == true
> I0407 22:34:11.363685 29311 auxprop.cpp:129] Skipping auxiliary property
> '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
> I0407 22:34:11.363706 29311 authenticator.cpp:317] Authentication success
> I0407 22:34:11.363785 29307 authenticatee.cpp:298] Authentication success
> I0407 22:34:11.363858 29297 master.cpp:5725] Successfully authenticated
> principal 'test-principal' at
> scheduler-37080386-2aa8-4592-bf09-8288bd04727a@172.17.0.3:35855
> I0407 22:34:11.363903 29311 authenticator.cpp:431] Authentication session
> cleanup for crammd5_authenticatee(282)@172.17.0.3:35855
> I0407 22:34:11.365274 29297 sched.cpp:474] Successfully authenticated with
> master master@172.17.0.3:35855
> I0407 22:34:11.365301 29297 sched.cpp:779] Sending SUBSCRIBE call to
> master@172.17.0.3:35855
> I0407 22:34:11.365396 29297 sched.cpp:812] Will retry registration in
> 1.739883809secs if necessary
> I0407 22:34:11.365500 29311 master.cpp:2362] Received SUBSCRIBE call for
> framework 'default' at
> scheduler-37080386-2aa8-4592-bf09-8288bd04727a@172.17.0.3:35855
> I0407 22:34:11.365528 29311 master.cpp:1871] Authorizing framework principal
> 'test-principal' to receive offers for role 'role2'
> I0407 22:34:11.365952 29297 master.cpp:2433] Subscribing framework default
> with checkpointing disabled and capabilities [ ]
> I0407 22:34:11.366518 29297 sched.cpp:706] Framework registered with
> f59f9057-a5c7-43e1-b129-96862e640a12-0001
> I0407 22:34:11.366564 29311 hierarchical.cpp:267] Added framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001
> I0407 22:34:11.366590 29297 sched.cpp:720] Scheduler::registered took 57363ns
> I0407 22:34:11.366768 29311 hierarchical.cpp:1491] No resources available to
> allocate!
> I0407 22:34:11.366837 29311 hierarchical.cpp:1586] No inverse offers to send
> out!
> I0407 22:34:11.366914 29311 hierarchical.cpp:1142] Performed allocation for 3
> agents in 340908ns
> I0407 22:34:11.369886 29309 process.cpp:3165] Handling HTTP event for process
> 'master' with path: '/master/weights'
> I0407 22:34:11.370643 29309 http.cpp:313] HTTP PUT for /master/weights from
> 172.17.0.3:59397
> I0407 22:34:11.370762 29309 weights_handler.cpp:58] Updating weights from
> request: '[{"role":"role2","weight":2.0}]'
> I0407 22:34:11.370908 29309 weights_handler.cpp:198] Authorizing principal
> 'test-principal' to update weights for roles '[ role2 ]'
> I0407 22:34:11.372067 29306 registrar.cpp:463] Applied 1 operations in
> 136060ns; attempting to update the 'registry'
> I0407 22:34:11.388222 29299 leveldb.cpp:341] Persisting action (16 bytes) to
> leveldb took 45.245469ms
> I0407 22:34:11.388381 29299 replica.cpp:712] Persisted action at 8
> I0407 22:34:11.389389 29305 replica.cpp:691] Replica received learned notice
> for position 8 from @0.0.0.0:0
> I0407 22:34:11.435415 29305 leveldb.cpp:341] Persisting action (18 bytes) to
> leveldb took 45.918275ms
> I0407 22:34:11.435688 29305 leveldb.cpp:399] Deleting ~2 keys from leveldb
> took 98518ns
> I0407 22:34:11.435835 29305 replica.cpp:712] Persisted action at 8
> I0407 22:34:11.435956 29305 replica.cpp:697] Replica learned TRUNCATE action
> at position 8
> I0407 22:34:11.437063 29310 log.cpp:683] Attempting to append 691 bytes to
> the log
> I0407 22:34:11.437297 29300 coordinator.cpp:348] Coordinator attempting to
> write APPEND action at position 9
> I0407 22:34:11.437979 29300 replica.cpp:537] Replica received write request
> for position 9 from (4834)@172.17.0.3:35855
> I0407 22:34:11.479363 29300 leveldb.cpp:341] Persisting action (710 bytes) to
> leveldb took 41.36295ms
> I0407 22:34:11.479432 29300 replica.cpp:712] Persisted action at 9
> I0407 22:34:11.480434 29296 replica.cpp:691] Replica received learned notice
> for position 9 from @0.0.0.0:0
> I0407 22:34:11.521299 29296 leveldb.cpp:341] Persisting action (712 bytes) to
> leveldb took 40.855981ms
> I0407 22:34:11.521378 29296 replica.cpp:712] Persisted action at 9
> I0407 22:34:11.521412 29296 replica.cpp:697] Replica learned APPEND action at
> position 9
> I0407 22:34:11.524554 29304 registrar.cpp:508] Successfully updated the
> 'registry' in 152.402176ms
> I0407 22:34:11.524790 29298 log.cpp:702] Attempting to truncate the log to 9
> I0407 22:34:11.524960 29304 coordinator.cpp:348] Coordinator attempting to
> write TRUNCATE action at position 10
> I0407 22:34:11.525243 29298 hierarchical.cpp:1491] No resources available to
> allocate!
> I0407 22:34:11.525387 29298 hierarchical.cpp:1586] No inverse offers to send
> out!
> I0407 22:34:11.525538 29298 hierarchical.cpp:1142] Performed allocation for 3
> agents in 540681ns
> I0407 22:34:11.525856 29296 replica.cpp:537] Replica received write request
> for position 10 from (4835)@172.17.0.3:35855
> I0407 22:34:11.526267 29308 sched.cpp:902] Rescinded offer
> f59f9057-a5c7-43e1-b129-96862e640a12-O1
> I0407 22:34:11.526398 29308 sched.cpp:913] Scheduler::offerRescinded took
> 54437ns
> I0407 22:34:11.526425 29298 hierarchical.cpp:894] Recovered cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000] (total: cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000], allocated: ) on agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S2 from framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000
> I0407 22:34:11.527235 29299 sched.cpp:902] Rescinded offer
> f59f9057-a5c7-43e1-b129-96862e640a12-O2
> I0407 22:34:11.527299 29299 sched.cpp:913] Scheduler::offerRescinded took
> 29764ns
> I0407 22:34:11.527825 29300 sched.cpp:902] Rescinded offer
> f59f9057-a5c7-43e1-b129-96862e640a12-O0
> I0407 22:34:11.527920 29298 hierarchical.cpp:1586] No inverse offers to send
> out!
> I0407 22:34:11.527990 29298 hierarchical.cpp:1142] Performed allocation for 3
> agents in 1.481251ms
> I0407 22:34:11.528009 29300 sched.cpp:913] Scheduler::offerRescinded took
> 333035ns
> I0407 22:34:11.528591 29298 hierarchical.cpp:894] Recovered cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000] (total: cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000], allocated: ) on agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S1 from framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000
> I0407 22:34:11.529536 29311 master.cpp:5524] Sending 1 offers to framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001 (default) at
> scheduler-37080386-2aa8-4592-bf09-8288bd04727a@172.17.0.3:35855
> I0407 22:34:11.529846 29298 hierarchical.cpp:894] Recovered cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000] (total: cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000], allocated: ) on agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S0 from framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000
> I0407 22:34:11.530747 29304 sched.cpp:876] Scheduler::resourceOffers took
> 128400ns
> I0407 22:34:11.560456 29296 leveldb.cpp:341] Persisting action (16 bytes) to
> leveldb took 34.585376ms
> I0407 22:34:11.560539 29296 replica.cpp:712] Persisted action at 10
> I0407 22:34:11.564628 29303 replica.cpp:691] Replica received learned notice
> for position 10 from @0.0.0.0:0
> I0407 22:34:11.601330 29303 leveldb.cpp:341] Persisting action (18 bytes) to
> leveldb took 36.57815ms
> I0407 22:34:11.601774 29303 leveldb.cpp:399] Deleting ~2 keys from leveldb
> took 221499ns
> I0407 22:34:11.601899 29303 replica.cpp:712] Persisted action at 10
> I0407 22:34:11.602052 29303 replica.cpp:697] Replica learned TRUNCATE action
> at position 10
> I0407 22:34:12.531602 29308 hierarchical.cpp:1586] No inverse offers to send
> out!
> I0407 22:34:12.532578 29308 hierarchical.cpp:1142] Performed allocation for 3
> agents in 3.892929ms
> I0407 22:34:12.532403 29306 master.cpp:5524] Sending 1 offers to framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001 (default) at
> scheduler-37080386-2aa8-4592-bf09-8288bd04727a@172.17.0.3:35855
> ../../src/tests/master_allocator_tests.cpp:1587: Failure
> Mock function called more times than expected - returning directly.
> Function call: resourceOffers(0x7fffe87e3370, @0x2adef432e6f0 { 144-byte
> object <E0-9C 76-EA DE-2A 00-00 00-00 00-00 00-00 00-00 1F-00 00-00 00-00
> 00-00 90-4B 00-2C DF-2A 00-00 30-6A 00-2C DF-2A 00-00 80-6A 00-2C DF-2A 00-00
> 20-62 00-2C DF-2A 00-00 60-38 00-2C DF-2A 00-00 ... 04-00 00-00 01-00 00-00
> 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00
> 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00 00-00
> 00-00 00-00> })
> Expected: to be called once
> Actual: called twice - over-saturated and active
> I0407 22:34:12.533665 29301 sched.cpp:876] Scheduler::resourceOffers took
> 250853ns
> I0407 22:34:12.533915 29306 master.cpp:5524] Sending 1 offers to framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000 (default) at
> scheduler-72944dc9-e3cc-4ebc-bca6-d72c77ad6721@172.17.0.3:35855
> I0407 22:34:12.534454 29306 sched.cpp:876] Scheduler::resourceOffers took
> 157733ns
> ../../src/tests/master_allocator_tests.cpp:1629: Failure
> Value of: framework2offers.get().size()
> Actual: 1
> Expected: 2u
> Which is: 2
> I0407 22:34:12.534997 29278 resources.cpp:572] Parsing resources as JSON
> failed: cpus:2;mem:1024;disk:4096;ports:[31000-32000]
> Trying semicolon-delimited string format instead
> I0407 22:34:12.537264 29301 master.cpp:1275] Framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001 (default) at
> scheduler-37080386-2aa8-4592-bf09-8288bd04727a@172.17.0.3:35855 disconnected
> I0407 22:34:12.537297 29301 master.cpp:2658] Disconnecting framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001 (default) at
> scheduler-37080386-2aa8-4592-bf09-8288bd04727a@172.17.0.3:35855
> I0407 22:34:12.537330 29301 master.cpp:2682] Deactivating framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001 (default) at
> scheduler-37080386-2aa8-4592-bf09-8288bd04727a@172.17.0.3:35855
> W0407 22:34:12.537849 29301 master.hpp:1822] Master attempted to send message
> to disconnected framework f59f9057-a5c7-43e1-b129-96862e640a12-0001 (default)
> at scheduler-37080386-2aa8-4592-bf09-8288bd04727a@172.17.0.3:35855
> W0407 22:34:12.538306 29301 master.hpp:1822] Master attempted to send message
> to disconnected framework f59f9057-a5c7-43e1-b129-96862e640a12-0001 (default)
> at scheduler-37080386-2aa8-4592-bf09-8288bd04727a@172.17.0.3:35855
> I0407 22:34:12.538394 29301 master.cpp:1299] Giving framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001 (default) at
> scheduler-37080386-2aa8-4592-bf09-8288bd04727a@172.17.0.3:35855 0ns to
> failover
> I0407 22:34:12.539371 29302 hierarchical.cpp:378] Deactivated framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001
> I0407 22:34:12.540053 29302 hierarchical.cpp:894] Recovered cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000] (total: cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000], allocated: ) on agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S0 from framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001
> I0407 22:34:12.540732 29302 hierarchical.cpp:894] Recovered cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000] (total: cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000], allocated: ) on agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S2 from framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001
> I0407 22:34:12.540974 29301 master.cpp:1275] Framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000 (default) at
> scheduler-72944dc9-e3cc-4ebc-bca6-d72c77ad6721@172.17.0.3:35855 disconnected
> I0407 22:34:12.541178 29301 master.cpp:2658] Disconnecting framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000 (default) at
> scheduler-72944dc9-e3cc-4ebc-bca6-d72c77ad6721@172.17.0.3:35855
> I0407 22:34:12.541292 29301 master.cpp:2682] Deactivating framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000 (default) at
> scheduler-72944dc9-e3cc-4ebc-bca6-d72c77ad6721@172.17.0.3:35855
> I0407 22:34:12.541553 29300 hierarchical.cpp:378] Deactivated framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000
> I0407 22:34:12.542654 29300 hierarchical.cpp:894] Recovered cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000] (total: cpus(*):2;
> mem(*):1024; disk(*):4096; ports(*):[31000-32000], allocated: ) on agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S1 from framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000
> W0407 22:34:12.543051 29301 master.hpp:1822] Master attempted to send message
> to disconnected framework f59f9057-a5c7-43e1-b129-96862e640a12-0000 (default)
> at scheduler-72944dc9-e3cc-4ebc-bca6-d72c77ad6721@172.17.0.3:35855
> I0407 22:34:12.543525 29301 master.cpp:1299] Giving framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000 (default) at
> scheduler-72944dc9-e3cc-4ebc-bca6-d72c77ad6721@172.17.0.3:35855 0ns to
> failover
> I0407 22:34:12.543861 29301 master.cpp:5376] Framework failover timeout,
> removing framework f59f9057-a5c7-43e1-b129-96862e640a12-0001 (default) at
> scheduler-37080386-2aa8-4592-bf09-8288bd04727a@172.17.0.3:35855
> I0407 22:34:12.543959 29301 master.cpp:6109] Removing framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001 (default) at
> scheduler-37080386-2aa8-4592-bf09-8288bd04727a@172.17.0.3:35855
> I0407 22:34:12.544445 29301 slave.cpp:2226] Asked to shut down framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001 by master@172.17.0.3:35855
> W0407 22:34:12.545446 29301 slave.cpp:2241] Cannot shut down unknown
> framework f59f9057-a5c7-43e1-b129-96862e640a12-0001
> I0407 22:34:12.544556 29300 slave.cpp:2226] Asked to shut down framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001 by master@172.17.0.3:35855
> W0407 22:34:12.545661 29300 slave.cpp:2241] Cannot shut down unknown
> framework f59f9057-a5c7-43e1-b129-96862e640a12-0001
> I0407 22:34:12.545774 29300 slave.cpp:811] Agent terminating
> I0407 22:34:12.544791 29305 hierarchical.cpp:329] Removed framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001
> I0407 22:34:12.545241 29296 master.cpp:5376] Framework failover timeout,
> removing framework f59f9057-a5c7-43e1-b129-96862e640a12-0000 (default) at
> scheduler-72944dc9-e3cc-4ebc-bca6-d72c77ad6721@172.17.0.3:35855
> I0407 22:34:12.544518 29302 slave.cpp:2226] Asked to shut down framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0001 by master@172.17.0.3:35855
> I0407 22:34:12.546140 29296 master.cpp:6109] Removing framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000 (default) at
> scheduler-72944dc9-e3cc-4ebc-bca6-d72c77ad6721@172.17.0.3:35855
> W0407 22:34:12.546159 29302 slave.cpp:2241] Cannot shut down unknown
> framework f59f9057-a5c7-43e1-b129-96862e640a12-0001
> I0407 22:34:12.546496 29296 master.cpp:1236] Agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S0 at slave(111)@172.17.0.3:35855
> (129e11060069) disconnected
> I0407 22:34:12.546527 29296 master.cpp:2717] Disconnecting agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S0 at slave(111)@172.17.0.3:35855
> (129e11060069)
> I0407 22:34:12.546581 29296 master.cpp:2736] Deactivating agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S0 at slave(111)@172.17.0.3:35855
> (129e11060069)
> I0407 22:34:12.546752 29296 slave.cpp:2226] Asked to shut down framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000 by master@172.17.0.3:35855
> W0407 22:34:12.546782 29296 slave.cpp:2241] Cannot shut down unknown
> framework f59f9057-a5c7-43e1-b129-96862e640a12-0000
> I0407 22:34:12.546844 29296 slave.cpp:2226] Asked to shut down framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000 by master@172.17.0.3:35855
> W0407 22:34:12.546869 29296 slave.cpp:2241] Cannot shut down unknown
> framework f59f9057-a5c7-43e1-b129-96862e640a12-0000
> I0407 22:34:12.547111 29296 hierarchical.cpp:329] Removed framework
> f59f9057-a5c7-43e1-b129-96862e640a12-0000
> I0407 22:34:12.547302 29296 hierarchical.cpp:563] Agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S0 deactivated
> I0407 22:34:12.553478 29278 slave.cpp:811] Agent terminating
> I0407 22:34:12.553766 29306 master.cpp:1236] Agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S1 at slave(112)@172.17.0.3:35855
> (129e11060069) disconnected
> I0407 22:34:12.555483 29306 master.cpp:2717] Disconnecting agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S1 at slave(112)@172.17.0.3:35855
> (129e11060069)
> I0407 22:34:12.555858 29306 master.cpp:2736] Deactivating agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S1 at slave(112)@172.17.0.3:35855
> (129e11060069)
> I0407 22:34:12.556190 29307 hierarchical.cpp:563] Agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S1 deactivated
> I0407 22:34:12.559095 29299 slave.cpp:811] Agent terminating
> I0407 22:34:12.559301 29300 master.cpp:1236] Agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S2 at slave(113)@172.17.0.3:35855
> (129e11060069) disconnected
> I0407 22:34:12.559327 29300 master.cpp:2717] Disconnecting agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S2 at slave(113)@172.17.0.3:35855
> (129e11060069)
> I0407 22:34:12.559370 29300 master.cpp:2736] Deactivating agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S2 at slave(113)@172.17.0.3:35855
> (129e11060069)
> I0407 22:34:12.559516 29309 hierarchical.cpp:563] Agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S2 deactivated
> I0407 22:34:12.561872 29278 master.cpp:1089] Master terminating
> I0407 22:34:12.562566 29304 hierarchical.cpp:508] Removed agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S2
> I0407 22:34:12.562890 29304 hierarchical.cpp:508] Removed agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S1
> I0407 22:34:12.565459 29304 hierarchical.cpp:508] Removed agent
> f59f9057-a5c7-43e1-b129-96862e640a12-S0
> [ FAILED ] MasterAllocatorTest/1.RebalancedForUpdatedWeights, where
> TypeParam =
> mesos::internal::tests::Module<mesos::master::allocator::Allocator,
> (mesos::internal::tests::ModuleID)6> (2240 ms)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
