[
https://issues.apache.org/jira/browse/MESOS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16163488#comment-16163488
]
Vinod Kone commented on MESOS-7729:
-----------------------------------
Observed this again when testing 1.4.0-rc5
{code}
[ RUN ] ExamplesTest.DynamicReservationFramework
Using temporary directory '/tmp/ExamplesTest_DynamicReservationFramework_X8HEx3'
/mesos/mesos-1.4.0/src/tests/dynamic_reservation_framework_test.sh: line 19:
/mesos/mesos-1.4.0/_build/src/colors.sh: No such file or directory
/mesos/mesos-1.4.0/src/tests/dynamic_reservation_framework_test.sh: line 20:
/mesos/mesos-1.4.0/_build/src/atexit.sh: No such file or directory
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0912 05:39:23.537657 10146 process.cpp:1383] libprocess is initialized on
172.17.0.2:58338 with 16 worker threads
I0912 05:39:23.537824 10146 logging.cpp:199] Logging to STDERR
I0912 05:39:23.546293 10146 leveldb.cpp:174] Opened db in 3.736538ms
I0912 05:39:23.548110 10146 leveldb.cpp:181] Compacted db in 1.772058ms
I0912 05:39:23.548224 10146 leveldb.cpp:196] Created db iterator in 65871ns
I0912 05:39:23.548252 10146 leveldb.cpp:202] Seeked to beginning of db in 4485ns
I0912 05:39:23.548266 10146 leveldb.cpp:271] Iterated through 0 keys in the db
in 837ns
I0912 05:39:23.548477 10146 replica.cpp:779] Replica recovered with log
positions 0 -> 0 with 1 holes and 0 unlearned
I0912 05:39:23.552364 10178 recover.cpp:451] Starting replica recovery
I0912 05:39:23.553293 10178 recover.cpp:477] Replica is in EMPTY status
I0912 05:39:23.553362 10146 local.cpp:272] Creating default 'local' authorizer
I0912 05:39:23.556284 10177 replica.cpp:676] Replica in EMPTY status received a
broadcasted recover request from __req_res__(1)@172.17.0.2:58338
I0912 05:39:23.557749 10183 recover.cpp:197] Received a recover response from a
replica in EMPTY status
I0912 05:39:23.558420 10172 master.cpp:442] Master
88d5c5d6-0adb-4ab6-b31a-8d4c15835aec (1f5ae5235571) started on 172.17.0.2:58338
I0912 05:39:23.558684 10186 recover.cpp:568] Updating replica status to STARTING
I0912 05:39:23.558457 10172 master.cpp:444] Flags at startup:
--acls="permissive: true
register_frameworks {
principals {
type: ANY
}
roles {
type: SOME
values: "test"
}
}
" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins"
--allocation_interval="1secs" --allocator="HierarchicalDRF"
--authenticate_agents="false" --authenticate_f
rameworks="false" --authenticate_http_frameworks="false"
--authenticate_http_readonly="false" --authenticate_http_readwrite="false"
--authenticators="crammd5" --authorizers="
local"
--credentials="/tmp/ExamplesTest_DynamicReservationFramework_X8HEx3/credentials"
--filter_gpu_resources="true" --framework_sorter="drf" --help="false"
--hostname_looku
p="true" --http_authenticators="basic" --initialize_driver_logging="true"
--log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO"
--max_agent_ping_timeouts="5" --max_completed_frameworks="50"
--max_completed_tasks_per_framework="1000"
--max_unreachable_tasks_per_framework="1000" --port="5050" --quiet="false"
--recovery_agent_removal_limit="100%" --registry="replicated_log"
--registry_fetch_timeout="1mins" --registry_gc_interval="15mins"
--registry_max_agent_age="2weeks" --registry_max_agent_count="102400"
--registry_store_timeout="20secs" --registry_strict="false"
--root_submissions="true" --user_sorter="drf" --version="false"
--webui_dir="/mesos/mesos-1.4.0/src/webui"
--work_dir="/tmp/mesos-XAzyPI/master" --zk_session_timeout="10secs"
I0912 05:39:23.559283 10172 master.cpp:496] Master allowing unauthenticated
frameworks to register
I0912 05:39:23.559315 10172 master.cpp:510] Master allowing unauthenticated
agents to register
I0912 05:39:23.559345 10172 master.cpp:524] Master allowing HTTP frameworks to
register without authentication
I0912 05:39:23.559367 10172 credentials.hpp:37] Loading credentials for
authentication from
'/tmp/ExamplesTest_DynamicReservationFramework_X8HEx3/credentials'
W0912 05:39:23.559479 10172 credentials.hpp:52] Permissions on credentials file
'/tmp/ExamplesTest_DynamicReservationFramework_X8HEx3/credentials' are too
open; it is recommended that your credentials file is NOT accessible by others
I0912 05:39:23.559638 10171 leveldb.cpp:304] Persisting metadata (8 bytes) to
leveldb took 686513ns
I0912 05:39:23.559670 10171 replica.cpp:322] Persisted replica status to
STARTING
I0912 05:39:23.559728 10172 master.cpp:566] Using default 'crammd5'
authenticator
I0912 05:39:23.559926 10172 authenticator.cpp:520] Initializing server SASL
I0912 05:39:23.560144 10171 recover.cpp:477] Replica is in STARTING status
I0912 05:39:23.560703 10172 auxprop.cpp:73] Initialized in-memory auxiliary
property plugin
I0912 05:39:23.560852 10172 master.cpp:646] Authorization enabled
I0912 05:39:23.561005 10179 replica.cpp:676] Replica in STARTING status
received a broadcasted recover request from __req_res__(2)@172.17.0.2:58338
I0912 05:39:23.561352 10183 hierarchical.cpp:171] Initialized hierarchical
allocator process
I0912 05:39:23.561383 10182 recover.cpp:197] Received a recover response from a
replica in STARTING status
I0912 05:39:23.561552 10171 whitelist_watcher.cpp:77] No whitelist given
I0912 05:39:23.561923 10181 recover.cpp:568] Updating replica status to VOTING
I0912 05:39:23.562558 10177 leveldb.cpp:304] Persisting metadata (8 bytes) to
leveldb took 411036ns
I0912 05:39:23.562587 10177 replica.cpp:322] Persisted replica status to VOTING
I0912 05:39:23.562688 10185 recover.cpp:582] Successfully joined the Paxos group
I0912 05:39:23.563045 10185 recover.cpp:466] Recover process terminated
I0912 05:39:23.564373 10146 resolver.cpp:69] Creating default secret resolver
I0912 05:39:23.564946 10146 containerizer.cpp:246] Using isolation:
filesystem/posix,posix/cpu,posix/mem,network/cni,environment_secret
W0912 05:39:23.566143 10146 backend.cpp:76] Failed to create 'aufs' backend:
AufsBackend requires root privileges
W0912 05:39:23.566447 10146 backend.cpp:76] Failed to create 'bind' backend:
BindBackend requires root privileges
I0912 05:39:23.566524 10146 provisioner.cpp:255] Using default backend 'copy'
I0912 05:39:23.571393 10174 slave.cpp:250] Mesos agent started on
(1)@172.17.0.2:58338
I0912 05:39:23.571421 10174 slave.cpp:251] Flags at startup:
--acls="permissive: true
register_frameworks {
principals {
type: ANY
}
roles {
type: SOME
values: "test"
}
}
" --appc_simple_discovery_uri_prefix="http://";
--appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="false"
--authenticate_http_readwrite="false" --authenticatee="crammd5"
--authentication_backoff_factor="1secs" --authorizer="local"
--cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false"
--cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false"
--cgroups_root="mesos" --container_disk_watch_interval="15secs"
--containerizers="mesos" --default_role="*"
--disallow_sharing_agent_pid_namespace="false" --disk_watch_interval="1mins"
--docker="docker" --docker_kill_orphans="true"
--docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs"
--docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns"
--docker_store_dir="/tmp/mesos/store/docker"
--docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume"
--enforce_container_disk_quota="false" --executor_registration_timeout="1mins"
--executor_reregistration_timeout="2secs"
--executor_shutdown_grace_period="5secs"
--fetcher_cache_dir="/tmp/mesos-XAzyPI/agents/0/fetch"
--fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
--gc_disk_headroom="0.1" --hadoop_home="" --help="false"
--hostname_lookup="true" --http_command_executor="false"
--http_heartbeat_interval="30secs" --initialize_driver_logging="true"
--isolation="filesystem/posix,posix/cpu,posix/mem" --launcher="posix"
--launcher_dir="/mesos/mesos-1.4.0/_build/src" --logbufsecs="0"
--logging_level="INFO" --max_completed_executors_per_framework="150"
--oversubscribed_resources_interval="15secs" --perf_duration="10secs"
--perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns"
--quiet="false" --recover="reconnect" --recovery_timeout="15mins"
--registration_backoff_factor="1secs" --revocable_cpu_low_priority="true"
--runtime_dir="/tmp/mesos-XAzyPI/agents/0/run"
--sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true"
--systemd_enable_support="true"
--systemd_runtime_directory="/run/systemd/system" --version="false"
--work_dir="/tmp/mesos-XAzyPI/agents/0/work"
I0912 05:39:23.574439 10173 master.cpp:2163] Elected as the leading master!
I0912 05:39:23.574484 10173 master.cpp:1702] Recovering from registrar
I0912 05:39:23.574596 10146 resolver.cpp:69] Creating default secret resolver
I0912 05:39:23.574844 10185 registrar.cpp:347] Recovering registrar
I0912 05:39:23.575057 10146 containerizer.cpp:246] Using isolation:
filesystem/posix,posix/cpu,posix/mem,network/cni,environment_secret
W0912 05:39:23.575667 10146 backend.cpp:76] Failed to create 'aufs' backend:
AufsBackend requires root privileges
W0912 05:39:23.575793 10146 backend.cpp:76] Failed to create 'bind' backend:
BindBackend requires root privileges
I0912 05:39:23.575839 10146 provisioner.cpp:255] Using default backend 'copy'
I0912 05:39:23.576120 10178 log.cpp:536] Attempting to start the writer
I0912 05:39:23.578747 10186 replica.cpp:496] Replica received implicit promise
request from __req_res__(3)@172.17.0.2:58338 with proposal 1
I0912 05:39:23.579331 10186 leveldb.cpp:304] Persisting metadata (8 bytes) to
leveldb took 543214ns
I0912 05:39:23.579362 10186 replica.cpp:344] Persisted promised to 1
I0912 05:39:23.579798 10180 slave.cpp:250] Mesos agent started on
(2)@172.17.0.2:58338
I0912 05:39:23.579821 10180 slave.cpp:251] Flags at startup:
--acls="permissive: true
register_frameworks {
principals {
type: ANY
}
roles {
type: SOME
values: "test"
}
}
" --appc_simple_discovery_uri_prefix="http://";
--appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="false"
--authenticate_http_readwrite="false" --authenticatee="crammd5"
--authentication_backoff_factor="1secs" --authorizer="local"
--cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false"
--cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false"
--cgroups_root="mesos" --container_disk_watch_interval="15secs"
--containerizers="mesos" --default_role="*"
--disallow_sharing_agent_pid_namespace="false" --disk_watch_interval="1mins"
--docker="docker" --docker_kill_orphans="true"
--docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs"
--docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns"
--docker_store_dir="/tmp/mesos/store/docker"
--docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume"
--enforce_container_disk_quota="false" --executor_registration_timeout="1mins"
--executor_reregistration_timeout="2secs"
--executor_shutdown_grace_period="5secs"
--fetcher_cache_dir="/tmp/mesos-XAzyPI/agents/1/fetch"
--fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
--gc_disk_headroom="0.1" --hadoop_home="" --help="false"
--hostname_lookup="true" --http_command_executor="false"
--http_heartbeat_interval="30secs" --initialize_driver_logging="true"
--isolation="filesystem/posix,posix/cpu,posix/mem" --launcher="posix"
--launcher_dir="/mesos/mesos-1.4.0/_build/src" --logbufsecs="0"
--logging_level="INFO" --max_completed_executors_per_framework="150"
--oversubscribed_resources_interval="15secs" --perf_duration="10secs"
--perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns"
--quiet="false" --recover="reconnect" --recovery_timeout="15mins"
--registration_backoff_factor="1secs" --revocable_cpu_low_priority="true"
--runtime_dir="/tmp/mesos-XAzyPI/agents/1/run"
--sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true"
--systemd_enable_support="true"
--systemd_runtime_directory="/run/systemd/system" --version="false"
--work_dir="/tmp/mesos-XAzyPI/agents/1/work"
I0912 05:39:23.580376 10173 coordinator.cpp:238] Coordinator attempting to fill
missing positions
I0912 05:39:23.581925 10184 replica.cpp:391] Replica received explicit promise
request from __req_res__(4)@172.17.0.2:58338 for position 0 with proposal 2
I0912 05:39:23.582340 10184 leveldb.cpp:341] Persisting action (8 bytes) to
leveldb took 356887ns
I0912 05:39:23.582370 10184 replica.cpp:711] Persisted action NOP at position 0
I0912 05:39:23.583437 10146 resolver.cpp:69] Creating default secret resolver
I0912 05:39:23.583847 10173 replica.cpp:540] Replica received write request for
position 0 from __req_res__(5)@172.17.0.2:58338
I0912 05:39:23.583868 10146 containerizer.cpp:246] Using isolation:
filesystem/posix,posix/cpu,posix/mem,network/cni,environment_secret
I0912 05:39:23.583945 10173 leveldb.cpp:436] Reading position from leveldb took
60225ns
I0912 05:39:23.584494 10173 leveldb.cpp:341] Persisting action (14 bytes) to
leveldb took 470724ns
W0912 05:39:23.584523 10146 backend.cpp:76] Failed to create 'aufs' backend:
AufsBackend requires root privileges
I0912 05:39:23.584525 10173 replica.cpp:711] Persisted action NOP at position 0
W0912 05:39:23.584676 10146 backend.cpp:76] Failed to create 'bind' backend:
BindBackend requires root privileges
I0912 05:39:23.584723 10146 provisioner.cpp:255] Using default backend 'copy'
I0912 05:39:23.585263 10182 replica.cpp:694] Replica received learned notice
for position 0 from log-network(1)@172.17.0.2:58338
I0912 05:39:23.585748 10182 leveldb.cpp:341] Persisting action (16 bytes) to
leveldb took 450483ns
I0912 05:39:23.585777 10182 replica.cpp:711] Persisted action NOP at position 0
I0912 05:39:23.586402 10177 log.cpp:552] Writer started with ending position 0
I0912 05:39:23.588623 10185 slave.cpp:250] Mesos agent started on
(3)@172.17.0.2:58338
I0912 05:39:23.588649 10185 slave.cpp:251] Flags at startup:
--acls="permissive: true
register_frameworks {
principals {
type: ANY
}
roles {
type: SOME
values: "test"
}
}
" --appc_simple_discovery_uri_prefix="http://";
--appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="false"
--authenticate_http_readwrite="false" --authenticatee="crammd5"
--authentication_backoff_factor="1secs" --authorizer="local"
--cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false"
--cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false"
--cgroups_root="mesos" --container_disk_watch_interval="15secs"
--containerizers="mesos" --default_role="*"
--disallow_sharing_agent_pid_namespace="false" --disk_watch_interval="1mins"
--docker="docker" --docker_kill_orphans="true"
--docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs"
--docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns"
--docker_store_dir="/tmp/mesos/store/docker"
--docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume"
--enforce_container_disk_quota="false" --executor_registration_timeout="1mins"
--executor_reregistration_timeout="2secs"
--executor_shutdown_grace_period="5secs"
--fetcher_cache_dir="/tmp/mesos-XAzyPI/agents/2/fetch"
--fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
--gc_disk_headroom="0.1" --hadoop_home="" --help="false"
--hostname_lookup="true" --http_command_executor="false"
--http_heartbeat_interval="30secs" --initialize_driver_logging="true"
--isolation="filesystem/posix,posix/cpu,posix/mem" --launcher="posix"
--launcher_dir="/mesos/mesos-1.4.0/_build/src" --logbufsecs="0"
--logging_level="INFO" --max_completed_executors_per_framework="150"
--oversubscribed_resources_interval="15secs" --perf_duration="10secs"
--perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns"
--quiet="false" --recover="reconnect" --recovery_timeout="15mins"
--registration_backoff_factor="1secs" --revocable_cpu_low_priority="true"
--runtime_dir="/tmp/mesos-XAzyPI/agents/2/run"
--sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true"
--systemd_enable_support="true"
--systemd_runtime_directory="/run/systemd/system" --version="false"
--work_dir="/tmp/mesos-XAzyPI/agents/2/work"
I0912 05:39:23.589975 10146 sched.cpp:232] Version: 1.4.0
I0912 05:39:23.590693 10176 leveldb.cpp:436] Reading position from leveldb took
35991ns
I0912 05:39:23.591331 10176 sched.cpp:336] New master detected at
[email protected]:58338
I0912 05:39:23.591498 10176 sched.cpp:352] No credentials provided. Attempting
to register without authentication
I0912 05:39:23.591540 10176 sched.cpp:836] Sending SUBSCRIBE call to
[email protected]:58338
I0912 05:39:23.591751 10176 sched.cpp:869] Will retry registration in
1.548772469secs if necessary
I0912 05:39:23.591790 10181 master.cpp:1525] Dropping 'mesos.scheduler.Call'
message since not recovered yet
I0912 05:39:23.581357 10180 slave.cpp:565] Agent resources:
[{"name":"cpus","scalar":{"value":16.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":47270.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":3701220.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
I0912 05:39:23.590345 10185 slave.cpp:565] Agent resources:
[{"name":"cpus","scalar":{"value":16.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":47270.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":3701220.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
I0912 05:39:23.573421 10174 slave.cpp:565] Agent resources:
[{"name":"cpus","scalar":{"value":16.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":47270.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":3701220.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
I0912 05:39:23.592649 10180 slave.cpp:573] Agent attributes: [ ]
I0912 05:39:23.592651 10185 slave.cpp:573] Agent attributes: [ ]
I0912 05:39:23.592687 10180 slave.cpp:582] Agent hostname: 1f5ae5235571
I0912 05:39:23.592699 10185 slave.cpp:582] Agent hostname: 1f5ae5235571
I0912 05:39:23.592736 10174 slave.cpp:573] Agent attributes: [ ]
I0912 05:39:23.592768 10174 slave.cpp:582] Agent hostname: 1f5ae5235571
I0912 05:39:23.592907 10177 status_update_manager.cpp:177] Pausing sending
status updates
I0912 05:39:23.592939 10186 status_update_manager.cpp:177] Pausing sending
status updates
I0912 05:39:23.593065 10177 status_update_manager.cpp:177] Pausing sending
status updates
I0912 05:39:23.595026 10175 registrar.cpp:391] Successfully fetched the
registry (0B) in 20.11904ms
I0912 05:39:23.595355 10175 registrar.cpp:495] Applied 1 operations in 81685ns;
attempting to update the registry
*** Error in
`/mesos/mesos-1.4.0/_build/src/.libs/lt-dynamic-reservation-framework': double
free or corruption (!prev): 0x00007fd85c006570 ***
======= Backtrace: =========
/lib64/libc.so.6(+0x7c503)[0x7fd8aa8b2503]
I0912 05:39:23.596341 10184 state.cpp:64] Recovering state from
'/tmp/mesos-XAzyPI/agents/0/work/meta'
I0912 05:39:23.596341 10179 state.cpp:64] Recovering state from
'/tmp/mesos-XAzyPI/agents/1/work/meta'
I0912 05:39:23.597025 10179 status_update_manager.cpp:203] Recovering status
update manager
I0912 05:39:23.597029 10183 status_update_manager.cpp:203] Recovering status
update manager
I0912 05:39:23.597344 10172 containerizer.cpp:609] Recovering containerizer
I0912 05:39:23.597358 10178 containerizer.cpp:609] Recovering containerizer
I0912 05:39:23.598991 10183 log.cpp:560] Attempting to append 168 bytes to the
log
I0912 05:39:23.599205 10182 coordinator.cpp:348] Coordinator attempting to
write APPEND action at position 1
I0912 05:39:23.600191 10183 replica.cpp:540] Replica received write request for
position 1 from __req_res__(6)@172.17.0.2:58338
I0912 05:39:23.600818 10177 provisioner.cpp:416] Provisioner recovery complete
I0912 05:39:23.600833 10183 leveldb.cpp:341] Persisting action (187 bytes) to
leveldb took 580274ns
I0912 05:39:23.600821 10173 provisioner.cpp:416] Provisioner recovery complete
I0912 05:39:23.600889 10183 replica.cpp:711] Persisted action APPEND at
position 1
I0912 05:39:23.601405 10173 slave.cpp:6295] Finished recovery
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(_ZNSt14_Function_base13_Base_managerIZN7process5deferIN5mesos8internal5slave5SlaveEiiRKSt12_PlaceholderILi1EERKS7_ILi2EEEENS1_9_DeferredIDTcl4bindadsrSt8functionIFvT0_T1_EEclcvSJ__Ecl7forwardIT2_Efp1_Ecl7forwardIT3_Efp2_EEEEERKNS1_3PIDIT_EEMSP_FvSG_SH_EOSK_OSL_EUliiE_E10_M_destroyERSt9_Any_dataSt17integral_constantIbLb0EE+0x31)[0x7fd8b131fdb6]
I0912 05:39:23.601409 10180 slave.cpp:6295] Finished recovery
I0912 05:39:23.601806 10181 replica.cpp:694] Replica received learned notice
for position 1 from log-network(1)@172.17.0.2:58338
I0912 05:39:23.602125 10180 slave.cpp:6477] Querying resource estimator for
oversubscribable resources
I0912 05:39:23.602130 10173 slave.cpp:6477] Querying resource estimator for
oversubscribable resources
I0912 05:39:23.602512 10181 leveldb.cpp:341] Persisting action (189 bytes) to
leveldb took 574653ns
I0912 05:39:23.602617 10171 status_update_manager.cpp:177] Pausing sending
status updates
I0912 05:39:23.602625 10184 status_update_manager.cpp:177] Pausing sending
status updates
I0912 05:39:23.602627 10181 replica.cpp:711] Persisted action APPEND at
position 1
I0912 05:39:23.602690 10173 slave.cpp:971] New master detected at
[email protected]:58338
I0912 05:39:23.602717 10180 slave.cpp:971] New master detected at
[email protected]:58338
I0912 05:39:23.602761 10173 slave.cpp:995] No credentials provided. Attempting
to register without authentication
I0912 05:39:23.602776 10180 slave.cpp:995] No credentials provided. Attempting
to register without authentication
I0912 05:39:23.602860 10173 slave.cpp:1006] Detecting new master
I0912 05:39:23.602874 10180 slave.cpp:1006] Detecting new master
I0912 05:39:23.602988 10173 slave.cpp:6491] Received oversubscribable resources
{} from the resource estimator
I0912 05:39:23.603126 10180 slave.cpp:6491] Received oversubscribable resources
{} from the resource estimator
I0912 05:39:23.604110 10175 registrar.cpp:552] Successfully updated the
registry in 8.638976ms
I0912 05:39:23.604315 10175 registrar.cpp:424] Successfully recovered registrar
I0912 05:39:23.604476 10179 log.cpp:579] Attempting to truncate the log to 1
I0912 05:39:23.604734 10175 coordinator.cpp:348] Coordinator attempting to
write TRUNCATE action at position 2
I0912 05:39:23.604975 10182 hierarchical.cpp:209] Skipping recovery of
hierarchical allocator: nothing to recover
I0912 05:39:23.605023 10171 master.cpp:1801] Recovered 0 agents from the
registry (129B); allowing 10mins for agents to re-register
I0912 05:39:23.605545 10183 replica.cpp:540] Replica received write request for
position 2 from __req_res__(7)@172.17.0.2:58338
I0912 05:39:23.606123 10183 leveldb.cpp:341] Persisting action (16 bytes) to
leveldb took 535113ns
I0912 05:39:23.606153 10183 replica.cpp:711] Persisted action TRUNCATE at
position 2
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(_ZNSt14_Function_base13_Base_managerIZN7process5deferIN5mesos8internal5slave5SlaveEiiRKSt12_PlaceholderILi1EERKS7_ILi2EEEENS1_9_DeferredIDTcl4bindadsrSt8functionIFvT0_T1_EEclcvSJ__Ecl7forwardIT2_Efp1_Ecl7forwardIT3_Efp2_EEEEERKNS1_3PIDIT_EEMSP_FvSG_SH_EOSK_OSL_EUliiE_E10_M_managerERSt9_Any_dataRKSZ_St18_Manager_operation+0xa2)[0x7fd8b130168b]
/mesos/mesos-1.4.0/_build/src/.libs/lt-dynamic-reservation-framework(_ZNSt14_Function_baseD1Ev+0x33)[0x7fd8b3f7eb97]
I0912 05:39:23.606695 10178 replica.cpp:694] Replica received learned notice
for position 2 from log-network(1)@172.17.0.2:58338
I0912 05:39:23.607146 10178 leveldb.cpp:341] Persisting action (18 bytes) to
leveldb took 415900ns
I0912 05:39:23.607218 10178 leveldb.cpp:399] Deleting ~1 keys from leveldb took
45543ns
I0912 05:39:23.607240 10178 replica.cpp:711] Persisted action TRUNCATE at
position 2
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(_ZNSt8functionIFviiEED1Ev+0x18)[0x7fd8b12b5fd0]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(_ZNSt10_Head_baseILm0ESt8functionIFviiEELb0EED1Ev+0x18)[0x7fd8b12b7582]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(_ZNSt11_Tuple_implILm0EISt8functionIFviiEESt12_PlaceholderILi1EES3_ILi2EEEED1Ev+0x18)[0x7fd8b12b759c]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(_ZNSt5tupleIISt8functionIFviiEESt12_PlaceholderILi1EES3_ILi2EEEED1Ev+0x18)[0x7fd8b12b75b6]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(_ZNSt5_BindIFSt7_Mem_fnIMSt8functionIFviiEEKFviiEES3_St12_PlaceholderILi1EES7_ILi2EEEED1Ev+0x1c)[0x7fd8b12b75d4]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(_ZNSt14_Function_base13_Base_managerISt5_BindIFSt7_Mem_fnIMSt8functionIFviiEEKFviiEES5_St12_PlaceholderILi1EES9_ILi2EEEEE10_M_destroyERSt9_Any_dataSt17integral_constantIbLb0EE+0x29)[0x7fd8b131ffcd]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(_ZNSt14_Function_base13_Base_managerISt5_BindIFSt7_Mem_fnIMSt8functionIFviiEEKFviiEES5_St12_PlaceholderILi1EES9_ILi2EEEEE10_M_managerERSt9_Any_dataRKSF_St18_Manager_operation+0xa2)[0x7fd8b13019d7]
/mesos/mesos-1.4.0/_build/src/.libs/lt-dynamic-reservation-framework(_ZNSt14_Function_baseD1Ev+0x33)[0x7fd8b3f7eb97]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(_ZNSt8functionIFviiEED1Ev+0x18)[0x7fd8b12b5fd0]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(_ZN2os8internal15configureSignalEPKSt8functionIFviiEE+0x4a)[0x7fd8b1261575]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(_ZN5mesos8internal5slave5Slave10initializeEv+0x3f64)[0x7fd8b1266ea6]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(_ZN7process14ProcessManager6resumeEPNS_11ProcessBaseE+0x27f)[0x7fd8b2265fa5]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(+0x6f306e8)[0x7fd8b22626e8]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(+0x6f42d92)[0x7fd8b2274d92]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(+0x6f42cd6)[0x7fd8b2274cd6]
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so(+0x6f42c60)[0x7fd8b2274c60]
/lib64/libstdc++.so.6(+0xb5230)[0x7fd8aaec2230]
/lib64/libpthread.so.0(+0x7dc5)[0x7fd8ab11ddc5]
/lib64/libc.so.6(clone+0x6d)[0x7fd8aa92d76d]
======= Memory map: ========
7fd848000000-7fd848021000 rw-p 00000000 00:00 0
7fd848021000-7fd84c000000 ---p 00000000 00:00 0
7fd850000000-7fd850021000 rw-p 00000000 00:00 0
7fd850021000-7fd854000000 ---p 00000000 00:00 0
7fd854000000-7fd854021000 rw-p 00000000 00:00 0
7fd854021000-7fd858000000 ---p 00000000 00:00 0
7fd858000000-7fd858021000 rw-p 00000000 00:00 0
7fd858021000-7fd85c000000 ---p 00000000 00:00 0
7fd85c000000-7fd85c021000 rw-p 00000000 00:00 0
7fd85c021000-7fd860000000 ---p 00000000 00:00 0
7fd860000000-7fd860021000 rw-p 00000000 00:00 0
7fd860021000-7fd864000000 ---p 00000000 00:00 0
7fd864000000-7fd864021000 rw-p 00000000 00:00 0
7fd864021000-7fd868000000 ---p 00000000 00:00 0
7fd868000000-7fd868021000 rw-p 00000000 00:00 0
7fd868021000-7fd86c000000 ---p 00000000 00:00 0
7fd86c000000-7fd86c021000 rw-p 00000000 00:00 0
7fd86c021000-7fd870000000 ---p 00000000 00:00 0
7fd870000000-7fd870021000 rw-p 00000000 00:00 0
7fd870021000-7fd874000000 ---p 00000000 00:00 0
7fd8771e5000-7fd8771e9000 r-xp 00000000 00:23 1059
/usr/lib64/sasl2/libanonymous.so.3.0.0
7fd8771e9000-7fd8773e8000 ---p 00004000 00:23 1059
/usr/lib64/sasl2/libanonymous.so.3.0.0
7fd8773e8000-7fd8773e9000 r--p 00003000 00:23 1059
/usr/lib64/sasl2/libanonymous.so.3.0.0
7fd8773e9000-7fd8773ea000 rw-p 00004000 00:23 1059
/usr/lib64/sasl2/libanonymous.so.3.0.0
7fd8773ea000-7fd8773f0000 r-xp 00000000 00:23 1056
/usr/lib64/sasl2/libsasldb.so.3.0.0
7fd8773f0000-7fd8775ef000 ---p 00006000 00:23 1056
/usr/lib64/sasl2/libsasldb.so.3.0.0
7fd8775ef000-7fd8775f0000 r--p 00005000 00:23 1056
/usr/lib64/sasl2/libsasldb.so.3.0.0
7fd8775f0000-7fd8775f1000 rw-p 00006000 00:23 1056
/usr/lib64/sasl2/libsasldb.so.3.0.0
7fd8775f1000-7fd8775fe000 r-xp 00000000 00:23 1050
/usr/lib64/sasl2/libdigestmd5.so.3.0.0
7fd8775fe000-7fd8777fd000 ---p 0000d000 00:23 1050
/usr/lib64/sasl2/libdigestmd5.so.3.0.0
7fd8777fd000-7fd8777fe000 r--p 0000c000 00:23 1050
/usr/lib64/sasl2/libdigestmd5.so.3.0.0
7fd8777fe000-7fd8777ff000 rw-p 0000d000 00:23 1050
/usr/lib64/sasl2/libdigestmd5.so.3.0.0
7fd8777ff000-7fd877800000 ---p 00000000 00:00 0
7fd877800000-7fd878000000 rw-p 00000000 00:00 0
[stack:4568]
7fd878000000-7fd878021000 rw-p 00000000 00:00 0
7fd878021000-7fd87c000000 ---p 00000000 00:00 0
7fd87c000000-7fd87c021000 rw-p 00000000 00:00 0
7fd87c021000-7fd880000000 ---p 00000000 00:00 0
7fd880000000-7fd880021000 rw-p 00000000 00:00 0
7fd880021000-7fd884000000 ---p 00000000 00:00 0
7fd884000000-7fd884021000 rw-p 00000000 00:00 0
7fd884021000-7fd888000000 ---p 00000000 00:00 0
7fd888000000-7fd888102000 rw-p 00000000 00:00 0
7fd888102000-7fd88c000000 ---p 00000000 00:00 0
7fd88c000000-7fd88c021000 rw-p 00000000 00:00 0
7fd88c021000-7fd890000000 ---p 00000000 00:00 0
7fd890000000-7fd890021000 rw-p 00000000 00:00 0
7fd890021000-7fd894000000 ---p 00000000 00:00 0
7fd894000000-7fd89405e000 rw-p 00000000 00:00 0
7fd89405e000-7fd898000000 ---p 00000000 00:00 0
7fd898000000-7fd898021000 rw-p 00000000 00:00 0
7fd898021000-7fd89c000000 ---p 00000000 00:00 0
7fd89c155000-7fd89c15a000 r-xp 00000000 00:23 1048
/usr/lib64/sasl2/libcrammd5.so.3.0.0
7fd89c15a000-7fd89c359000 ---p 00005000 00:23 1048
/usr/lib64/sasl2/libcrammd5.so.3.0.0
7fd89c359000-7fd89c35a000 r--p 00004000 00:23 1048
/usr/lib64/sasl2/libcrammd5.so.3.0.0
7fd89c35a000-7fd89c35b000 rw-p 00005000 00:23 1048
/usr/lib64/sasl2/libcrammd5.so.3.0.0
7fd89c35b000-7fd89c367000 r-xp 00000000 00:23 42
/usr/lib64/libnss_files-2.17.so
7fd89c367000-7fd89c566000 ---p 0000c000 00:23 42
/usr/lib64/libnss_files-2.17.so
7fd89c566000-7fd89c567000 r--p 0000b000 00:23 42
/usr/lib64/libnss_files-2.17.so
7fd89c567000-7fd89c568000 rw-p 0000c000 00:23 42
/usr/lib64/libnss_files-2.17.so
7fd89c568000-7fd89c56e000 rw-p 00000000 00:00 0
7fd89c56e000-7fd89c56f000 ---p 00000000 00:00 0
7fd89c56f000-7fd89cd6f000 rw-p 00000000 00:00 0
[stack:4567]
7fd89cd6f000-7fd89cd70000 ---p 00000000 00:00 0
7fd89cd70000-7fd89d570000 rw-p 00000000 00:00 0
[stack:4566]
7fd89d570000-7fd89d571000 ---p 00000000 00:00 0
7fd89d571000-7fd89dd71000 rw-p 00000000 00:00 0
[stack:4565]
7fd89dd71000-7fd89dd72000 ---p 00000000 00:00 0
7fd89dd72000-7fd89e572000 rw-p 00000000 00:00 0
[stack:4564]
7fd89e572000-7fd89e573000 ---p 00000000 00:00 0
7fd89e573000-7fd89ed73000 rw-p 00000000 00:00 0
[stack:4563]
7fd89ed73000-7fd89ed74000 ---p 00000000 00:00 0
7fd89ed74000-7fd89f574000 rw-p 00000000 00:00 0
[stack:4562]
7fd89f574000-7fd89f575000 ---p 00000000 00:00 0
7fd89f575000-7fd89fd75000 rw-p 00000000 00:00 0
[stack:4561]
7fd89fd75000-7fd89fd76000 ---p 00000000 00:00 0
7fd89fd76000-7fd8a0576000 rw-p 00000000 00:00 0
[stack:4560]
7fd8a0576000-7fd8a0577000 ---p 00000000 00:00 0
7fd8a0577000-7fd8a0d77000 rw-p 00000000 00:00 0
[stack:4559]
7fd8a0d77000-7fd8a0d78000 ---p 00000000 00:00 0
7fd8a0d78000-7fd8a1578000 rw-p 00000000 00:00 0
[stack:4558]
7fd8a1578000-7fd8a1579000 ---p 00000000 00:00 0
7fd8a1579000-7fd8a1d79000 rw-p 00000000 00:00 0
[stack:4557]
7fd8a1d79000-7fd8a1d7a000 ---p 00000000 00:00 0
7fd8a1d7a000-7fd8a257a000 rw-p 00000000 00:00 0
[stack:4556]
7fd8a257a000-7fd8a257b000 ---p 00000000 00:00 0
7fd8a257b000-7fd8a2d7b000 rw-p 00000000 00:00 0
[stack:4555]
7fd8a2d7b000-7fd8a2d7c000 ---p 00000000 00:00 0
7fd8a2d7c000-7fd8a357c000 rw-p 00000000 00:00 0
[stack:4554]
7fd8a357c000-7fd8a357d000 ---p 00000000 00:00 0
7fd8a357d000-7fd8a3d7d000 rw-p 00000000 00:00 0
[stack:4553]
7fd8a3d7d000-7fd8a3d7e000 ---p 00000000 00:00 0
7fd8a3d7e000-7fd8a457e000 rw-p 00000000 00:00 0
[stack:4552]
7fd8a457e000-7fd8a457f000 ---p 00000000 00:00 0
7fd8a457f000-7fd8a4d7f000 rw-p 00000000 00:00 0
[stack:4551]
7fd8a4d7f000-7fd8a4ddf000 r-xp 00000000 00:23 51
/usr/lib64/libpcre.so.1.2.0
7fd8a4ddf000-7fd8a4fde000 ---p 00060000 00:23 51
/usr/lib64/libpcre.so.1.2.0
7fd8a4fde000-7fd8a4fdf000 r--p 0005f000 00:23 51
/usr/lib64/libpcre.so.1.2.0
7fd8a4fdf000-7fd8a4fe0000 rw-p 00060000 00:23 51
/usr/lib64/libpcre.so.1.2.0
7fd8a4fe0000-7fd8a5004000 r-xp 00000000 00:23 336
/usr/lib64/libselinux.so.1
7fd8a5004000-7fd8a5203000 ---p 00024000 00:23 336
/usr/lib64/libselinux.so.1
7fd8a5203000-7fd8a5204000 r--p 00023000 00:23 336
/usr/lib64/libselinux.so.1
7fd8a5204000-7fd8a5205000 rw-p 00024000 00:23 336
/usr/lib64/libselinux.so.1
7fd8a5205000-7fd8a5207000 rw-p 00000000 00:00 0
7fd8a5207000-7fd8a520a000 r-xp 00000000 00:23 985
/usr/lib64/libkeyutils.so.1.5
7fd8a520a000-7fd8a5409000 ---p 00003000 00:23 985
/usr/lib64/libkeyutils.so.1.5
7fd8a5409000-7fd8a540a000 r--p 00002000 00:23 985
/usr/lib64/libkeyutils.so.1.5
7fd8a540a000-7fd8a540b000 rw-p 00003000 00:23 985
/usr/lib64/libkeyutils.so.1.5
7fd8a540b000-7fd8a5418000 r-xp 00000000 00:23 983
/usr/lib64/libkrb5support.so.0.1
7fd8a5418000-7fd8a5618000 ---p 0000d000 00:23 983
/usr/lib64/libkrb5support.so.0.1
7fd8a5618000-7fd8a5619000 r--p 0000d000 00:23 983
/usr/lib64/libkrb5support.so.0.1
7fd8a5619000-7fd8a561a000 rw-p 0000e000 00:23 983
/usr/lib64/libkrb5support.so.0.1
7fd8a561a000-7fd8a57da000 r-xp 00000000 00:23 981
/usr/lib64/libcrypto.so.1.0.1e
7fd8a57da000-7fd8a59da000 ---p 001c0000 00:23 981
/usr/lib64/libcrypto.so.1.0.1e
7fd8a59da000-7fd8a59f4000 r--p 001c0000 00:23 981
/usr/lib64/libcrypto.so.1.0.1e
7fd8a59f4000-7fd8a5a00000 rw-p 001da000 00:23 981
/usr/lib64/libcrypto.so.1.0.1e
7fd8a5a00000-7fd8a5a04000 rw-p 00000000 00:00 0
7fd8a5a04000-7fd8a5a68000 r-xp 00000000 00:23 979
/usr/lib64/libssl.so.1.0.1e
7fd8a5a68000-7fd8a5c67000 ---p 00064000 00:23 979
/usr/lib64/libssl.so.1.0.1e
7fd8a5c67000-7fd8a5c6b000 r--p 00063000 00:23 979
/usr/lib64/libssl.so.1.0.1e
7fd8a5c6b000-7fd8a5c72000 rw-p 00067000 00:23 979
/usr/lib64/libssl.so.1.0.1e
7fd8a5c72000-7fd8a5cc2000 r-xp 00000000 00:23 977
/usr/lib64/libldap-2.4.so.2.10.3
7fd8a5cc2000-7fd8a5ec1000 ---p 00050000 00:23 977
/usr/lib64/libldap-2.4.so.2.10.3
7fd8a5ec1000-7fd8a5ec4000 r--p 0004f000 00:23 977
/usr/lib64/libldap-2.4.so.2.10.3
7fd8a5ec4000-7fd8a5ec5000 rw-p 00052000 00:23 977
/usr/lib64/libldap-2.4.so.2.10.3
7fd8a5ec5000-7fd8a5ed3000 r-xp 00000000 00:23 975
/usr/lib64/liblber-2.4.so.2.10.3
7fd8a5ed3000-7fd8a60d2000 ---p 0000e000 00:23 975
/usr/lib64/liblber-2.4.so.2.10.3
7fd8a60d2000-7fd8a60d3000 r--p 0000d000 00:23 975
/usr/lib64/liblber-2.4.so.2.10.3
7fd8a60d3000-7fd8a60d4000 rw-p 0000e000 00:23 975
/usr/lib64/liblber-2.4.so.2.10.3
7fd8a60d4000-7fd8a60d7000 r-xp 00000000 00:23 973
/usr/lib64/libcom_err.so.2.1
7fd8a60d7000-7fd8a62d6000 ---p 00003000 00:23 973
/usr/lib64/libcom_err.so.2.1
7fd8a62d6000-7fd8a62d7000 r--p 00002000 00:23 973
/usr/lib64/libcom_err.so.2.1
7fd8a62d7000-7fd8a62d8000 rw-p 00003000 00:23 973
/usr/lib64/libcom_err.so.2.1
7fd8a62d8000-7fd8a6307000 r-xp 00000000 00:23 971
/usr/lib64/libk5crypto.so.3.1
7fd8a6307000-7fd8a6506000 ---p 0002f000 00:23 971
/usr/lib64/libk5crypto.so.3.1
7fd8a6506000-7fd8a6508000 r--p 0002e000 00:23 971
/usr/lib64/libk5crypto.so.3.1
7fd8a6508000-7fd8a6509000 rw-p 00030000 00:23 971
/usr/lib64/libk5crypto.so.3.1
7fd8a6509000-7fd8a650a000 rw-p 00000000 00:00 0
7fd8a650a000-7fd8a65e0000 r-xp 00000000 00:23 969
/usr/lib64/libkrb5.so.3.3
7fd8a65e0000-7fd8a67e0000 ---p 000d6000 00:23 969
/usr/lib64/libkrb5.so.3.3
7fd8a67e0000-7fd8a67ee000 r--p 000d6000 00:23 969
/usr/lib64/libkrb5.so.3.3
7fd8a67ee000-7fd8a67f1000 rw-p 000e4000 00:23 969
/usr/lib64/libkrb5.so.3.3
7fd8a67f1000-7fd8a683c000 r-xp 00000000 00:23 967
/usr/lib64/libgssapi_krb5.so.2.2
7fd8a683c000-7fd8a6a3c000 ---p 0004b000 00:23 967
/usr/lib64/libgssapi_krb5.so.2.2
7fd8a6a3c000-7fd8a6a3d000 r--p 0004b000 00:23 967
/usr/lib64/libgssapi_krb5.so.2.2
7fd8a6a3d000-7fd8a6a3f000 rw-p 0004c000 00:23 967
/usr/lib64/libgssapi_krb5.so.2.2
7fd8a6a3f000-7fd8a6a79000 r-xp 00000000 00:23 965
/usr/lib64/libnspr4.so
7fd8a6a79000-7fd8a6c78000 ---p 0003a000 00:23 965
/usr/lib64/libnspr4.so
7fd8a6c78000-7fd8a6c79000 r--p 00039000 00:23 965
/usr/lib64/libnspr4.so
7fd8a6c79000-7fd8a6c7b000 rw-p 0003a000 00:23 965
/usr/lib64/libnspr4.so
7fd8a6c7b000-7fd8a6c7d000 rw-p 00000000 00:00 0
7fd8a6c7d000-7fd8a6c81000 r-xp 00000000 00:23 964
/usr/lib64/libplc4.so
7fd8a6c81000-7fd8a6e80000 ---p 00004000 00:23 964
/usr/lib64/libplc4.so
7fd8a6e80000-7fd8a6e81000 r--p 00003000 00:23 964
/usr/lib64/libplc4.so
7fd8a6e81000-7fd8a6e82000 rw-p 00004000 00:23 964
/usr/lib64/libplc4.so
7fd8a6e82000-7fd8a6e85000 r-xp 00000000 00:23 963
/usr/lib64/libplds4.so
7fd8a6e85000-7fd8a7084000 ---p 00003000 00:23 963
/usr/lib64/libplds4.so
7fd8a7084000-7fd8a7085000 r--p 00002000 00:23 963
/usr/lib64/libplds4.so
7fd8a7085000-7fd8a7086000 rw-p 00003000 00:23 963
/usr/lib64/libplds4.so
7fd8a7086000-7fd8a70ac000 r-xp 00000000 00:23 962
/usr/lib64/libnssutil3.so
7fd8a70ac000-7fd8a72ab000 ---p 00026000 00:23 962
/usr/lib64/libnssutil3.so
7fd8a72ab000-7fd8a72b2000 r--p 00025000 00:23 962
/usr/lib64/libnssutil3.so
7fd8a72b2000-7fd8a72b3000 rw-p 0002c000 00:23 962
/usr/lib64/libnssutil3.so
7fd8a72b3000-7fd8a73d4000 r-xp 00000000 00:23 961
/usr/lib64/libnss3.so
7fd8a73d4000-7fd8a75d4000 ---p 00121000 00:23 961
/usr/lib64/libnss3.so
7fd8a75d4000-7fd8a75d9000 r--p 00121000 00:23 961
/usr/lib64/libnss3.so
7fd8a75d9000-7fd8a75db000 rw-p 00126000 00:23 961
/usr/lib64/libnss3.so
7fd8a75db000-7fd8a75dd000 rw-p 00000000 00:00 0
7fd8a75dd000-7fd8a7601000 r-xp 00000000 00:23 960
/usr/lib64/libsmime3.so
7fd8a7601000-7fd8a7800000 ---p 00024000 00:23 960
/usr/lib64/libsmime3.so
7fd8a7800000-7fd8a7803000 r--p 00023000 00:23 960
/usr/lib64/libsmime3.so
7fd8a7803000-7fd8a7804000 rw-p 00026000 00:23 960
/usr/lib64/libsmime3.so
7fd8a7804000-7fd8a784b000 r-xp 00000000 00:23 959
/usr/lib64/libssl3.so
7fd8a784b000-7fd8a7a4a000 ---p 00047000 00:23 959
/usr/lib64/libssl3.so
7fd8a7a4a000-7fd8a7a4e000 r--p 00046000 00:23 959
/usr/lib64/libssl3.so
7fd8a7a4e000-7fd8a7a4f000 rw-p 0004a000 00:23 959
/usr/lib64/libssl3.so
7fd8a7a4f000-7fd8a7a50000 rw-p 00000000 00:00 0
7fd8a7a50000-7fd8a7a78000 r-xp 00000000 00:23 958
/usr/lib64/libssh2.so.1.0.1
7fd8a7a78000-7fd8a7c78000 ---p 00028000 00:23 958
/usr/lib64/libssh2.so.1.0.1
7fd8a7c78000-7fd8a7c79000 r--p 00028000 00:23 958
/usr/lib64/libssh2.so.1.0.1
7fd8a7c79000-7fd8a7c7a000 rw-p 00029000 00:23 958
/usr/lib64/libssh2.so.1.0.1
7fd8a7c7a000-7fd8a7cac000 r-xp 00000000 00:23 956
/usr/lib64/libidn.so.11.6.11
7fd8a7cac000-7fd8a7eab000 ---p 00032000 00:23 956
/usr/lib64/libidn.so.11.6.11
7fd8a7eab000-7fd8a7eac000 r--p 00031000 00:23 956
/usr/lib64/libidn.so.11.6.11
7fd8a7eac000-7fd8a7ead000 rw-p 00032000 00:23 956
/usr/lib64/libidn.so.11.6.11
7fd8a7ead000-7fd8a7ec3000 r-xp 00000000 00:23 81
/usr/lib64/libresolv-2.17.so
7fd8a7ec3000-7fd8a80c3000 ---p 00016000 00:23 81
/usr/lib64/libresolv-2.17.so
7fd8a80c3000-7fd8a80c4000 r--p 00016000 00:23 81
/usr/lib64/libresolv-2.17.so
7fd8a80c4000-7fd8a80c5000 rw-p 00017000 00:23 81
/usr/lib64/libresolv-2.17.so
7fd8a80c5000-7fd8a80c7000 rw-p 00000000 00:00 0
7fd8a80c7000-7fd8a80cb000 r-xp 00000000 00:23 952
/usr/lib64/libuuid.so.1.3.0
7fd8a80cb000-7fd8a82ca000 ---p 00004000 00:23 952
/usr/lib64/libuuid.so.1.3.0
7fd8a82ca000-7fd8a82cb000 r--p 00003000 00:23 952
/usr/lib64/libuuid.so.1.3.0
7fd8a82cb000-7fd8a82cc000 rw-p 00004000 00:23 952
/usr/lib64/libuuid.so.1.3.0
7fd8a82cc000-7fd8a82e7000 r-xp 00000000 00:23 640
/usr/lib64/libmagic.so.1.0.0
7fd8a82e7000-7fd8a84e7000 ---p 0001b000 00:23 640
/usr/lib64/libmagic.so.1.0.0
7fd8a84e7000-7fd8a84e8000 r--p 0001b000 00:23 640
/usr/lib64/libmagic.so.1.0.0
7fd8a84e8000-7fd8a84e9000 rw-p 0001c000 00:23 640
/usr/lib64/libmagic.so.1.0.0
7fd8a84e9000-7fd8a859a000 r-xp 00000000 00:23 1131
/usr/lib64/libsqlite3.so.0.8.6
7fd8a859a000-7fd8a8799000 ---p 000b1000 00:23 1131
/usr/lib64/libsqlite3.so.0.8.6
7fd8a8799000-7fd8a879b000 r--p 000b0000 00:23 1131
/usr/lib64/libsqlite3.so.0.8.6
7fd8a879b000-7fd8a879e000 rw-p 000b2000 00:23 1131
/usr/lib64/libsqlite3.so.0.8.6
7fd8a879e000-7fd8a87a0000 r-xp 00000000 00:23 90
/usr/lib64/libfreebl3.so
7fd8a87a0000-7fd8a899f000 ---p 00002000 00:23 90
/usr/lib64/libfreebl3.so
7fd8a899f000-7fd8a89a0000 r--p 00001000 00:23 90
/usr/lib64/libfreebl3.so
7fd8a89a0000-7fd8a89a1000 rw-p 00002000 00:23 90
/usr/lib64/libfreebl3.so
7fd8a89a1000-7fd8a8aa1000 r-xp 00000000 00:23 85
/usr/lib64/libm-2.17.so
7fd8a8aa1000-7fd8a8ca1000 ---p 00100000 00:23 85
/usr/lib64/libm-2.17.so
7fd8a8ca1000-7fd8a8ca2000 r--p 00100000 00:23 85
/usr/lib64/libm-2.17.so
7fd8a8ca2000-7fd8a8ca3000 rw-p 00101000 00:23 85
/usr/lib64/libm-2.17.so
7fd8a8ca3000-7fd8a8caa000 r-xp 00000000 00:23 913
/usr/lib64/librt-2.17.so
7fd8a8caa000-7fd8a8ea9000 ---p 00007000 00:23 913
/usr/lib64/librt-2.17.so
7fd8a8ea9000-7fd8a8eaa000 r--p 00006000 00:23 913
/usr/lib64/librt-2.17.so
7fd8a8eaa000-7fd8a8eab000 rw-p 00007000 00:23 913
/usr/lib64/librt-2.17.so
7fd8a8eab000-7fd8a8ead000 r-xp 00000000 00:23 34
/usr/lib64/libdl-2.17.so
7fd8a8ead000-7fd8a90ad000 ---p 00002000 00:23 34
/usr/lib64/libdl-2.17.so
7fd8a90ad000-7fd8a90ae000 r--p 00002000 00:23 34
/usr/lib64/libdl-2.17.so
7fd8a90ae000-7fd8a90af000 rw-p 00003000 00:23 34
/usr/lib64/libdl-2.17.so
7fd8a90af000-7fd8a90dc000 r-xp 00000000 00:23 950
/usr/lib64/libapr-1.so.0.4.8
7fd8a90dc000-7fd8a92dc000 ---p 0002d000 00:23 950
/usr/lib64/libapr-1.so.0.4.8
7fd8a92dc000-7fd8a92dd000 r--p 0002d000 00:23 950
/usr/lib64/libapr-1.so.0.4.8
7fd8a92dd000-7fd8a92de000 rw-p 0002e000 00:23 950
/usr/lib64/libapr-1.so.0.4.8
7fd8a92de000-7fd8a9343000 r-xp 00000000 00:23 954
/usr/lib64/libcurl.so.4.3.0
7fd8a9343000-7fd8a9543000 ---p 00065000 00:23 954
/usr/lib64/libcurl.so.4.3.0
7fd8a9543000-7fd8a9545000 r--p 00065000 00:23 954
/usr/lib64/libcurl.so.4.3.0
7fd8a9545000-7fd8a9546000 rw-p 00067000 00:23 954
/usr/lib64/libcurl.so.4.3.0
7fd8a9546000-7fd8a9547000 rw-p 00000000 00:00 0
7fd8a9547000-7fd8a9563000 r-xp 00000000 00:23 987
/usr/lib64/libsasl2.so.3.0.0
7fd8a9563000-7fd8a9762000 ---p 0001c000 00:23 987
/usr/lib64/libsasl2.so.3.0.0
7fd8a9762000-7fd8a9763000 r--p 0001b000 00:23 987
/usr/lib64/libsasl2.so.3.0.0
7fd8a9763000-7fd8a9764000 rw-p 0001c000 00:23 987
/usr/lib64/libsasl2.so.3.0.0
7fd8a9764000-7fd8a978c000 r-xp 00000000 00:23 1127
/usr/lib64/libaprutil-1.so.0.5.2
7fd8a978c000-7fd8a998b000 ---p 00028000 00:23 1127
/usr/lib64/libaprutil-1.so.0.5.2
7fd8a998b000-7fd8a998c000 r--p 00027000 00:23 1127
/usr/lib64/libaprutil-1.so.0.5.2
7fd8a998c000-7fd8a998d000 rw-p 00028000 00:23 1127
/usr/lib64/libaprutil-1.so.0.5.2
7fd8a998d000-7fd8a99ef000 r-xp 00000000 00:23 1125
/usr/lib64/libsvn_subr-1.so.0.0.0
7fd8a99ef000-7fd8a9bef000 ---p 00062000 00:23 1125
/usr/lib64/libsvn_subr-1.so.0.0.0
7fd8a9bef000-7fd8a9bf2000 r--p 00062000 00:23 1125
/usr/lib64/libsvn_subr-1.so.0.0.0
7fd8a9bf2000-7fd8a9bf3000 rw-p 00065000 00:23 1125
/usr/lib64/libsvn_subr-1.so.0.0.0
7fd8a9bf3000-7fd8a9c00000 r-xp 00000000 00:23 1144
/usr/lib64/libsvn_delta-1.so.0.0.0
7fd8a9c00000-7fd8a9dff000 ---p 0000d000 00:23 1144
/usr/lib64/libsvn_delta-1.so.0.0.0
7fd8a9dff000-7fd8a9e00000 r--p 0000c000 00:23 1144
/usr/lib64/libsvn_delta-1.so.0.0.0
7fd8a9e00000-7fd8a9e01000 rw-p 00000000 00:00 0
7fd8a9e01000-7fd8a9e16000 r-xp 00000000 00:23 53
/usr/lib64/libz.so.1.2.7
7fd8a9e16000-7fd8aa015000 ---p 00015000 00:23 53
/usr/lib64/libz.so.1.2.7
7fd8aa015000-7fd8aa016000 r--p 00014000 00:23 53
/usr/lib64/libz.so.1.2.7
7fd8aa016000-7fd8aa017000 rw-p 00015000 00:23 53
/usr/lib64/libz.so.1.2.7
7fd8aa017000-7fd8aa1cb000 r-xp 00000000 00:23 1062
/usr/lib64/libdb-5.3.so
7fd8aa1cb000-7fd8aa3cb000 ---p 001b4000 00:23 1062
/usr/lib64/libdb-5.3.so
7fd8aa3cb000-7fd8aa3d2000 r--p 001b4000 00:23 1062
/usr/lib64/libdb-5.3.so
7fd8aa3d2000-7fd8aa3d5000 rw-p 001bb000 00:23 1062
/usr/lib64/libdb-5.3.so
7fd8aa3d5000-7fd8aa3fc000 r-xp 00000000 00:23 1129
/usr/lib64/libexpat.so.1.6.0
7fd8aa3fc000-7fd8aa5fc000 ---p 00027000 00:23 1129
/usr/lib64/libexpat.so.1.6.0
7fd8aa5fc000-7fd8aa5fe000 r--p 00027000 00:23 1129
/usr/lib64/libexpat.so.1.6.0
7fd8aa5fe000-7fd8aa5ff000 rw-p 00029000 00:23 1129
/usr/lib64/libexpat.so.1.6.0
7fd8aa5ff000-7fd8aa607000 r-xp 00000000 00:23 87
/usr/lib64/libcrypt-2.17.so
7fd8aa607000-7fd8aa806000 ---p 00008000 00:23 87
/usr/lib64/libcrypt-2.17.so
7fd8aa806000-7fd8aa807000 r--p 00007000 00:23 87
/usr/lib64/libcrypt-2.17.so
7fd8aa807000-7fd8aa808000 rw-p 00008000 00:23 87
/usr/lib64/libcrypt-2.17.so
7fd8aa808000-7fd8aa836000 rw-p 00000000 00:00 0
7fd8aa836000-7fd8aa9ed000 r-xp 00000000 00:23 36
/usr/lib64/libc-2.17.so
7fd8aa9ed000-7fd8aabec000 ---p 001b7000 00:23 36
/usr/lib64/libc-2.17.so
7fd8aabec000-7fd8aabf0000 r--p 001b6000 00:23 36
/usr/lib64/libc-2.17.so
7fd8aabf0000-7fd8aabf2000 rw-p 001ba000 00:23 36
/usr/lib64/libc-2.17.so
7fd8aabf2000-7fd8aabf7000 rw-p 00000000 00:00 0
7fd8aabf7000-7fd8aac0c000 r-xp 00000000 00:23 566
/usr/lib64/libgcc_s-4.8.5-20150702.so.1
7fd8aac0c000-7fd8aae0b000 ---p 00015000 00:23 566
/usr/lib64/libgcc_s-4.8.5-20150702.so.1
7fd8aae0b000-7fd8aae0c000 r--p 00014000 00:23 566
/usr/lib64/libgcc_s-4.8.5-20150702.so.1
7fd8aae0c000-7fd8aae0d000 rw-p 00015000 00:23 566
/usr/lib64/libgcc_s-4.8.5-20150702.so.1
7fd8aae0d000-7fd8aaef6000 r-xp 00000000 00:23 589
/usr/lib64/libstdc++.so.6.0.19
7fd8aaef6000-7fd8ab0f6000 ---p 000e9000 00:23 589
/usr/lib64/libstdc++.so.6.0.19
7fd8ab0f6000-7fd8ab0ff000 r--p 000e9000 00:23 589
/usr/lib64/libstdc++.so.6.0.19
7fd8ab0ff000-7fd8ab101000 rw-p 000f2000 00:23 589
/usr/lib64/libstdc++.so.6.0.19
7fd8ab101000-7fd8ab116000 rw-p 00000000 00:00 0
7fd8ab116000-7fd8ab12d000 r-xp 00000000 00:23 55
/usr/lib64/libpthread-2.17.so
7fd8ab12d000-7fd8ab32c000 ---p 00017000 00:23 55
/usr/lib64/libpthread-2.17.so
7fd8ab32c000-7fd8ab32d000 r--p 00016000 00:23 55
/usr/lib64/libpthread-2.17.so
7fd8ab32d000-7fd8ab32e000 rw-p 00017000 00:23 55
/usr/lib64/libpthread-2.17.so
7fd8ab32e000-7fd8ab332000 rw-p 00000000 00:00 0
7fd8ab332000-7fd8b381a000 r-xp 00000000 00:23 27397
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so
7fd8b381a000-7fd8b3a1a000 ---p 084e8000 00:23 27397
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so
7fd8b3a1a000-7fd8b3ae4000 r--p 084e8000 00:23 27397
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so
7fd8b3ae4000-7fd8b3cdb000 rw-p 085b2000 00:23 27397
/mesos/mesos-1.4.0/_build/src/.libs/libmesos-1.4.0.so
7fd8b3cdb000-7fd8b3d01000 rw-p 00000000 00:00 0
7fd8b3d01000-7fd8b3d21000 r-xp 00000000 00:23 29
/usr/lib64/ld-2.17.so
7fd8b3f21000-7fd8b3f22000 r--p 00020000 00:23 29
/usr/lib64/ld-2.17.so
7fd8b3f22000-7fd8b3f23000 rw-p 00021000 00:23 29
/usr/lib64/ld-2.17.so
7fd8b3f23000-7fd8b3f24000 rw-p 00000000 00:00 0
7fd8b3f24000-7fd8b3fd1000 r-xp 00000000 00:23 28531
/mesos/mesos-1.4.0/_build/src/.libs/lt-dynamic-reservation-framework
7fd8b41aa000-7fd8b41c9000 rw-p 00000000 00:00 0
7fd8b41ca000-7fd8b41cb000 rw-p 00000000 00:00 0
7fd8b41cc000-7fd8b41d0000 rw-p 00000000 00:00 0
7fd8b41d0000-7fd8b41d1000 r--p 000ac000 00:23 28531
/mesos/mesos-1.4.0/_build/src/.libs/lt-dynamic-reservation-framework
7fd8b41d1000-7fd8b41d2000 rw-p 000ad000 00:23 28531
/mesos/mesos-1.4.0/_build/src/.libs/lt-dynamic-reservation-framework
7fd8b5bf7000-7fd8b5ddd000 rw-p 00000000 00:00 0 [heap]
7ffc9a471000-7ffc9a492000 rw-p 00000000 00:00 0 [stack]
7ffc9a4cf000-7ffc9a4d1000 r-xp 00000000 00:00 0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0
[vsyscall]
../../src/tests/script.cpp:83: Failure
Failed
dynamic_reservation_framework_test.sh terminated with signal Aborted
[ FAILED ] ExamplesTest.DynamicReservationFramework (4128 ms)
{code}
> ExamplesTest.DynamicReservationFramework is flaky
> -------------------------------------------------
>
> Key: MESOS-7729
> URL: https://issues.apache.org/jira/browse/MESOS-7729
> Project: Mesos
> Issue Type: Bug
> Reporter: Vinod Kone
> Labels: flaky-test, mesosphere-oncall
>
> Observed this on ASF CI
> {code}
> [ RUN ] ExamplesTest.DynamicReservationFramework
> Using temporary directory
> '/tmp/ExamplesTest_DynamicReservationFramework_uPVIaN'
> /mesos/mesos-1.4.0/src/tests/dynamic_reservation_framework_test.sh: line 19:
> /mesos/mesos-1.4.0/_build/src/colors.sh: No such file or directory
> /mesos/mesos-1.4.0/src/tests/dynamic_reservation_framework_test.sh: line 20:
> /mesos/mesos-1.4.0/_build/src/atexit.sh: No such file or directory
> WARNING: Logging before InitGoogleLogging() is written to STDERR
> I0627 16:04:20.661948 8847 process.cpp:1282] libprocess is initialized on
> 172.17.0.3:37113 with 16 worker threads
> I0627 16:04:20.662199 8847 logging.cpp:199] Logging to STDERR
> I0627 16:04:20.674317 8847 leveldb.cpp:174] Opened db in 3.343216ms
> I0627 16:04:20.675655 8847 leveldb.cpp:181] Compacted db in 1.264481ms
> I0627 16:04:20.675797 8847 leveldb.cpp:196] Created db iterator in 89655ns
> I0627 16:04:20.675829 8847 leveldb.cpp:202] Seeked to beginning of db in
> 5551ns
> I0627 16:04:20.675848 8847 leveldb.cpp:271] Iterated through 0 keys in the
> db in 1133ns
> I0627 16:04:20.676103 8847 replica.cpp:779] Replica recovered with log
> positions 0 -> 0 with 1 holes and 0 unlearned
> I0627 16:04:20.680465 8873 recover.cpp:451] Starting replica recovery
> I0627 16:04:20.681649 8873 recover.cpp:477] Replica is in EMPTY status
> I0627 16:04:20.682160 8847 local.cpp:272] Creating default 'local' authorizer
> I0627 16:04:20.684504 8884 replica.cpp:676] Replica in EMPTY status received
> a broadcasted recover request from __req_res__(1)@172.17.0.3:37113
> I0627 16:04:20.685750 8882 recover.cpp:197] Received a recover response from
> a replica in EMPTY status
> I0627 16:04:20.686617 8877 recover.cpp:568] Updating replica status to
> STARTING
> I0627 16:04:20.688508 8877 leveldb.cpp:304] Persisting metadata (8 bytes) to
> leveldb took 741914ns
> I0627 16:04:20.688544 8881 master.cpp:438] Master
> c1c3a180-5bd3-42fa-b84e-e2c30aba7364 (089cb2cc2625) started on
> 172.17.0.3:37113
> I0627 16:04:20.688551 8877 replica.cpp:322] Persisted replica status to
> STARTING
> I0627 16:04:20.689095 8878 recover.cpp:477] Replica is in STARTING status
> I0627 16:04:20.688582 8881 master.cpp:440] Flags at startup:
> --acls="permissive: true
> register_frameworks {
> principals {
> type: ANY
> }
> roles {
> type: SOME
> values: "test"
> }
> }
> " --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins"
> --allocation_interval="1secs" --allocator="HierarchicalDRF"
> --authenticate_agents="false" --authenticate_frameworks="false"
> --authenticate_http_frameworks="false" --authenticate_http_readonly="false"
> --authenticate_http_readwrite="false" --authenticators="crammd5"
> --authorizers="local"
> --credentials="/tmp/ExamplesTest_DynamicReservationFramework_uPVIaN/credentials"
> --filter_gpu_resources="true" --framework_sorter="drf" --help="false"
> --hostname_lookup="true" --http_authenticators="basic"
> --initialize_driver_logging="true" --log_auto_initialize="true"
> --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5"
> --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000"
> --max_unreachable_tasks_per_framework="1000" --port="5050" --quiet="false"
> --recovery_agent_removal_limit="100%" --registry="replicated_log"
> --registry_fetch_timeout="1mins" --registry_gc_interval="15mins"
> --registry_max_agent_age="2weeks" --registry_max_agent_count="102400"
> --registry_store_timeout="20secs" --registry_strict="false"
> --root_submissions="true" --user_sorter="drf" --version="false"
> --webui_dir="/mesos/mesos-1.4.0/src/webui"
> --work_dir="/tmp/mesos-9H3Est/master" --zk_session_timeout="10secs"
> I0627 16:04:20.689460 8881 master.cpp:492] Master allowing unauthenticated
> frameworks to register
> I0627 16:04:20.689476 8881 master.cpp:506] Master allowing unauthenticated
> agents to register
> I0627 16:04:20.689482 8881 master.cpp:520] Master allowing HTTP frameworks
> to register without authentication
> I0627 16:04:20.689494 8881 credentials.hpp:37] Loading credentials for
> authentication from
> '/tmp/ExamplesTest_DynamicReservationFramework_uPVIaN/credentials'
> W0627 16:04:20.689620 8881 credentials.hpp:52] Permissions on credentials
> file '/tmp/ExamplesTest_DynamicReservationFramework_uPVIaN/credentials' are
> too open; it is recommended that your credentials file is NOT accessible by
> others
> I0627 16:04:20.689817 8881 master.cpp:562] Using default 'crammd5'
> authenticator
> I0627 16:04:20.690021 8881 authenticator.cpp:520] Initializing server SASL
> I0627 16:04:20.690615 8878 replica.cpp:676] Replica in STARTING status
> received a broadcasted recover request from __req_res__(2)@172.17.0.3:37113
> I0627 16:04:20.691058 8877 recover.cpp:197] Received a recover response from
> a replica in STARTING status
> I0627 16:04:20.691951 8885 recover.cpp:568] Updating replica status to VOTING
> I0627 16:04:20.692548 8881 auxprop.cpp:73] Initialized in-memory auxiliary
> property plugin
> I0627 16:04:20.692679 8881 master.cpp:642] Authorization enabled
> I0627 16:04:20.692991 8872 leveldb.cpp:304] Persisting metadata (8 bytes) to
> leveldb took 525491ns
> I0627 16:04:20.693245 8872 replica.cpp:322] Persisted replica status to
> VOTING
> I0627 16:04:20.693567 8882 recover.cpp:582] Successfully joined the Paxos
> group
> I0627 16:04:20.693084 8876 hierarchical.cpp:169] Initialized hierarchical
> allocator process
> I0627 16:04:20.693971 8882 recover.cpp:466] Recover process terminated
> I0627 16:04:20.693136 8885 whitelist_watcher.cpp:77] No whitelist given
> I0627 16:04:20.695565 8847 resolver.cpp:69] Creating default secret resolver
> I0627 16:04:20.696056 8847 containerizer.cpp:230] Using isolation:
> filesystem/posix,posix/cpu,posix/mem,network/cni,environment_secret
> W0627 16:04:20.697029 8847 backend.cpp:76] Failed to create 'aufs' backend:
> AufsBackend requires root privileges
> W0627 16:04:20.697257 8847 backend.cpp:76] Failed to create 'bind' backend:
> BindBackend requires root privileges
> I0627 16:04:20.697340 8847 provisioner.cpp:255] Using default backend 'copy'
> I0627 16:04:20.702487 8878 slave.cpp:249] Mesos agent started on
> (1)@172.17.0.3:37113
> I0627 16:04:20.702535 8878 slave.cpp:250] Flags at startup:
> --acls="permissive: true
> register_frameworks {
> principals {
> type: ANY
> }
> roles {
> type: SOME
> values: "test"
> }
> }
> " --appc_simple_discovery_uri_prefix="http://";
> --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="false"
> --authenticate_http_readwrite="false" --authenticatee="crammd5"
> --authentication_backoff_factor="1secs" --authorizer="local"
> --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false"
> --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false"
> --cgroups_root="mesos" --container_disk_watch_interval="15secs"
> --containerizers="mesos" --default_role="*" --disk_watch_interval="1mins"
> --docker="docker" --docker_kill_orphans="true"
> --docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs"
> --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns"
> --docker_store_dir="/tmp/mesos/store/docker"
> --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume"
> --enforce_container_disk_quota="false"
> --executor_registration_timeout="1mins"
> --executor_reregistration_timeout="2secs"
> --executor_shutdown_grace_period="5secs"
> --fetcher_cache_dir="/tmp/mesos-9H3Est/agents/0/fetch"
> --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
> --gc_disk_headroom="0.1" --hadoop_home="" --help="false"
> --hostname_lookup="true" --http_command_executor="false"
> --http_heartbeat_interval="30secs" --initialize_driver_logging="true"
> --isolation="filesystem/posix,posix/cpu,posix/mem" --launcher="posix"
> --launcher_dir="/mesos/mesos-1.4.0/_build/src" --logbufsecs="0"
> --logging_level="INFO" --max_completed_executors_per_framework="150"
> --oversubscribed_resources_interval="15secs" --perf_duration="10secs"
> --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns"
> --quiet="false" --recover="reconnect" --recovery_timeout="15mins"
> --registration_backoff_factor="1secs" --revocable_cpu_low_priority="true"
> --runtime_dir="/tmp/mesos-9H3Est/agents/0/run"
> --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true"
> --systemd_enable_support="true"
> --systemd_runtime_directory="/run/systemd/system" --version="false"
> --work_dir="/tmp/mesos-9H3Est/agents/0/work"
> I0627 16:04:20.706677 8847 resolver.cpp:69] Creating default secret resolver
> I0627 16:04:20.707231 8847 containerizer.cpp:230] Using isolation:
> filesystem/posix,posix/cpu,posix/mem,network/cni,environment_secret
> W0627 16:04:20.708060 8847 backend.cpp:76] Failed to create 'aufs' backend:
> AufsBackend requires root privileges
> W0627 16:04:20.708179 8847 backend.cpp:76] Failed to create 'bind' backend:
> BindBackend requires root privileges
> I0627 16:04:20.708231 8847 provisioner.cpp:255] Using default backend 'copy'
> I0627 16:04:20.710345 8881 master.cpp:2161] Elected as the leading master!
> I0627 16:04:20.710400 8881 master.cpp:1700] Recovering from registrar
> I0627 16:04:20.710644 8886 registrar.cpp:345] Recovering registrar
> I0627 16:04:20.711997 8881 log.cpp:536] Attempting to start the writer
> I0627 16:04:20.714257 8880 slave.cpp:249] Mesos agent started on
> (2)@172.17.0.3:37113
> I0627 16:04:20.714516 8880 slave.cpp:250] Flags at startup:
> --acls="permissive: true
> register_frameworks {
> principals {
> type: ANY
> }
> roles {
> type: SOME
> values: "test"
> }
> }
> " --appc_simple_discovery_uri_prefix="http://";
> --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="false"
> --authenticate_http_readwrite="false" --authenticatee="crammd5"
> --authentication_backoff_factor="1secs" --authorizer="local"
> --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false"
> --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false"
> --cgroups_root="mesos" --container_disk_watch_interval="15secs"
> --containerizers="mesos" --default_role="*" --disk_watch_interval="1mins"
> --docker="docker" --docker_kill_orphans="true"
> --docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs"
> --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns"
> --docker_store_dir="/tmp/mesos/store/docker"
> --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume"
> --enforce_container_disk_quota="false"
> --executor_registration_timeout="1mins"
> --executor_reregistration_timeout="2secs"
> --executor_shutdown_grace_period="5secs"
> --fetcher_cache_dir="/tmp/mesos-9H3Est/agents/1/fetch"
> --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
> --gc_disk_headroom="0.1" --hadoop_home="" --help="false"
> --hostname_lookup="true" --http_command_executor="false"
> --http_heartbeat_interval="30secs" --initialize_driver_logging="true"
> --isolation="filesystem/posix,posix/cpu,posix/mem" --launcher="posix"
> --launcher_dir="/mesos/mesos-1.4.0/_build/src" --logbufsecs="0"
> --logging_level="INFO" --max_completed_executors_per_framework="150"
> --oversubscribed_resources_interval="15secs" --perf_duration="10secs"
> --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns"
> --quiet="false" --recover="reconnect" --recovery_timeout="15mins"
> --registration_backoff_factor="1secs" --revocable_cpu_low_priority="true"
> --runtime_dir="/tmp/mesos-9H3Est/agents/1/run"
> --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true"
> --systemd_enable_support="true"
> --systemd_runtime_directory="/run/systemd/system" --version="false"
> --work_dir="/tmp/mesos-9H3Est/agents/1/work"
> I0627 16:04:20.715459 8884 replica.cpp:496] Replica received implicit
> promise request from __req_res__(3)@172.17.0.3:37113 with proposal 1
> I0627 16:04:20.716228 8884 leveldb.cpp:304] Persisting metadata (8 bytes) to
> leveldb took 693410ns
> I0627 16:04:20.716259 8884 replica.cpp:344] Persisted promised to 1
> I0627 16:04:20.717954 8875 coordinator.cpp:238] Coordinator attempting to
> fill missing positions
> I0627 16:04:20.718142 8847 resolver.cpp:69] Creating default secret resolver
> I0627 16:04:20.718848 8847 containerizer.cpp:230] Using isolation:
> filesystem/posix,posix/cpu,posix/mem,network/cni,environment_secret
> W0627 16:04:20.719561 8847 backend.cpp:76] Failed to create 'aufs' backend:
> AufsBackend requires root privileges
> W0627 16:04:20.719844 8847 backend.cpp:76] Failed to create 'bind' backend:
> BindBackend requires root privileges
> I0627 16:04:20.719885 8847 provisioner.cpp:255] Using default backend 'copy'
> I0627 16:04:20.721727 8872 replica.cpp:391] Replica received explicit
> promise request from __req_res__(4)@172.17.0.3:37113 for position 0 with
> proposal 2
> I0627 16:04:20.722569 8872 leveldb.cpp:341] Persisting action (8 bytes) to
> leveldb took 685913ns
> I0627 16:04:20.722607 8872 replica.cpp:711] Persisted action NOP at position > 0
> I0627 16:04:20.724098 8872 slave.cpp:249] Mesos agent started on
> (3)@172.17.0.3:37113
> I0627 16:04:20.724123 8872 slave.cpp:250] Flags at startup:
> --acls="permissive: true
> register_frameworks {
> principals {
> type: ANY
> }
> roles {
> type: SOME
> values: "test"
> }
> }
> " --appc_simple_discovery_uri_prefix="http://";
> --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="false"
> --authenticate_http_readwrite="false" --authenticatee="crammd5"
> --authentication_backoff_factor="1secs" --authorizer="local"
> --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false"
> --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false"
> --cgroups_root="mesos" --container_disk_watch_interval="15secs"
> --containerizers="mesos" --default_role="*" --disk_watch_interval="1mins"
> --docker="docker" --docker_kill_orphans="true"
> --docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs"
> --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns"
> --docker_store_dir="/tmp/mesos/store/docker"
> --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume"
> --enforce_container_disk_quota="false"
> --executor_registration_timeout="1mins"
> --executor_reregistration_timeout="2secs"
> --executor_shutdown_grace_period="5secs"
> --fetcher_cache_dir="/tmp/mesos-9H3Est/agents/2/fetch"
> --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
> --gc_disk_headroom="0.1" --hadoop_home="" --help="false"
> --hostname_lookup="true" --http_command_executor="false"
> --http_heartbeat_interval="30secs" --initialize_driver_logging="true"
> --isolation="filesystem/posix,posix/cpu,posix/mem" --launcher="posix"
> --launcher_dir="/mesos/mesos-1.4.0/_build/src" --logbufsecs="0"
> --logging_level="INFO" --max_completed_executors_per_framework="150"
> --oversubscribed_resources_interval="15secs" --perf_duration="10secs"
> --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns"
> --quiet="false" --recover="reconnect" --recovery_timeout="15mins"
> --registration_backoff_factor="1secs" --revocable_cpu_low_priority="true"
> --runtime_dir="/tmp/mesos-9H3Est/agents/2/run"
> --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true"
> --systemd_enable_support="true"
> --systemd_runtime_directory="/run/systemd/system" --version="false"
> --work_dir="/tmp/mesos-9H3Est/agents/2/work"
> I0627 16:04:20.725759 8847 sched.cpp:232] Version: 1.4.0
> I0627 16:04:20.727453 8877 replica.cpp:540] Replica received write request
> for position 0 from __req_res__(5)@172.17.0.3:37113
> I0627 16:04:20.727560 8877 leveldb.cpp:436] Reading position from leveldb
> took 65766ns
> I0627 16:04:20.727771 8884 sched.cpp:336] New master detected at
> [email protected]:37113
> I0627 16:04:20.728091 8877 leveldb.cpp:341] Persisting action (14 bytes) to
> leveldb took 432923ns
> I0627 16:04:20.728114 8877 replica.cpp:711] Persisted action NOP at position > 0
> I0627 16:04:20.728425 8884 sched.cpp:352] No credentials provided.
> Attempting to register without authentication
> I0627 16:04:20.728458 8884 sched.cpp:836] Sending SUBSCRIBE call to
> [email protected]:37113
> I0627 16:04:20.729207 8876 replica.cpp:694] Replica received learned notice
> for position 0 from @0.0.0.0:0
> I0627 16:04:20.729523 8884 sched.cpp:869] Will retry registration in
> 1.548772469secs if necessary
> I0627 16:04:20.729578 8887 master.cpp:1523] Dropping 'mesos.scheduler.Call'
> message since not recovered yet
> I0627 16:04:20.729859 8876 leveldb.cpp:341] Persisting action (16 bytes) to
> leveldb took 594682ns
> I0627 16:04:20.729890 8876 replica.cpp:711] Persisted action NOP at position > 0
> I0627 16:04:20.730602 8882 log.cpp:552] Writer started with ending position 0
> I0627 16:04:20.704807 8878 slave.cpp:553] Agent resources:
> [{"name":"cpus","scalar":{"value":16.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":47270.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":3701220.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
> I0627 16:04:20.716545 8880 slave.cpp:553] Agent resources:
> [{"name":"cpus","scalar":{"value":16.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":47270.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":3701220.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
> I0627 16:04:20.732960 8880 slave.cpp:561] Agent attributes: [ ]
> I0627 16:04:20.733045 8878 slave.cpp:561] Agent attributes: [ ]
> I0627 16:04:20.730206 8872 slave.cpp:553] Agent resources:
> [{"name":"cpus","scalar":{"value":16.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":47270.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":3701220.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
> I0627 16:04:20.733058 8880 slave.cpp:566] Agent hostname: 089cb2cc2625
> I0627 16:04:20.733126 8872 slave.cpp:561] Agent attributes: [ ]
> I0627 16:04:20.733155 8872 slave.cpp:566] Agent hostname: 089cb2cc2625
> I0627 16:04:20.733086 8878 slave.cpp:566] Agent hostname: 089cb2cc2625
> I0627 16:04:20.733321 8879 leveldb.cpp:436] Reading position from leveldb
> took 79459ns
> I0627 16:04:20.733381 8887 status_update_manager.cpp:177] Pausing sending
> status updates
> I0627 16:04:20.733424 8887 status_update_manager.cpp:177] Pausing sending
> status updates
> I0627 16:04:20.733777 8887 status_update_manager.cpp:177] Pausing sending
> status updates
> I0627 16:04:20.737633 8885 state.cpp:64] Recovering state from
> '/tmp/mesos-9H3Est/agents/2/work/meta'
> I0627 16:04:20.738603 8874 status_update_manager.cpp:203] Recovering status
> update manager
> *** Error in
> `/mesos/mesos-1.4.0/_build/src/.libs/lt-dynamic-reservation-framework':
> double free or corruption (fasttop): 0x00002b7eac002ae0 ***
> ../../src/tests/script.cpp:83: Failure
> Failed
> dynamic_reservation_framework_test.sh terminated with signal Aborted
> [ FAILED ] ExamplesTest.DynamicReservationFramework (2904 ms)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
