Benjamin Mahler created MESOS-8134:
--------------------------------------
Summary: SlaveTest.ContainersEndpoint is flaky due to getenv crash.
Key: MESOS-8134
URL: https://issues.apache.org/jira/browse/MESOS-8134
Project: Mesos
Issue Type: Bug
Components: test
Reporter: Benjamin Mahler
Looks like this test also has the getenv during setenv crash:
{noformat}
[ RUN ] SlaveTest.ContainersEndpoint
I1025 04:02:53.061488 6805 cluster.cpp:162] Creating default 'local' authorizer
I1025 04:02:53.065587 6824 master.cpp:445] Master
2dc7ad46-f111-4762-9bf6-ef428a6f6d53 (a4020869f68c) started on 172.17.0.2:38626
I1025 04:02:53.065665 6824 master.cpp:447] Flags at startup: --acls=""
--agent_ping_timeout="15secs" --agent_reregister_timeout="10mins"
--allocation_interval="1secs" --allocator="HierarchicalDRF"
--authenticate_agents="true" --authenticate_frameworks="true"
--authenticate_http_frameworks="true" --authenticate_http_readonly="true"
--authenticate_http_readwrite="true" --authenticators="crammd5"
--authorizers="local" --credentials="/tmp/lq9Ngb/credentials"
--filter_gpu_resources="true" --framework_sorter="drf" --help="false"
--hostname_lookup="true" --http_authenticators="basic"
--http_framework_authenticators="basic" --initialize_driver_logging="true"
--log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO"
--max_agent_ping_timeouts="5" --max_completed_frameworks="50"
--max_completed_tasks_per_framework="1000"
--max_unreachable_tasks_per_framework="1000" --port="5050" --quiet="false"
--recovery_agent_removal_limit="100%" --registry="in_memory"
--registry_fetch_timeout="1mins" --registry_gc_interval="15mins"
--registry_max_agent_age="2weeks" --registry_max_agent_count="102400"
--registry_store_timeout="100secs" --registry_strict="false"
--root_submissions="true" --user_sorter="drf" --version="false"
--webui_dir="/mesos/mesos-1.5.0/_inst/share/mesos/webui"
--work_dir="/tmp/lq9Ngb/master" --zk_session_timeout="10secs"
I1025 04:02:53.066131 6824 master.cpp:496] Master only allowing authenticated
frameworks to register
I1025 04:02:53.066145 6824 master.cpp:502] Master only allowing authenticated
agents to register
I1025 04:02:53.066153 6824 master.cpp:508] Master only allowing authenticated
HTTP frameworks to register
I1025 04:02:53.066165 6824 credentials.hpp:37] Loading credentials for
authentication from '/tmp/lq9Ngb/credentials'
I1025 04:02:53.066561 6824 master.cpp:552] Using default 'crammd5'
authenticator
I1025 04:02:53.066746 6824 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-master-readonly'
I1025 04:02:53.066949 6824 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-master-readwrite'
I1025 04:02:53.067095 6824 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-master-scheduler'
I1025 04:02:53.067230 6824 master.cpp:631] Authorization enabled
I1025 04:02:53.067430 6818 hierarchical.cpp:171] Initialized hierarchical
allocator process
I1025 04:02:53.067477 6807 whitelist_watcher.cpp:77] No whitelist given
I1025 04:02:53.070369 6825 master.cpp:2198] Elected as the leading master!
I1025 04:02:53.070421 6825 master.cpp:1687] Recovering from registrar
I1025 04:02:53.070796 6816 registrar.cpp:347] Recovering registrar
I1025 04:02:53.071532 6816 registrar.cpp:391] Successfully fetched the
registry (0B) in 690944ns
I1025 04:02:53.071671 6816 registrar.cpp:495] Applied 1 operations in 54316ns;
attempting to update the registry
I1025 04:02:53.072278 6816 registrar.cpp:552] Successfully updated the
registry in 538880ns
I1025 04:02:53.072394 6816 registrar.cpp:424] Successfully recovered registrar
I1025 04:02:53.072808 6823 master.cpp:1791] Recovered 0 agents from the
registry (129B); allowing 10mins for agents to re-register
I1025 04:02:53.072983 6828 hierarchical.cpp:209] Skipping recovery of
hierarchical allocator: nothing to recover
W1025 04:02:53.077972 6805 process.cpp:3193] Attempted to spawn already
running process [email protected]:38626
I1025 04:02:53.078305 6805 cluster.cpp:448] Creating default 'local' authorizer
I1025 04:02:53.080204 6811 slave.cpp:254] Mesos agent started on
(539)@172.17.0.2:38626
I1025 04:02:53.080246 6811 slave.cpp:255] Flags at startup: --acls=""
--appc_simple_discovery_uri_prefix="http://";
--appc_store_dir="/tmp/SlaveTest_ContainersEndpoint_kzLnW6/store/appc"
--authenticate_http_executors="true" --authenticate_http_readonly="true"
--authenticate_http_readwrite="true" --authenticatee="crammd5"
--authentication_backoff_factor="1secs" --authorizer="local"
--cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false"
--cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false"
--cgroups_root="mesos" --container_disk_watch_interval="15secs"
--containerizers="mesos"
--credential="/tmp/SlaveTest_ContainersEndpoint_kzLnW6/credential"
--default_role="*" --disallow_sharing_agent_pid_namespace="false"
--disk_watch_interval="1mins" --docker="docker" --docker_kill_orphans="true"
--docker_registry="https://registry-1.docker.io"; --docker_remove_delay="6hrs"
--docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns"
--docker_store_dir="/tmp/SlaveTest_ContainersEndpoint_kzLnW6/store/docker"
--docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume"
--enforce_container_disk_quota="false" --executor_registration_timeout="1mins"
--executor_reregistration_timeout="2secs"
--executor_secret_key="/tmp/SlaveTest_ContainersEndpoint_kzLnW6/executor_secret_key"
--executor_shutdown_grace_period="5secs"
--fetcher_cache_dir="/tmp/SlaveTest_ContainersEndpoint_kzLnW6/fetch"
--fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
--gc_disk_headroom="0.1" --hadoop_home="" --help="false"
--hostname_lookup="true" --http_command_executor="false"
--http_credentials="/tmp/SlaveTest_ContainersEndpoint_kzLnW6/http_credentials"
--http_heartbeat_interval="30secs" --initialize_driver_logging="true"
--isolation="posix/cpu,posix/mem" --launcher="posix"
--launcher_dir="/mesos/mesos-1.5.0/_build/src" --logbufsecs="0"
--logging_level="INFO" --max_completed_executors_per_framework="150"
--oversubscribed_resources_interval="15secs" --perf_duration="10secs"
--perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns"
--quiet="false" --recover="reconnect" --recovery_timeout="15mins"
--registration_backoff_factor="10ms"
--resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]"
--revocable_cpu_low_priority="true"
--runtime_dir="/tmp/SlaveTest_ContainersEndpoint_kzLnW6"
--sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true"
--systemd_enable_support="true"
--systemd_runtime_directory="/run/systemd/system" --version="false"
--work_dir="/tmp/SlaveTest_ContainersEndpoint_RzfA6D"
--zk_session_timeout="10secs"
I1025 04:02:53.080750 6811 credentials.hpp:86] Loading credential for
authentication from '/tmp/SlaveTest_ContainersEndpoint_kzLnW6/credential'
W1025 04:02:53.080813 6805 process.cpp:3193] Attempted to spawn already
running process [email protected]:38626
I1025 04:02:53.080951 6811 slave.cpp:287] Agent using credential for:
test-principal
I1025 04:02:53.080979 6811 credentials.hpp:37] Loading credentials for
authentication from '/tmp/SlaveTest_ContainersEndpoint_kzLnW6/http_credentials'
I1025 04:02:53.081332 6811 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-agent-executor'
I1025 04:02:53.081487 6811 http.cpp:1066] Creating default 'jwt' HTTP
authenticator for realm 'mesos-agent-executor'
I1025 04:02:53.081723 6811 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-agent-readonly'
I1025 04:02:53.081825 6811 http.cpp:1066] Creating default 'jwt' HTTP
authenticator for realm 'mesos-agent-readonly'
I1025 04:02:53.081881 6805 sched.cpp:232] Version: 1.5.0
I1025 04:02:53.082005 6811 http.cpp:1045] Creating default 'basic' HTTP
authenticator for realm 'mesos-agent-readwrite'
I1025 04:02:53.082109 6811 http.cpp:1066] Creating default 'jwt' HTTP
authenticator for realm 'mesos-agent-readwrite'
I1025 04:02:53.082706 6810 sched.cpp:336] New master detected at
[email protected]:38626
I1025 04:02:53.082825 6810 sched.cpp:396] Authenticating with master
[email protected]:38626
I1025 04:02:53.082901 6810 sched.cpp:403] Using default CRAM-MD5 authenticatee
I1025 04:02:53.083366 6822 authenticatee.cpp:121] Creating new client SASL
connection
I1025 04:02:53.083696 6808 master.cpp:7947] Authenticating
[email protected]:38626
I1025 04:02:53.083904 6808 authenticator.cpp:414] Starting authentication
session for crammd5-authenticatee(1077)@172.17.0.2:38626
I1025 04:02:53.083873 6811 slave.cpp:585] Agent resources:
[{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
I1025 04:02:53.084163 6811 slave.cpp:593] Agent attributes: [ ]
I1025 04:02:53.084215 6827 authenticator.cpp:98] Creating new server SASL
connection
I1025 04:02:53.084241 6811 slave.cpp:602] Agent hostname: a4020869f68c
I1025 04:02:53.084460 6823 status_update_manager.cpp:177] Pausing sending
status updates
I1025 04:02:53.084522 6827 authenticatee.cpp:213] Received SASL authentication
mechanisms: CRAM-MD5
I1025 04:02:53.084548 6827 authenticatee.cpp:239] Attempting to authenticate
with mechanism 'CRAM-MD5'
I1025 04:02:53.084641 6807 authenticator.cpp:204] Received SASL authentication
start
I1025 04:02:53.084709 6807 authenticator.cpp:326] Authentication requires more
steps
I1025 04:02:53.084834 6820 authenticatee.cpp:259] Received SASL authentication
step
I1025 04:02:53.085031 6814 authenticator.cpp:232] Received SASL authentication
step
I1025 04:02:53.085105 6814 auxprop.cpp:109] Request to lookup properties for
user: 'test-principal' realm: 'a4020869f68c' server FQDN: 'a4020869f68c'
SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
SASL_AUXPROP_AUTHZID: false
I1025 04:02:53.085129 6814 auxprop.cpp:181] Looking up auxiliary property
'*userPassword'
I1025 04:02:53.085182 6814 auxprop.cpp:181] Looking up auxiliary property
'*cmusaslsecretCRAM-MD5'
I1025 04:02:53.085214 6814 auxprop.cpp:109] Request to lookup properties for
user: 'test-principal' realm: 'a4020869f68c' server FQDN: 'a4020869f68c'
SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
SASL_AUXPROP_AUTHZID: true
I1025 04:02:53.085232 6814 auxprop.cpp:131] Skipping auxiliary property
'*userPassword' since SASL_AUXPROP_AUTHZID == true
I1025 04:02:53.085247 6814 auxprop.cpp:131] Skipping auxiliary property
'*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
I1025 04:02:53.085270 6814 authenticator.cpp:318] Authentication success
I1025 04:02:53.085429 6817 master.cpp:7977] Successfully authenticated
principal 'test-principal' at
[email protected]:38626
I1025 04:02:53.085454 6818 authenticator.cpp:432] Authentication session
cleanup for crammd5-authenticatee(1077)@172.17.0.2:38626
I1025 04:02:53.085482 6820 authenticatee.cpp:299] Authentication success
I1025 04:02:53.085904 6820 sched.cpp:502] Successfully authenticated with
master [email protected]:38626
I1025 04:02:53.085937 6820 sched.cpp:820] Sending SUBSCRIBE call to
[email protected]:38626
I1025 04:02:53.086078 6820 sched.cpp:853] Will retry registration in
466.181463ms if necessary
I1025 04:02:53.086318 6810 master.cpp:2929] Received SUBSCRIBE call for
framework 'default' at
[email protected]:38626
I1025 04:02:53.086372 6810 master.cpp:2263] Authorizing framework principal
'test-principal' to receive offers for roles '{ * }'
I1025 04:02:53.086642 6822 state.cpp:64] Recovering state from
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/meta'
I1025 04:02:53.086926 6812 status_update_manager.cpp:203] Recovering status
update manager
I1025 04:02:53.087033 6808 master.cpp:3009] Subscribing framework default with
checkpointing disabled and capabilities [ RESERVATION_REFINEMENT ]
I1025 04:02:53.087266 6806 slave.cpp:6310] Finished recovery
I1025 04:02:53.087702 6809 sched.cpp:747] Framework registered with
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000
I1025 04:02:53.087786 6809 sched.cpp:761] Scheduler::registered took 38714ns
I1025 04:02:53.087977 6826 hierarchical.cpp:303] Added framework
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000
I1025 04:02:53.088042 6814 status_update_manager.cpp:177] Pausing sending
status updates
I1025 04:02:53.088057 6825 slave.cpp:993] New master detected at
[email protected]:38626
I1025 04:02:53.088184 6825 slave.cpp:1028] Detecting new master
I1025 04:02:53.088302 6826 hierarchical.cpp:1488] Performed allocation for 0
agents in 115530ns
I1025 04:02:53.096532 6818 slave.cpp:1055] Authenticating with master
[email protected]:38626
I1025 04:02:53.096709 6818 slave.cpp:1064] Using default CRAM-MD5 authenticatee
I1025 04:02:53.097173 6818 authenticatee.cpp:121] Creating new client SASL
connection
I1025 04:02:53.097568 6810 master.cpp:7947] Authenticating
slave(539)@172.17.0.2:38626
I1025 04:02:53.097718 6819 authenticator.cpp:414] Starting authentication
session for crammd5-authenticatee(1078)@172.17.0.2:38626
I1025 04:02:53.098012 6822 authenticator.cpp:98] Creating new server SASL
connection
I1025 04:02:53.098245 6821 authenticatee.cpp:213] Received SASL authentication
mechanisms: CRAM-MD5
I1025 04:02:53.098291 6821 authenticatee.cpp:239] Attempting to authenticate
with mechanism 'CRAM-MD5'
I1025 04:02:53.098415 6815 authenticator.cpp:204] Received SASL authentication
start
I1025 04:02:53.098482 6815 authenticator.cpp:326] Authentication requires more
steps
I1025 04:02:53.098582 6815 authenticatee.cpp:259] Received SASL authentication
step
I1025 04:02:53.098703 6823 authenticator.cpp:232] Received SASL authentication
step
I1025 04:02:53.098743 6823 auxprop.cpp:109] Request to lookup properties for
user: 'test-principal' realm: 'a4020869f68c' server FQDN: 'a4020869f68c'
SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
SASL_AUXPROP_AUTHZID: false
I1025 04:02:53.098767 6823 auxprop.cpp:181] Looking up auxiliary property
'*userPassword'
I1025 04:02:53.098829 6823 auxprop.cpp:181] Looking up auxiliary property
'*cmusaslsecretCRAM-MD5'
I1025 04:02:53.098866 6823 auxprop.cpp:109] Request to lookup properties for
user: 'test-principal' realm: 'a4020869f68c' server FQDN: 'a4020869f68c'
SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false
SASL_AUXPROP_AUTHZID: true
I1025 04:02:53.098886 6823 auxprop.cpp:131] Skipping auxiliary property
'*userPassword' since SASL_AUXPROP_AUTHZID == true
I1025 04:02:53.098917 6823 auxprop.cpp:131] Skipping auxiliary property
'*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
I1025 04:02:53.098983 6823 authenticator.cpp:318] Authentication success
I1025 04:02:53.099086 6812 authenticatee.cpp:299] Authentication success
I1025 04:02:53.099150 6827 master.cpp:7977] Successfully authenticated
principal 'test-principal' at slave(539)@172.17.0.2:38626
I1025 04:02:53.099378 6813 authenticator.cpp:432] Authentication session
cleanup for crammd5-authenticatee(1078)@172.17.0.2:38626
I1025 04:02:53.099433 6812 slave.cpp:1147] Successfully authenticated with
master [email protected]:38626
I1025 04:02:53.099699 6812 slave.cpp:1626] Will retry registration in
17.954247ms if necessary
I1025 04:02:53.099915 6829 master.cpp:5801] Received register agent message
from slave(539)@172.17.0.2:38626 (a4020869f68c)
I1025 04:02:53.099952 6829 master.cpp:3838] Authorizing agent with principal
'test-principal'
I1025 04:02:53.100402 6814 master.cpp:5861] Authorized registration of agent
at slave(539)@172.17.0.2:38626 (a4020869f68c)
I1025 04:02:53.100524 6814 master.cpp:5954] Registering agent at
slave(539)@172.17.0.2:38626 (a4020869f68c) with id
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0
I1025 04:02:53.100894 6826 registrar.cpp:495] Applied 1 operations in 80109ns;
attempting to update the registry
I1025 04:02:53.101490 6826 registrar.cpp:552] Successfully updated the
registry in 525056ns
I1025 04:02:53.101676 6810 master.cpp:6001] Admitted agent
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0 at slave(539)@172.17.0.2:38626
(a4020869f68c)
I1025 04:02:53.102337 6822 slave.cpp:1193] Registered with master
[email protected]:38626; given agent ID 2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0
I1025 04:02:53.102442 6811 status_update_manager.cpp:184] Resuming sending
status updates
I1025 04:02:53.102229 6810 master.cpp:6032] Registered agent
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0 at slave(539)@172.17.0.2:38626
(a4020869f68c) with
[{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
I1025 04:02:53.102644 6821 hierarchical.cpp:593] Added agent
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0 (a4020869f68c) with cpus:2; mem:1024;
disk:1024; ports:[31000-32000] (allocated: {})
I1025 04:02:53.102702 6822 slave.cpp:1213] Checkpointing SlaveInfo to
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/meta/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/slave.info'
I1025 04:02:53.103113 6822 slave.cpp:1262] Forwarding total oversubscribed
resources {}
I1025 04:02:53.103298 6807 master.cpp:6828] Received update of agent
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0 at slave(539)@172.17.0.2:38626
(a4020869f68c) with total oversubscribed resources {}
I1025 04:02:53.103512 6807 master.cpp:6839] Ignoring update on agent
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0 at slave(539)@172.17.0.2:38626
(a4020869f68c) as it reports no changes
I1025 04:02:53.103955 6821 hierarchical.cpp:1488] Performed allocation for 1
agents in 1.162098ms
I1025 04:02:53.104391 6827 master.cpp:7777] Sending 1 offers to framework
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000 (default) at
[email protected]:38626
I1025 04:02:53.104918 6823 sched.cpp:917] Scheduler::resourceOffers took
112626ns
I1025 04:02:53.106896 6829 master.cpp:9400] Removing offer
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-O0
I1025 04:02:53.107036 6829 master.cpp:4196] Processing ACCEPT call for offers:
[ 2dc7ad46-f111-4762-9bf6-ef428a6f6d53-O0 ] on agent
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0 at slave(539)@172.17.0.2:38626
(a4020869f68c) for framework 2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000
(default) at [email protected]:38626
I1025 04:02:53.107153 6829 master.cpp:3565] Authorizing framework principal
'test-principal' to launch task 1
I1025 04:02:53.107358 6829 master.cpp:3565] Authorizing framework principal
'test-principal' to launch task 2
W1025 04:02:53.108886 6829 validation.cpp:1338] Executor 'executor-1' for task
'1' uses less CPUs (None) than the minimum required (0.01). Please update your
executor, as this will be mandatory in future releases.
W1025 04:02:53.108920 6829 validation.cpp:1350] Executor 'executor-1' for task
'1' uses less memory (None) than the minimum required (32MB). Please update
your executor, as this will be mandatory in future releases.
I1025 04:02:53.109328 6829 master.cpp:10146] Adding task 1 with resources
[{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":1.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":512.0},"type":"SCALAR"}]
on agent 2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0 at
slave(539)@172.17.0.2:38626 (a4020869f68c)
I1025 04:02:53.109657 6829 master.cpp:4879] Launching task 1 of framework
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000 (default) at
[email protected]:38626 with resources
[{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":1.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":512.0},"type":"SCALAR"}]
on agent 2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0 at
slave(539)@172.17.0.2:38626 (a4020869f68c)
I1025 04:02:53.110110 6818 slave.cpp:1747] Got assigned task '1' for framework
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000
W1025 04:02:53.110733 6829 validation.cpp:1338] Executor 'executor-2' for task
'2' uses less CPUs (None) than the minimum required (0.01). Please update your
executor, as this will be mandatory in future releases.
I1025 04:02:53.110743 6818 slave.cpp:2015] Authorizing task '1' for framework
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000
W1025 04:02:53.110766 6829 validation.cpp:1350] Executor 'executor-2' for task
'2' uses less memory (None) than the minimum required (32MB). Please update
your executor, as this will be mandatory in future releases.
I1025 04:02:53.110800 6818 slave.cpp:6809] Authorizing framework principal
'test-principal' to launch task 1
I1025 04:02:53.111147 6829 master.cpp:10146] Adding task 2 with resources
[{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":1.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":512.0},"type":"SCALAR"}]
on agent 2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0 at
slave(539)@172.17.0.2:38626 (a4020869f68c)
I1025 04:02:53.111491 6811 slave.cpp:2183] Launching task '1' for framework
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000
I1025 04:02:53.111441 6829 master.cpp:4879] Launching task 2 of framework
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000 (default) at
[email protected]:38626 with resources
[{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":1.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":512.0},"type":"SCALAR"}]
on agent 2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0 at
slave(539)@172.17.0.2:38626 (a4020869f68c)
I1025 04:02:53.111994 6811 paths.cpp:605] Trying to chown
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-1/runs/deb5e9ee-b64c-4dcb-8fac-9eefdbc721ed'
to user 'mesos'
I1025 04:02:53.112248 6811 slave.cpp:7283] Launching executor 'executor-1' of
framework 2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000 with resources [] in work
directory
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-1/runs/deb5e9ee-b64c-4dcb-8fac-9eefdbc721ed'
I1025 04:02:53.113008 6811 slave.cpp:2411] Queued task '1' for executor
'executor-1' of framework 2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000
I1025 04:02:53.113246 6826 hierarchical.cpp:887] Updated allocation of
framework 2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000 on agent
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0 from cpus(allocated: *):2;
mem(allocated: *):1024; disk(allocated: *):1024; ports(allocated:
*):[31000-32000] to cpus(allocated: *):2; mem(allocated: *):1024;
disk(allocated: *):1024; ports(allocated: *):[31000-32000]
I1025 04:02:53.113325 6811 slave.cpp:1747] Got assigned task '2' for framework
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000
I1025 04:02:53.113775 6811 slave.cpp:944] Successfully attached
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-1/runs/deb5e9ee-b64c-4dcb-8fac-9eefdbc721ed'
to virtual path
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-1/runs/latest'
I1025 04:02:53.113832 6811 slave.cpp:944] Successfully attached
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-1/runs/deb5e9ee-b64c-4dcb-8fac-9eefdbc721ed'
to virtual path
'/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-1/runs/latest'
I1025 04:02:53.113829 6826 hierarchical.cpp:1163] Recovered ports(allocated:
*):[31000-32000]; disk(allocated: *):1024 (total: cpus:2; mem:1024; disk:1024;
ports:[31000-32000], allocated: cpus(allocated: *):2; mem(allocated: *):1024)
on agent 2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0 from framework
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000
I1025 04:02:53.113880 6826 hierarchical.cpp:1209] Framework
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000 filtered agent
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0 for 5secs
I1025 04:02:53.113889 6811 slave.cpp:944] Successfully attached
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-1/runs/deb5e9ee-b64c-4dcb-8fac-9eefdbc721ed'
to virtual path
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-1/runs/deb5e9ee-b64c-4dcb-8fac-9eefdbc721ed'
I1025 04:02:53.114147 6811 slave.cpp:2874] Launching container
deb5e9ee-b64c-4dcb-8fac-9eefdbc721ed for executor 'executor-1' of framework
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000
I1025 04:02:53.114493 6811 slave.cpp:2015] Authorizing task '2' for framework
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000
I1025 04:02:53.114563 6811 slave.cpp:6809] Authorizing framework principal
'test-principal' to launch task 2
I1025 04:02:53.115202 6811 slave.cpp:2183] Launching task '2' for framework
2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000
I1025 04:02:53.115674 6811 paths.cpp:605] Trying to chown
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-2/runs/a542c575-457d-49f0-b271-472245d3878d'
to user 'mesos'
I1025 04:02:53.115883 6811 slave.cpp:7283] Launching executor 'executor-2' of
framework 2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000 with resources [] in work
directory
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-2/runs/a542c575-457d-49f0-b271-472245d3878d'
I1025 04:02:53.116703 6811 slave.cpp:2411] Queued task '2' for executor
'executor-2' of framework 2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000
I1025 04:02:53.116796 6811 slave.cpp:944] Successfully attached
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-2/runs/a542c575-457d-49f0-b271-472245d3878d'
to virtual path
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-2/runs/latest'
I1025 04:02:53.116850 6811 slave.cpp:944] Successfully attached
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-2/runs/a542c575-457d-49f0-b271-472245d3878d'
to virtual path
'/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-2/runs/latest'
I1025 04:02:53.116902 6811 slave.cpp:944] Successfully attached
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-2/runs/a542c575-457d-49f0-b271-472245d3878d'
to virtual path
'/tmp/SlaveTest_ContainersEndpoint_RzfA6D/slaves/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-S0/frameworks/2dc7ad46-f111-4762-9bf6-ef428a6f6d53-0000/executors/executor-2/runs/a542c575-457d-49f0-b271-472245d3878d'
*** Aborted at 1508904173 (unix time) try "date -d @1508904173" if you are
using GNU date ***
PC: @ 0x2ba56a14582d (unknown)
W1025 04:02:53.117486 6807 process.cpp:3193] Attempted to spawn already
running process [email protected]:38626
*** SIGSEGV (@0xd0) received by PID 6805 (TID 0x2ba573896700) from PID 208;
stack trace: ***
I1025 04:02:53.117677 6807 exec.cpp:162] Version: 1.5.0
I1025 04:02:53.117945 6806 exec.cpp:212] Executor started at:
executor(138)@172.17.0.2:38626 with pid 6805
@ 0x2ba5e07dcaf7 (unknown)
@ 0x2ba5e07e1449 (unknown)
@ 0x2ba569efc330 (unknown)
@ 0x2ba56a14582d (unknown)
@ 0x55adfc9771a8 os::getenv()
@ 0x2ba565c5510b mesos::internal::slave::executorEnvironment()
@ 0x2ba565c50779 mesos::internal::slave::Slave::launchExecutor()
@ 0x2ba565d159f8
_ZZN7process8dispatchIN5mesos8internal5slave5SlaveERK6OptionINS_6FutureINS1_6SecretEEEERKNS1_11FrameworkIDERKNS1_10ExecutorIDERKS5_INS1_8TaskInfoEESB_SE_SH_SL_EEvRKNS_3PIDIT_EEMSN_FvT0_T1_T2_T3_EOT4_OT5_OT6_OT7_ENKUlRS9_RSC_RSF_RSJ_PNS_11ProcessBaseEE_clES15_S16_S17_S18_S1A_
@ 0x2ba565d1586b
_ZNSt5_BindIFZN7process8dispatchIN5mesos8internal5slave5SlaveERK6OptionINS0_6FutureINS2_6SecretEEEERKNS2_11FrameworkIDERKNS2_10ExecutorIDERKS6_INS2_8TaskInfoEESC_SF_SI_SM_EEvRKNS0_3PIDIT_EEMSO_FvT0_T1_T2_T3_EOT4_OT5_OT6_OT7_EUlRSA_RSD_RSG_RSK_PNS0_11ProcessBaseEE_SA_SD_SG_SK_St12_PlaceholderILi1EEEE6__callIvJOS1B_EJLm0ELm1ELm2ELm3ELm4EEEESO_OSt5tupleIJDpT0_EESt12_Index_tupleIJXspT1_EEE
@ 0x2ba565d15766
_ZNSt5_BindIFZN7process8dispatchIN5mesos8internal5slave5SlaveERK6OptionINS0_6FutureINS2_6SecretEEEERKNS2_11FrameworkIDERKNS2_10ExecutorIDERKS6_INS2_8TaskInfoEESC_SF_SI_SM_EEvRKNS0_3PIDIT_EEMSO_FvT0_T1_T2_T3_EOT4_OT5_OT6_OT7_EUlRSA_RSD_RSG_RSK_PNS0_11ProcessBaseEE_SA_SD_SG_SK_St12_PlaceholderILi1EEEEclIJS1B_EvEESS_DpOT_
@ 0x2ba565d1521f
_ZNSt17_Function_handlerIFvPN7process11ProcessBaseEESt5_BindIFZNS0_8dispatchIN5mesos8internal5slave5SlaveERK6OptionINS0_6FutureINS6_6SecretEEEERKNS6_11FrameworkIDERKNS6_10ExecutorIDERKSA_INS6_8TaskInfoEESG_SJ_SM_SQ_EEvRKNS0_3PIDIT_EEMSS_FvT0_T1_T2_T3_EOT4_OT5_OT6_OT7_EUlRSE_RSH_RSK_RSO_S2_E_SE_SH_SK_SO_St12_PlaceholderILi1EEEEE9_M_invokeERKSt9_Any_dataS2_
@ 0x2ba567123774 std::function<>::operator()()
@ 0x2ba567107cc4 process::ProcessBase::visit()
@ 0x2ba567190b7e process::DispatchEvent::visit()
@ 0x55adfc95c7b1 process::ProcessBase::serve()
@ 0x2ba5671053c2 process::ProcessManager::resume()
@ 0x2ba5671151d1
process::ProcessManager::init_threads()::$_9::operator()()
@ 0x2ba567115115
_ZNSt12_Bind_simpleIFZN7process14ProcessManager12init_threadsEvE3$_9vEE9_M_invokeIJEEEvSt12_Index_tupleIJXspT_EEE
@ 0x2ba5671150e5 std::_Bind_simple<>::operator()()
@ 0x2ba5671150bc std::thread::_Impl<>::_M_run()
@ 0x2ba56977da60 (unknown)
@ 0x2ba569ef4184 start_thread
@ 0x2ba56a207ffd (unknown)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
