[
https://issues.apache.org/jira/browse/MESOS-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638823#comment-14638823
]
Adam B edited comment on MESOS-3136 at 7/23/15 5:20 PM:
--------------------------------------------------------
The mesos-slave logs of a task on 0.22.1:
The status updates include "in health state healthy" which is not visible in
0.23.
{code}
mesos-slave.INFO:I0723 10:08:08.253509 40252 slave.cpp:1144] Got assigned task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 for
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.254894 40252 slave.cpp:1254] Launching task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 for
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.265609 40252 slave.cpp:4208] Launching executor
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003 in work directory
'/tmp/mesos/slaves/20150723-081517-100663306-5050-2386-S1/frameworks/20150703-103541-67108874-5050-13727-0003/executors/company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83/runs/30672d3a-249c-4468-b620-a5873c8a87a8'
mesos-slave.INFO:I0723 10:08:08.267479 40252 slave.cpp:1401] Queuing task
'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83' for
executor company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework '20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.275472 40252 docker.cpp:626] Starting container
'30672d3a-249c-4468-b620-a5873c8a87a8' for task
'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83' (and
executor 'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83')
of framework '20150703-103541-67108874-5050-13727-0003'
mesos-slave.INFO:I0723 10:08:08.700194 40250 docker.cpp:277] Checkpointing pid
33342 to
'/tmp/mesos/meta/slaves/20150723-081517-100663306-5050-2386-S1/frameworks/20150703-103541-67108874-5050-13727-0003/executors/company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83/runs/30672d3a-249c-4468-b620-a5873c8a87a8/pids/forked.pid'
mesos-slave.INFO:I0723 10:08:08.706665 40255 slave.cpp:3165] Monitoring
executor 'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83'
of framework '20150703-103541-67108874-5050-13727-0003' in container
'30672d3a-249c-4468-b620-a5873c8a87a8'
mesos-slave.INFO:I0723 10:08:08.755120 40254 slave.cpp:2164] Got registration
for executor
'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83' of
framework 20150703-103541-67108874-5050-13727-0003 from
executor(1)@10.0.0.4:52687
mesos-slave.INFO:I0723 10:08:08.757438 40254 slave.cpp:1555] Sending queued
task 'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83' to
executor 'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83'
of framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.769215 40256 slave.cpp:2531] Handling status
update TASK_RUNNING (UUID: 7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003 from
executor(1)@10.0.0.4:52687
mesos-slave.INFO:I0723 10:08:08.772658 40256 status_update_manager.cpp:317]
Received status update TASK_RUNNING (UUID:
7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.775440 40256 status_update_manager.hpp:346]
Checkpointing UPDATE for status update TASK_RUNNING (UUID:
7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.781846 40251 slave.cpp:2776] Forwarding the
update TASK_RUNNING (UUID: 7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003 to [email protected]:5050
mesos-slave.INFO:I0723 10:08:08.782343 40251 slave.cpp:2709] Sending
acknowledgement for status update TASK_RUNNING (UUID:
7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003 to executor(1)@10.0.0.4:52687
mesos-slave.INFO:I0723 10:08:08.794363 40255 status_update_manager.cpp:389]
Received status update acknowledgement (UUID:
7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.794682 40255 status_update_manager.hpp:346]
Checkpointing ACK for status update TASK_RUNNING (UUID:
7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.934859 40253 slave.cpp:2531] Handling status
update TASK_RUNNING (UUID: fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 in health
state healthy of framework 20150703-103541-67108874-5050-13727-0003 from
executor(1)@10.0.0.4:52687
mesos-slave.INFO:I0723 10:08:08.935350 40253 status_update_manager.cpp:317]
Received status update TASK_RUNNING (UUID:
fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 in health
state healthy of framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.935422 40253 status_update_manager.hpp:346]
Checkpointing UPDATE for status update TASK_RUNNING (UUID:
fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 in health
state healthy of framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.939698 40255 slave.cpp:2776] Forwarding the
update TASK_RUNNING (UUID: fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 in health
state healthy of framework 20150703-103541-67108874-5050-13727-0003 to
[email protected]:5050
mesos-slave.INFO:I0723 10:08:08.940003 40255 slave.cpp:2709] Sending
acknowledgement for status update TASK_RUNNING (UUID:
fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 in health
state healthy of framework 20150703-103541-67108874-5050-13727-0003 to
executor(1)@10.0.0.4:52687
mesos-slave.INFO:I0723 10:08:08.954673 40253 status_update_manager.cpp:389]
Received status update acknowledgement (UUID:
fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.955098 40253 status_update_manager.hpp:346]
Checkpointing ACK for status update TASK_RUNNING (UUID:
fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 in health
state healthy of framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-090847.40234:I0723
10:08:08.253509 40252 slave.cpp:1144] Got assigned task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 for
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-090847.40234:I0723
10:08:08.254894 40252 slave.cpp:1254] Launching task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 for
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-090847.40234:I0723
10:08:08.265609 40252 slave.cpp:4208] Launching executor
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003 in work directory
'/tmp/mesos/slaves/20150723-081517-100663306-5050-2386-S1/frameworks/20150703-103541-67108874-5050-13727-0003/executors/company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83/runs/30672d3a-249c-4468-b620-a5873c8a87a8'
{code}
was (Author: sttts):
The mesos-slave logs of a task on 0.22.1:
The status updates include "in health state healthy" which is not visible in
0.23.
```
mesos-slave.INFO:I0723 10:08:08.253509 40252 slave.cpp:1144] Got assigned task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 for
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.254894 40252 slave.cpp:1254] Launching task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 for
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.265609 40252 slave.cpp:4208] Launching executor
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003 in work directory
'/tmp/mesos/slaves/20150723-081517-100663306-5050-2386-S1/frameworks/20150703-103541-67108874-5050-13727-0003/executors/company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83/runs/30672d3a-249c-4468-b620-a5873c8a87a8'
mesos-slave.INFO:I0723 10:08:08.267479 40252 slave.cpp:1401] Queuing task
'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83' for
executor company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework '20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.275472 40252 docker.cpp:626] Starting container
'30672d3a-249c-4468-b620-a5873c8a87a8' for task
'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83' (and
executor 'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83')
of framework '20150703-103541-67108874-5050-13727-0003'
mesos-slave.INFO:I0723 10:08:08.700194 40250 docker.cpp:277] Checkpointing pid
33342 to
'/tmp/mesos/meta/slaves/20150723-081517-100663306-5050-2386-S1/frameworks/20150703-103541-67108874-5050-13727-0003/executors/company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83/runs/30672d3a-249c-4468-b620-a5873c8a87a8/pids/forked.pid'
mesos-slave.INFO:I0723 10:08:08.706665 40255 slave.cpp:3165] Monitoring
executor 'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83'
of framework '20150703-103541-67108874-5050-13727-0003' in container
'30672d3a-249c-4468-b620-a5873c8a87a8'
mesos-slave.INFO:I0723 10:08:08.755120 40254 slave.cpp:2164] Got registration
for executor
'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83' of
framework 20150703-103541-67108874-5050-13727-0003 from
executor(1)@10.0.0.4:52687
mesos-slave.INFO:I0723 10:08:08.757438 40254 slave.cpp:1555] Sending queued
task 'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83' to
executor 'company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83'
of framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.769215 40256 slave.cpp:2531] Handling status
update TASK_RUNNING (UUID: 7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003 from
executor(1)@10.0.0.4:52687
mesos-slave.INFO:I0723 10:08:08.772658 40256 status_update_manager.cpp:317]
Received status update TASK_RUNNING (UUID:
7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.775440 40256 status_update_manager.hpp:346]
Checkpointing UPDATE for status update TASK_RUNNING (UUID:
7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.781846 40251 slave.cpp:2776] Forwarding the
update TASK_RUNNING (UUID: 7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003 to [email protected]:5050
mesos-slave.INFO:I0723 10:08:08.782343 40251 slave.cpp:2709] Sending
acknowledgement for status update TASK_RUNNING (UUID:
7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003 to executor(1)@10.0.0.4:52687
mesos-slave.INFO:I0723 10:08:08.794363 40255 status_update_manager.cpp:389]
Received status update acknowledgement (UUID:
7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.794682 40255 status_update_manager.hpp:346]
Checkpointing ACK for status update TASK_RUNNING (UUID:
7f5abf5c-702a-4380-9ea5-7a7eb401f3b2) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.934859 40253 slave.cpp:2531] Handling status
update TASK_RUNNING (UUID: fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 in health
state healthy of framework 20150703-103541-67108874-5050-13727-0003 from
executor(1)@10.0.0.4:52687
mesos-slave.INFO:I0723 10:08:08.935350 40253 status_update_manager.cpp:317]
Received status update TASK_RUNNING (UUID:
fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 in health
state healthy of framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.935422 40253 status_update_manager.hpp:346]
Checkpointing UPDATE for status update TASK_RUNNING (UUID:
fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 in health
state healthy of framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.939698 40255 slave.cpp:2776] Forwarding the
update TASK_RUNNING (UUID: fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 in health
state healthy of framework 20150703-103541-67108874-5050-13727-0003 to
[email protected]:5050
mesos-slave.INFO:I0723 10:08:08.940003 40255 slave.cpp:2709] Sending
acknowledgement for status update TASK_RUNNING (UUID:
fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 in health
state healthy of framework 20150703-103541-67108874-5050-13727-0003 to
executor(1)@10.0.0.4:52687
mesos-slave.INFO:I0723 10:08:08.954673 40253 status_update_manager.cpp:389]
Received status update acknowledgement (UUID:
fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 10:08:08.955098 40253 status_update_manager.hpp:346]
Checkpointing ACK for status update TASK_RUNNING (UUID:
fbe6e48f-055e-41f7-88eb-1a076e92c424) for task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 in health
state healthy of framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-090847.40234:I0723
10:08:08.253509 40252 slave.cpp:1144] Got assigned task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 for
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-090847.40234:I0723
10:08:08.254894 40252 slave.cpp:1254] Launching task
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 for
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-090847.40234:I0723
10:08:08.265609 40252 slave.cpp:4208] Launching executor
company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83 of
framework 20150703-103541-67108874-5050-13727-0003 in work directory
'/tmp/mesos/slaves/20150723-081517-100663306-5050-2386-S1/frameworks/20150703-103541-67108874-5050-13727-0003/executors/company-master_databases_redis.b787889b-3122-11e5-917e-cee15558ba83/runs/30672d3a-249c-4468-b620-a5873c8a87a8'
```
> COMMAND health checks with Marathon 0.10.0rc3 are broken
> --------------------------------------------------------
>
> Key: MESOS-3136
> URL: https://issues.apache.org/jira/browse/MESOS-3136
> Project: Mesos
> Issue Type: Bug
> Affects Versions: 0.23.0
> Reporter: Dr. Stefan Schimanski
>
> When deploying Mesos 0.23rc4 with latest Marathon 0.10.0 RC3 command health
> check stop working. Rolling back to Mesos 0.22.1 fixes the problem.
> Containerizer is Docker.
> All packages are from official Mesosphere Ubuntu 14.04 sources.
> The issue must be analyzed further.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
