[
https://issues.apache.org/jira/browse/MESOS-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638835#comment-14638835
]
Dr. Stefan Schimanski edited comment on MESOS-3136 at 7/23/15 2:01 PM:
-----------------------------------------------------------------------
Marathon logs of the same task on 0.23:
```
mesos-slave.INFO:I0723 09:08:47.880939 40256 slave.cpp:4319] Recovering
executor 'company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e'
of framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.INFO:I0723 09:08:47.883102 40253 gc.cpp:56] Scheduling
'/tmp/mesos/slaves/20150723-081517-100663306-5050-2386-S1/frameworks/20150703-103541-67108874-5050-13727-0003/executors/company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e/runs/0597b26e-56b2-42c5-8879-229dc0bcba21'
for gc 6.99819581929482days in the future
mesos-slave.INFO:I0723 09:08:47.883256 40253 gc.cpp:56] Scheduling
'/tmp/mesos/meta/slaves/20150723-081517-100663306-5050-2386-S1/frameworks/20150703-103541-67108874-5050-13727-0003/executors/company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e/runs/0597b26e-56b2-42c5-8879-229dc0bcba21'
for gc 6.99819581894815days in the future
mesos-slave.INFO:I0723 09:08:47.883311 40253 gc.cpp:56] Scheduling
'/tmp/mesos/slaves/20150723-081517-100663306-5050-2386-S1/frameworks/20150703-103541-67108874-5050-13727-0003/executors/company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e'
for gc 6.99819581871407days in the future
mesos-slave.INFO:I0723 09:08:47.883541 40253 gc.cpp:56] Scheduling
'/tmp/mesos/meta/slaves/20150723-081517-100663306-5050-2386-S1/frameworks/20150703-103541-67108874-5050-13727-0003/executors/company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e'
for gc 6.99819581850667days in the future
mesos-slave.INFO:I0723 09:08:47.890535 40252 status_update_manager.cpp:205]
Recovering executor
'company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e' of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:03.441830 4649 slave.cpp:1244] Got assigned task
company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e for
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:03.442643 4649 slave.cpp:1355] Launching task
company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e for
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:03.453456 4649 slave.cpp:4733] Launching executor
company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e of
framework 20150703-103541-67108874-5050-13727-0003 with resources cpus(*):0.1;
mem(*):32 in work directory
'/tmp/mesos/slaves/20150723-081517-100663306-5050-2386-S1/frameworks/20150703-103541-67108874-5050-13727-0003/executors/company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e/runs/0597b26e-56b2-42c5-8879-229dc0bcba21'
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:03.457329 4649 slave.cpp:1573] Queuing task
'company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e' for
executor company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e of
framework '20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:03.462908 4650 docker.cpp:766] Starting container
'0597b26e-56b2-42c5-8879-229dc0bcba21' for task
'company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e' (and
executor 'company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e')
of framework '20150703-103541-67108874-5050-13727-0003'
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:03.558148 4647 docker.cpp:390] Checkpointing pid 40350 to
'/tmp/mesos/meta/slaves/20150723-081517-100663306-5050-2386-S1/frameworks/20150703-103541-67108874-5050-13727-0003/executors/company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e/runs/0597b26e-56b2-42c5-8879-229dc0bcba21/pids/forked.pid'
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:03.616792 4647 slave.cpp:2333] Got registration for executor
'company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e' of
framework 20150703-103541-67108874-5050-13727-0003 from
executor(1)@10.0.0.4:36558
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:03.619221 4652 slave.cpp:1729] Sending queued task
'company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e' to
executor 'company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e'
of framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:04.335752 4653 slave.cpp:2671] Handling status update TASK_RUNNING
(UUID: a9550037-1716-40a2-be34-973ad3d97ab6) for task
company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e of
framework 20150703-103541-67108874-5050-13727-0003 from
executor(1)@10.0.0.4:36558
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:04.336181 4653 status_update_manager.cpp:322] Received status update
TASK_RUNNING (UUID: a9550037-1716-40a2-be34-973ad3d97ab6) for task
company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:04.336634 4653 status_update_manager.cpp:826] Checkpointing UPDATE for
status update TASK_RUNNING (UUID: a9550037-1716-40a2-be34-973ad3d97ab6) for
task company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:04.342088 4653 slave.cpp:2926] Forwarding the update TASK_RUNNING (UUID:
a9550037-1716-40a2-be34-973ad3d97ab6) for task
company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e of
framework 20150703-103541-67108874-5050-13727-0003 to [email protected]:5050
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:04.342319 4653 slave.cpp:2856] Sending acknowledgement for status update
TASK_RUNNING (UUID: a9550037-1716-40a2-be34-973ad3d97ab6) for task
company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e of
framework 20150703-103541-67108874-5050-13727-0003 to executor(1)@10.0.0.4:36558
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:04.355550 4653 status_update_manager.cpp:394] Received status update
acknowledgement (UUID: a9550037-1716-40a2-be34-973ad3d97ab6) for task
company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e of
framework 20150703-103541-67108874-5050-13727-0003
mesos-slave.srv004.invalid-user.log.INFO.20150723-081530.4292:I0723
08:32:04.355825 4653 status_update_manager.cpp:826] Checkpointing ACK for
status update TASK_RUNNING (UUID: a9550037-1716-40a2-be34-973ad3d97ab6) for
task company-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e of
framework 20150703-103541-67108874-5050-13727-0003
```
was (Author: sttts):
Marathon logs of the same task on 0.23:
```
Jul 23 08:46:41 srv006 marathon[1400]: [2015-07-23 08:46:41,816] INFO Received
status update for task
teamwire-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e:
TASK_RUNNING (Reconciliation: Latest task state)
(mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$521ff37:99)
Jul 23 08:46:41 srv006 marathon[1400]: [2015-07-23 08:46:41,945] INFO Received
status update for task
teamwire-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e:
TASK_RUNNING (Reconciliation: Latest task state)
(mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$521ff37:99)
Jul 23 08:47:11 srv006 marathon[1400]: [2015-07-23 08:47:11,755] INFO Received
status update for task
teamwire-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e:
TASK_RUNNING (Reconciliation: Latest task state)
(mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$521ff37:99)
Jul 23 08:47:11 srv006 marathon[1400]: [2015-07-23 08:47:11,877] INFO Received
status update for task
teamwire-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e:
TASK_RUNNING (Reconciliation: Latest task state)
(mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$521ff37:99)
Jul 23 08:47:41 srv006 marathon[1400]: [2015-07-23 08:47:41,755] INFO Received
status update for task
teamwire-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e:
TASK_RUNNING (Reconciliation: Latest task state)
(mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$521ff37:99)
Jul 23 08:47:41 srv006 marathon[1400]: [2015-07-23 08:47:41,829] INFO Received
status update for task
teamwire-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e:
TASK_RUNNING (Reconciliation: Latest task state)
(mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$521ff37:99)
Jul 23 08:48:11 srv006 marathon[1400]: [2015-07-23 08:48:11,762] INFO Received
status update for task
teamwire-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e:
TASK_RUNNING (Reconciliation: Latest task state)
(mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$521ff37:99)
Jul 23 08:48:11 srv006 marathon[1400]: [2015-07-23 08:48:11,849] INFO Received
status update for task
teamwire-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e:
TASK_RUNNING (Reconciliation: Latest task state)
(mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$521ff37:99)
Jul 23 08:48:41 srv006 marathon[1400]: [2015-07-23 08:48:41,771] INFO Received
status update for task
teamwire-master_databases_redis.4b6df685-3115-11e5-b6ee-66ed7426526e:
TASK_RUNNING (Reconciliation: Latest task state)
(mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$521ff37:99)
```
> COMMAND health checks with Marathon 0.10.0rc3 are broken
> --------------------------------------------------------
>
> Key: MESOS-3136
> URL: https://issues.apache.org/jira/browse/MESOS-3136
> Project: Mesos
> Issue Type: Bug
> Affects Versions: 0.23.0
> Reporter: Dr. Stefan Schimanski
>
> When deploying Mesos 0.23rc4 with latest Marathon 0.10.0 RC3 command health
> check stop working. Rolling back to Mesos 0.22.1 fixes the problem.
> Containerizer is Docker.
> All packages are from official Mesosphere Ubuntu 14.04 sources.
> The issue must be analyzed further.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
