[
https://issues.apache.org/jira/browse/SPARK-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastien Rainville updated SPARK-2204:
---------------------------------------
Description: MesosSchedulerBackend.resourceOffers(SchedulerDriver,
List[Offer]) is assuming that
TaskSchedulerImpl.resourceOffers(Seq[WorkerOffer]) is returning task lists in
the same order as the offers it was passed, but in the current implementation
TaskSchedulerImpl.resourceOffers shuffles the offers to avoid assigning the
tasks always to the same executors. The result is that the tasks are launched
on random executors. (was:
MesosSchedulerBackend.resourceOffers(SchedulerDriver, List[Offer]) is assuming
that TaskSchedulerImpl.resourceOffers(Seq[WorkerOffer]) is returning task lists
in the same order as the offers it was passed, but in the current
implementation TaskSchedulerImpl.resourceOffers shuffles the offers to avoid
assigning the tasks always to the same executors. The result is that the tasks
are launched on random executors.6)
> Scheduler for Mesos in fine-grained mode launches tasks on random executors
> ---------------------------------------------------------------------------
>
> Key: SPARK-2204
> URL: https://issues.apache.org/jira/browse/SPARK-2204
> Project: Spark
> Issue Type: Bug
> Components: Mesos
> Affects Versions: 1.0.0
> Reporter: Sebastien Rainville
> Priority: Blocker
>
> MesosSchedulerBackend.resourceOffers(SchedulerDriver, List[Offer]) is
> assuming that TaskSchedulerImpl.resourceOffers(Seq[WorkerOffer]) is returning
> task lists in the same order as the offers it was passed, but in the current
> implementation TaskSchedulerImpl.resourceOffers shuffles the offers to avoid
> assigning the tasks always to the same executors. The result is that the
> tasks are launched on random executors.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
