seojangho opened a new pull request #1: [NEMO-26] Implement SourceLocationAwareSchedulingPolicy URL: https://github.com/apache/incubator-nemo/pull/1 - Implemented SourceLocationAwareSchedulingPolicy - This scheduling policy schedules TaskGroups with Readables to the one of the executors that have the corresponding input split. - For TaskGroups without any Readables, it uses RoundRobinSchedulingPolicy. - Added unit tests for SourceLocationAwareSchedulingPolicy. - Refactored container management and scheduling on runtime master side (thanks to @johnyangk) - Made only two threads call scheduling-related code: RuntimeMaster thread (RMT), and SchedulerThread(ST) - RMT and ST meet only at two points: SchedulingPolicy, and PendingTaskGroupQueue, which are synchronized(ThreadSafe) - Other scheduler-related classes that are accessed by only one of the two threads are not synchronized(NotThreadSafe) - We use ContainerManager for handling containers only, and not executors (to avoid hanging, we also don?t wait for pending resource requests upon termination) - ExecutorRegistry and ExecutorRepresenter fully classify running/failed/completed Executor/Taskgroups JIRA: [NEMO-26](https://issues.apache.org/jira/projects/NEMO/issues/NEMO-26) Pull Request: This closes #
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
