[
https://issues.apache.org/jira/browse/HAMA-900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096102#comment-15096102
]
Behroz Sikander commented on HAMA-900:
--------------------------------------
Recently, I ran into a problem where a few of my machines were overloaded. I
was specifying the bsp.tasks.maximum more than each machine in my cluster could
handle (4 CPUs, 8GB RAM).
<property>
<name>bsp.tasks.maximum</name>
<value>8</value>
<description>The maximum number of BSP tasks that will be run
simultaneously
by a groom server.</description>
</property>
With 9 machines, I had a total of 72 tasks but my Hama job was only using like
40 tasks. But instead of uniformly distributing my tasks in my cluster (like
round robin), Hama was overloading first few Grooms. In code, I noticed that
BestEffort strategy is being used[1].
This ticket is pretty old so I am not sure if we already have this (FIFO)
functionality (and hama-site configuration) or I need to implement the
interface[2].
[1] -
https://github.com/apache/hama/blob/master/core/src/main/java/org/apache/hama/bsp/taskallocation/BestEffortDataLocalTaskAllocator.java
[2] -
https://github.com/apache/hama/blob/master/core/src/main/java/org/apache/hama/bsp/taskallocation/TaskAllocationStrategy.java
> Rotation task scheduler
> -----------------------
>
> Key: HAMA-900
> URL: https://issues.apache.org/jira/browse/HAMA-900
> Project: Hama
> Issue Type: New Feature
> Components: bsp core
> Reporter: Edward J. Yoon
>
> To spread tasks widely, I need a FIFO job scheduler that assign tasks one at
> a time in rotation of groom servers (a method of dealing cards).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
