[
https://issues.apache.org/jira/browse/HAMA-413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Edward J. Yoon updated HAMA-413:
--------------------------------
Attachment: HAMA_413_v04.patch
Tested on physical 16 nodes.
{code}
2011-08-24 13:22:32,107 INFO org.apache.hama.bsp.BSPMaster: Starting RUNNING
2011-08-24 13:22:44,252 DEBUG org.apache.hama.bsp.JobInProgress: numBSPTasks: 48
2011-08-24 13:22:44,254 DEBUG org.apache.hama.bsp.JobInProgress: Job is
initialized.
2011-08-24 13:22:49,546 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000029_0' has finished successfully.
2011-08-24 13:22:49,546 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000029' has completed.
2011-08-24 13:22:49,546 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000045_0' has finished successfully.
2011-08-24 13:22:49,546 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000045' has completed.
2011-08-24 13:22:49,547 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000037_0' has finished successfully.
2011-08-24 13:22:49,547 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000037' has completed.
2011-08-24 13:22:49,547 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000010_0' has finished successfully.
2011-08-24 13:22:49,547 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000010' has completed.
2011-08-24 13:22:49,547 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000009_0' has finished successfully.
2011-08-24 13:22:49,547 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000009' has completed.
2011-08-24 13:22:49,547 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000018_0' has finished successfully.
2011-08-24 13:22:49,547 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000018' has completed.
2011-08-24 13:22:49,547 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000015_0' has finished successfully.
2011-08-24 13:22:49,547 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000015' has completed.
2011-08-24 13:22:49,547 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000024_0' has finished successfully.
2011-08-24 13:22:49,547 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000024' has completed.
2011-08-24 13:22:49,548 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000030_0' has finished successfully.
2011-08-24 13:22:49,548 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000030' has completed.
2011-08-24 13:22:49,548 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000013_0' has finished successfully.
2011-08-24 13:22:49,548 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000013' has completed.
2011-08-24 13:22:49,548 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000027_0' has finished successfully.
2011-08-24 13:22:49,548 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000027' has completed.
2011-08-24 13:22:49,548 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000000_0' has finished successfully.
2011-08-24 13:22:49,548 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000000' has completed.
2011-08-24 13:22:49,548 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000022_0' has finished successfully.
2011-08-24 13:22:49,548 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000022' has completed.
2011-08-24 13:22:49,548 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000017_0' has finished successfully.
2011-08-24 13:22:49,548 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000017' has completed.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000006_0' has finished successfully.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000006' has completed.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000016_0' has finished successfully.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000016' has completed.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000039_0' has finished successfully.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000039' has completed.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000023_0' has finished successfully.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000023' has completed.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000038_0' has finished successfully.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000038' has completed.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000046_0' has finished successfully.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000046' has completed.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000021_0' has finished successfully.
2011-08-24 13:22:49,549 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000021' has completed.
2011-08-24 13:22:49,550 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000028_0' has finished successfully.
2011-08-24 13:22:49,550 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000028' has completed.
2011-08-24 13:22:49,550 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000044_0' has finished successfully.
2011-08-24 13:22:49,550 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000044' has completed.
2011-08-24 13:22:49,550 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000014_0' has finished successfully.
2011-08-24 13:22:49,550 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000014' has completed.
2011-08-24 13:22:49,550 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000032_0' has finished successfully.
2011-08-24 13:22:49,550 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000032' has completed.
2011-08-24 13:22:49,550 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000011_0' has finished successfully.
2011-08-24 13:22:49,550 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000011' has completed.
2011-08-24 13:22:49,550 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000042_0' has finished successfully.
2011-08-24 13:22:49,550 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000042' has completed.
2011-08-24 13:22:49,550 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000033_0' has finished successfully.
2011-08-24 13:22:49,551 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000033' has completed.
2011-08-24 13:22:49,551 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000005_0' has finished successfully.
2011-08-24 13:22:49,551 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000005' has completed.
2011-08-24 13:22:49,551 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000043_0' has finished successfully.
2011-08-24 13:22:49,551 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000043' has completed.
2011-08-24 13:22:49,551 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000002_0' has finished successfully.
2011-08-24 13:22:49,551 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000002' has completed.
2011-08-24 13:22:49,551 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000025_0' has finished successfully.
2011-08-24 13:22:49,551 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000025' has completed.
2011-08-24 13:22:49,551 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000019_0' has finished successfully.
2011-08-24 13:22:49,551 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000019' has completed.
2011-08-24 13:22:49,552 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000040_0' has finished successfully.
2011-08-24 13:22:49,552 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000040' has completed.
2011-08-24 13:22:49,552 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000034_0' has finished successfully.
2011-08-24 13:22:49,552 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000034' has completed.
2011-08-24 13:22:49,552 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000031_0' has finished successfully.
2011-08-24 13:22:49,552 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000031' has completed.
2011-08-24 13:22:49,552 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000008_0' has finished successfully.
2011-08-24 13:22:49,552 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000008' has completed.
2011-08-24 13:22:49,552 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000020_0' has finished successfully.
2011-08-24 13:22:49,553 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000020' has completed.
2011-08-24 13:22:49,553 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000003_0' has finished successfully.
2011-08-24 13:22:49,553 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000003' has completed.
2011-08-24 13:22:49,553 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000036_0' has finished successfully.
2011-08-24 13:22:49,553 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000036' has completed.
2011-08-24 13:22:49,553 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000035_0' has finished successfully.
2011-08-24 13:22:49,553 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000035' has completed.
2011-08-24 13:22:49,553 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000026_0' has finished successfully.
2011-08-24 13:22:49,553 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000026' has completed.
2011-08-24 13:22:49,554 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000007_0' has finished successfully.
2011-08-24 13:22:49,554 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000007' has completed.
2011-08-24 13:22:49,554 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000012_0' has finished successfully.
2011-08-24 13:22:49,554 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000012' has completed.
2011-08-24 13:22:49,557 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000047_0' has finished successfully.
2011-08-24 13:22:49,557 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000047' has completed.
2011-08-24 13:22:49,557 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000004_0' has finished successfully.
2011-08-24 13:22:49,557 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000004' has completed.
2011-08-24 13:22:49,558 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000041_0' has finished successfully.
2011-08-24 13:22:49,558 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000041' has completed.
2011-08-24 13:22:49,769 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201108241322_0001_000001_0' has finished successfully.
2011-08-24 13:22:49,769 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201108241322_0001_000001' has completed.
2011-08-24 13:22:49,771 DEBUG org.apache.hama.bsp.JobInProgress: Job
successfully done.
{code}
> Remove limitation on the number of tasks
> ----------------------------------------
>
> Key: HAMA-413
> URL: https://issues.apache.org/jira/browse/HAMA-413
> Project: Hama
> Issue Type: Sub-task
> Components: bsp
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.4.0
>
> Attachments: HAMA-413_v01.patch, HAMA-413_v02.patch,
> HAMA-413_v03.patch, HAMA_413_v04.patch
>
>
> By HAMA-410 patch, BSPPeer object will be constructed at child process. Now
> we can just remove limitation on the number of tasks.
> Here's TODO list:
> 1. The number of tasks per groom should be configurable e.g.,
> 'bsp.local.tasks.maximum'.
> 2. The 'totalTaskCapacity' should be calculated at
> BSPMaster.getClusterStatus().
> 3. When scheduling tasks, consider how to allocate them.
> 4. Each BSPPeer should know all created peers of Hama cluster by job. It can
> be listed based on actions of GroomServer.
> 5. In examples, 'cluster.getGroomServers()' can be changed to
> 'cluster.getMaxTasks()'.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
