Currently, I can't run Hama on large cluster using 20+ more tasks per
node and can't see any logs.
Tasks are finishes as soon as started.
root@cnode01:/usr/local/src/hama-trunk# core/bin/hama jar
examples/target/hama-e
xamples-0.4.0-incubating-SNAPSHOT.jar bench 16 1000 30
11/10/05 11:10:35 DEBUG bsp.BSPJobClient: BSPJobClient.submitJobDir:
hdfs://hnode15:9000/tmp/hadoop-root/bsp/system/submit_d3wx1z
11/10/05 11:10:35 INFO bsp.BSPJobClient: Running job: job_201110051110_0001
11/10/05 11:10:38 INFO bsp.BSPJobClient: Current supersteps number: 0
master log:
2011-10-05 11:10:34,860 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 40000: starting
2011-10-05 11:10:34,863 INFO org.apache.hama.bsp.BSPMaster: Starting RUNNING
2011-10-05 11:10:34,892 INFO org.apache.hama.bsp.BSPMaster:
groomd_cnode10_50000 is added.
2011-10-05 11:10:34,908 INFO org.apache.hama.bsp.BSPMaster:
groomd_cnode07_50000 is added.
2011-10-05 11:10:34,919 INFO org.apache.hama.bsp.BSPMaster:
groomd_cnode05_50000 is added.
2011-10-05 11:10:34,934 INFO org.apache.hama.bsp.BSPMaster:
groomd_cnode01_50000 is added.
2011-10-05 11:10:34,945 INFO org.apache.hama.bsp.BSPMaster:
groomd_cnode06_50000 is added.
2011-10-05 11:10:34,961 INFO org.apache.hama.bsp.BSPMaster:
groomd_cnode04_50000 is added.
2011-10-05 11:10:34,973 INFO org.apache.hama.bsp.BSPMaster:
groomd_cnode08_50000 is added.
2011-10-05 11:10:34,984 INFO org.apache.hama.bsp.BSPMaster:
groomd_cnode02_50000 is added.
2011-10-05 11:10:34,997 INFO org.apache.hama.bsp.BSPMaster:
groomd_cnode03_50000 is added.
2011-10-05 11:10:35,920 DEBUG org.apache.hama.bsp.JobInProgress:
numBSPTasks: 162
2011-10-05 11:10:35,949 DEBUG org.apache.hama.bsp.JobInProgress: Job
is initialized.
2011-10-05 11:10:50,087 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201110051110_0001_000034_0' has finished successfully: 0
2011-10-05 11:10:50,087 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201110051110_0001_000034' has completed.
2011-10-05 11:10:50,267 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201110051110_0001_000158_0' has finished successfully: 0
2011-10-05 11:10:50,267 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201110051110_0001_000158' has completed.
2011-10-05 11:10:51,122 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201110051110_0001_000074_0' has finished successfully: 0
2011-10-05 11:10:51,122 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201110051110_0001_000074' has completed.
2011-10-05 11:10:51,178 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201110051110_0001_000112_0' has finished successfully: 0
2011-10-05 11:10:51,178 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201110051110_0001_000112' has completed.
2011-10-05 11:10:51,268 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201110051110_0001_000159_0' has finished successfully: 0
2011-10-05 11:10:51,268 INFO org.apache.hama.bsp.TaskInProgress: Task
'task_201110051110_0001_000159' has completed.
2011-10-05 11:10:51,385 INFO org.apache.hama.bsp.JobInProgress: Taskid
'attempt_201110051110_0001_000075_0' has finished successfully: 0
--
Best Regards, Edward J. Yoon
@eddieyoon