[
https://issues.apache.org/jira/browse/HAMA-116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12652052#action_12652052
]
Edward J. Yoon commented on HAMA-116:
-------------------------------------
BTW, There is too many read/write operation.
This is a blocking job of 3000 * 3000 matrix.
----
08/12/02 01:20:54 INFO mapred.JobClient: Counters: 13
08/12/02 01:20:54 INFO mapred.JobClient: File Systems
08/12/02 01:20:54 INFO mapred.JobClient: Local bytes read=917571894
08/12/02 01:20:54 INFO mapred.JobClient: Local bytes written=1493961988
08/12/02 01:20:54 INFO mapred.JobClient: Job Counters
08/12/02 01:20:54 INFO mapred.JobClient: Launched reduce tasks=12
08/12/02 01:20:54 INFO mapred.JobClient: Launched map tasks=14
08/12/02 01:20:54 INFO mapred.JobClient: Map-Reduce Framework
08/12/02 01:20:54 INFO mapred.JobClient: Reduce input groups=100
08/12/02 01:20:54 INFO mapred.JobClient: Combine output records=0
08/12/02 01:20:54 INFO mapred.JobClient: Map input records=5665
08/12/02 01:20:54 INFO mapred.JobClient: Reduce output records=0
08/12/02 01:20:54 INFO mapred.JobClient: Map output bytes=572484210
08/12/02 01:20:54 INFO mapred.JobClient: Map input bytes=0
08/12/02 01:20:54 INFO mapred.JobClient: Combine input records=0
08/12/02 01:20:54 INFO mapred.JobClient: Map output records=56650
08/12/02 01:20:54 INFO mapred.JobClient: Reduce input records=56650
> ArrayIndexOutOfBoundsException at BlockingMapRed
> ------------------------------------------------
>
> Key: HAMA-116
> URL: https://issues.apache.org/jira/browse/HAMA-116
> Project: Hama
> Issue Type: Bug
> Components: mapred
> Reporter: Edward J. Yoon
> Fix For: 0.1.0
>
> Attachments: HAMA-116.patch
>
>
> [d8g053:/root/hama-trunk]# bin/hama examples mult -m 100 -r 100 1000 1000
> ----
> 08/11/30 11:56:07 INFO mapred.JobClient: map 100% reduce 1%
> 08/11/30 11:56:26 INFO mapred.JobClient: map 100% reduce 0%
> 08/11/30 11:56:26 INFO mapred.JobClient: Task Id :
> attempt_200811271544_0006_r_0
> 00001_1, Status : FAILED
> java.lang.ArrayIndexOutOfBoundsException: 10
> at org.apache.hama.SubMatrix.set(SubMatrix.java:61)
> at
> org.apache.hama.mapred.BlockingMapRed$BlockingReducer.reduce(Blocking
> MapRed.java:146)
> at
> org.apache.hama.mapred.BlockingMapRed$BlockingReducer.reduce(Blocking
> MapRed.java:127)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:318)
> at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207
> )
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.