Hmm... Yes, probably. Current mult algorithm needs one full scan by each rows (n). If it replaced to 2D blocking algorithm, it'll be solved.
/Ed On Tue, Nov 4, 2008 at 12:07 PM, Samuel Guo <[EMAIL PROTECTED]> wrote: > On Tue, Nov 4, 2008 at 10:30 AM, Edward J. Yoon <[EMAIL PROTECTED]>wrote: > >> While matrix-matrix mult, I received a message as below. Does anyone >> know about UnknownScannerException? >> >> ---- >> 08/11/04 11:24:57 INFO mapred.JobClient: map 90% reduce 28% >> 08/11/04 11:24:59 INFO mapred.JobClient: map 90% reduce 30% >> 08/11/04 11:26:49 INFO mapred.JobClient: Task Id : >> attempt_200811041040_0003_m_000002_0, Status : FAILED >> org.apache.hadoop.hbase.UnknownScannerException: >> org.apache.hadoop.hbase.UnknownScannerException: Name: >> -1151932123796109789 >> at >> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1077) >> at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >> at java.lang.reflect.Method.invoke(Method.java:597) >> at >> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554) >> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888) >> >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native >> Method) >> at >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) >> at >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) >> at java.lang.reflect.Constructor.newInstance(Constructor.java:513) >> at >> org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82) >> at >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:856) > > > I doubt that there may be some region splitting/moving during scanning, so > we get the RemoteException while getRegionServerWithRetires. > > >> >> at >> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1155) >> at >> org.apache.hama.mapred.MatrixInputFormatBase$TableRecordReader.next(MatrixInputFormatBase.java:174) >> at >> org.apache.hama.mapred.MatrixInputFormatBase$TableRecordReader.next(MatrixInputFormatBase.java:56) >> at >> org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:165) >> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45) >> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227) >> at >> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207) >> >> 08/11/04 11:27:11 INFO mapred.JobClient: map 100% reduce 30% >> 08/11/04 11:27:17 INFO mapred.JobClient: map 100% reduce 64% >> 08/11/04 11:27:23 INFO mapred.JobClient: Job complete: >> job_200811041040_0003 >> 08/11/04 11:27:23 INFO mapred.JobClient: Counters: 13 >> 08/11/04 11:27:23 INFO mapred.JobClient: File Systems >> 08/11/04 11:27:23 INFO mapred.JobClient: Local bytes read=32057196 >> 08/11/04 11:27:23 INFO mapred.JobClient: Local bytes written=64599524 >> >> -- >> Best regards, Edward J. Yoon @ NHN, corp. >> [EMAIL PROTECTED] >> http://blog.udanax.org >> > -- Best regards, Edward J. Yoon @ NHN, corp. [EMAIL PROTECTED] http://blog.udanax.org
