what size of matrix you used to run matrix-matrix mult? On Tue, Nov 4, 2008 at 11:21 AM, Edward J. Yoon <[EMAIL PROTECTED]>wrote:
> Hmm... Yes, probably. > Current mult algorithm needs one full scan by each rows (n). If it > replaced to 2D blocking algorithm, it'll be solved. > > /Ed > > On Tue, Nov 4, 2008 at 12:07 PM, Samuel Guo <[EMAIL PROTECTED]> wrote: > > On Tue, Nov 4, 2008 at 10:30 AM, Edward J. Yoon <[EMAIL PROTECTED] > >wrote: > > > >> While matrix-matrix mult, I received a message as below. Does anyone > >> know about UnknownScannerException? > >> > >> ---- > >> 08/11/04 11:24:57 INFO mapred.JobClient: map 90% reduce 28% > >> 08/11/04 11:24:59 INFO mapred.JobClient: map 90% reduce 30% > >> 08/11/04 11:26:49 INFO mapred.JobClient: Task Id : > >> attempt_200811041040_0003_m_000002_0, Status : FAILED > >> org.apache.hadoop.hbase.UnknownScannerException: > >> org.apache.hadoop.hbase.UnknownScannerException: Name: > >> -1151932123796109789 > >> at > >> > org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1077) > >> at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) > >> at > >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > >> at java.lang.reflect.Method.invoke(Method.java:597) > >> at > >> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554) > >> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888) > >> > >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > >> Method) > >> at > >> > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > >> at > >> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > >> at > java.lang.reflect.Constructor.newInstance(Constructor.java:513) > >> at > >> > org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82) > >> at > >> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:856) > > > > > > I doubt that there may be some region splitting/moving during scanning, > so > > we get the RemoteException while getRegionServerWithRetires. > > > > > >> > >> at > >> > org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1155) > >> at > >> > org.apache.hama.mapred.MatrixInputFormatBase$TableRecordReader.next(MatrixInputFormatBase.java:174) > >> at > >> > org.apache.hama.mapred.MatrixInputFormatBase$TableRecordReader.next(MatrixInputFormatBase.java:56) > >> at > >> > org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:165) > >> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45) > >> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227) > >> at > >> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207) > >> > >> 08/11/04 11:27:11 INFO mapred.JobClient: map 100% reduce 30% > >> 08/11/04 11:27:17 INFO mapred.JobClient: map 100% reduce 64% > >> 08/11/04 11:27:23 INFO mapred.JobClient: Job complete: > >> job_200811041040_0003 > >> 08/11/04 11:27:23 INFO mapred.JobClient: Counters: 13 > >> 08/11/04 11:27:23 INFO mapred.JobClient: File Systems > >> 08/11/04 11:27:23 INFO mapred.JobClient: Local bytes read=32057196 > >> 08/11/04 11:27:23 INFO mapred.JobClient: Local bytes > written=64599524 > >> > >> -- > >> Best regards, Edward J. Yoon @ NHN, corp. > >> [EMAIL PROTECTED] > >> http://blog.udanax.org > >> > > > > > > -- > Best regards, Edward J. Yoon @ NHN, corp. > [EMAIL PROTECTED] > http://blog.udanax.org >
