Looks like your map was fine but then it hung for three minutes: i.e. > default scanner timout.
08/11/06 16:36:09 INFO mapred.JobClient: map 50% reduce 16% 08/11/06 16:39:01 INFO mapred.JobClient: Task Id : attempt_200811061631_0001_m_000001_0, Status : FAILED org.apache.hadoop.hbase.UnknownScannerException: org.apache.hadoop.hbase.UnknownScannerException: Name: Anything in your Map that could hang that long? Can you add logging? After the 3 minute hang, if a Client goes back to the Server, it'll get the USE. St.Ack On Wed, Nov 5, 2008 at 11:52 PM, Edward J. Yoon <[EMAIL PROTECTED]>wrote: > After upgrade hadoop to 0.18.2 from 0.18.1, I received an > UnknownScannerException. And, Map in/output bytes are only 288 bytes. > > Does anyone know about this? > > ---- > [EMAIL PROTECTED] ~/hama-trunk $ bin/hama examples add 2 2 > 08/11/06 16:35:34 INFO hama.AbstractMatrix: Initializing the matrix > storage. > 08/11/06 16:35:39 INFO hama.AbstractMatrix: Create Matrix > DenseMatrix_randsmsif > 08/11/06 16:35:39 INFO hama.AbstractMatrix: Create the 2 * 2 random > matrix : DenseMatrix_randsmsif > 08/11/06 16:35:39 INFO hama.AbstractMatrix: Initializing the matrix > storage. > 08/11/06 16:35:45 INFO hama.AbstractMatrix: Create Matrix > DenseMatrix_randcnzdg > 08/11/06 16:35:45 INFO hama.AbstractMatrix: Create the 2 * 2 random > matrix : DenseMatrix_randcnzdg > 08/11/06 16:35:46 INFO hama.AbstractMatrix: Initializing the matrix > storage. > 08/11/06 16:35:52 INFO hama.AbstractMatrix: Create Matrix > DenseMatrix_randvhcsa > 08/11/06 16:35:52 WARN mapred.JobClient: Use GenericOptionsParser for > parsing the arguments. Applications should implement Tool for the > same. > 08/11/06 16:35:52 WARN mapred.JobClient: Use genericOptions for the > option -libjars > 08/11/06 16:35:54 WARN mapred.JobClient: No job jar file set. User > classes may not be found. See JobConf(Class) or > JobConf#setJar(String). > 08/11/06 16:35:54 INFO mapred.JobClient: Running job: job_200811061631_0001 > 08/11/06 16:35:55 INFO mapred.JobClient: map 0% reduce 0% > 08/11/06 16:35:59 INFO mapred.JobClient: map 50% reduce 0% > 08/11/06 16:36:09 INFO mapred.JobClient: map 50% reduce 16% > 08/11/06 16:39:01 INFO mapred.JobClient: Task Id : > attempt_200811061631_0001_m_000001_0, Status : FAILED > org.apache.hadoop.hbase.UnknownScannerException: > org.apache.hadoop.hbase.UnknownScannerException: Name: > -1687189961475873913 > at > org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1077) > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888) > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at > org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82) > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:856) > at > org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1155) > at > org.apache.hama.mapred.VectorInputFormatBase$TableRecordReader.next(VectorInputFormatBase.java:174) > at > org.apache.hama.mapred.VectorInputFormatBase$TableRecordReader.next(VectorInputFormatBase.java:56) > at > org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:165) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227) > at > org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207) > > 08/11/06 16:40:22 INFO mapred.JobClient: Task Id : > attempt_200811061631_0001_m_000001_1, Status : FAILED > org.apache.hadoop.hbase.UnknownScannerException: > org.apache.hadoop.hbase.UnknownScannerException: Name: > 745631933222911092 > at > org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1077) > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888) > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at > org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82) > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:856) > at > org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1155) > at > org.apache.hama.mapred.VectorInputFormatBase$TableRecordReader.next(VectorInputFormatBase.java:174) > at > org.apache.hama.mapred.VectorInputFormatBase$TableRecordReader.next(VectorInputFormatBase.java:56) > at > org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:165) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227) > at > org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207) > > 08/11/06 16:42:06 INFO mapred.JobClient: Task Id : > attempt_200811061631_0001_m_000001_2, Status : FAILED > org.apache.hadoop.hbase.UnknownScannerException: > org.apache.hadoop.hbase.UnknownScannerException: Name: > -8279337588883268282 > at > org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1077) > at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888) > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at > org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82) > at > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:856) > at > org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1155) > at > org.apache.hama.mapred.VectorInputFormatBase$TableRecordReader.next(VectorInputFormatBase.java:174) > at > org.apache.hama.mapred.VectorInputFormatBase$TableRecordReader.next(VectorInputFormatBase.java:56) > at > org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:165) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227) > at > org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207) > > 08/11/06 16:42:08 INFO mapred.JobClient: map 100% reduce 16% > 08/11/06 16:42:17 INFO mapred.JobClient: Job complete: > job_200811061631_0001 > 08/11/06 16:42:17 INFO mapred.JobClient: Counters: 13 > 08/11/06 16:42:17 INFO mapred.JobClient: File Systems > 08/11/06 16:42:17 INFO mapred.JobClient: Local bytes read=310 > 08/11/06 16:42:17 INFO mapred.JobClient: Local bytes written=706 > 08/11/06 16:42:17 INFO mapred.JobClient: Job Counters > 08/11/06 16:42:17 INFO mapred.JobClient: Launched reduce tasks=1 > 08/11/06 16:42:17 INFO mapred.JobClient: Launched map tasks=6 > 08/11/06 16:42:17 INFO mapred.JobClient: Map-Reduce Framework > 08/11/06 16:42:17 INFO mapred.JobClient: Reduce input groups=2 > 08/11/06 16:42:17 INFO mapred.JobClient: Combine output records=0 > 08/11/06 16:42:17 INFO mapred.JobClient: Map input records=2 > 08/11/06 16:42:17 INFO mapred.JobClient: Reduce output records=2 > 08/11/06 16:42:17 INFO mapred.JobClient: Map output bytes=288 > 08/11/06 16:42:17 INFO mapred.JobClient: Map input bytes=0 > 08/11/06 16:42:17 INFO mapred.JobClient: Combine input records=0 > 08/11/06 16:42:17 INFO mapred.JobClient: Map output records=4 > 08/11/06 16:42:17 INFO mapred.JobClient: Reduce input records=4 > 08/11/06 16:42:21 INFO client.HBaseAdmin: Disabled DenseMatrix_randsmsif > 08/11/06 16:42:21 INFO client.HBaseAdmin: Deleted DenseMatrix_randsmsif > 08/11/06 16:42:28 INFO client.HBaseAdmin: Disabled DenseMatrix_randcnzdg > 08/11/06 16:42:28 INFO client.HBaseAdmin: Deleted DenseMatrix_randcnzdg > 08/11/06 16:42:34 INFO client.HBaseAdmin: Disabled DenseMatrix_randvhcsa > 08/11/06 16:42:35 INFO client.HBaseAdmin: Deleted DenseMatrix_randvhcsa > > > -- > Best Regards, Edward J. Yoon @ NHN, corp. > [EMAIL PROTECTED] > http://blog.udanax.org >
