I received ScannerTimeoutException.
hbase.regionserver.lease.period is 240000.
table : 100 rows, one column, the cell is 2 MB.
So, total size of table entries is 200 MB.
Each map open a scanner of another table and, doing little big calculation.
How can I avoid ScannerTimeoutException?
----
org.apache.hadoop.hbase.client.ScannerTimeoutException
at org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java
1527)
at org.apache.hama.mapred.BlockInputFormat$TableRecordReader.next(Block
nputFormat.java:79)
at org.apache.hama.mapred.BlockInputFormat$TableRecordReader.next(Block
nputFormat.java:47)
at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapT
sk.java:186)
at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.ja
a:170)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
at org.apache.hadoop.mapred.Child.main(Child.java:155)
Caused by: org.apache.hadoop.hbase.UnknownScannerException: org.apache.hadoop.h
ase.UnknownScannerException: Name: 8114675974483083235
at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServe
.java:1561)
at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcce
sorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:632)
at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java
894)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruc
orAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Delegating
onstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException
RemoteExceptionHandler.java:95)
at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRe
ionServerWithRetries(HConnectionManager.java:855)
at org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java
1523)
... 7 more
--
Best Regards, Edward J. Yoon @ NHN, corp.
[email protected]
http://blog.udanax.org