All that means is that the task stayed in map() for 10 minutes,
blocked on "something".

If you were scanning an hbase table, and didn't get a new row after 1
minute, then the scanner would expire. That's orthogonal tho.

You need to figure what you're blocking on, add logging and try to
jstack your Child processes for example.

J-D

On Thu, May 12, 2011 at 7:21 PM, Venkatesh <[email protected]> wrote:
>
>  Hi
> Using hbase-0.20.6
>
> mapreduce job started failing in the map phase (using hbase table as input 
> for mapper)..(ran fine for a week or so starting with empty tables)..
>
> task tracker log:
>
>
> Task attempt_201105121141_0002_m_000452_0 failed to report status for 600 
> seconds. Killing
>
>
> Region server log:
>
> 2011-05-12 18:27:39,919 INFO 
> org.apache.hadoop.hbase.regionserver.HRegionServer: Scanner 
> -7857209327501974146 lease expired
>
> 2011-05-12 18:28:29,716 ERROR 
> org.apache.hadoop.hbase.regionserver.HRegionServer:org.apache.hadoop.hbase.UnknownScannerException:
>  Name: -7857209327501974146
>        at 
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1880)
>         at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)        
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:657)
>        at 
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
>
> 2011-05-12 18:28:29,897 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server 
> handler 3 on 60020, call next(-78572093275019
> 74146, 1) from .....:35202: error: 
> org.apache.hadoop.hbase.UnknownScannerException: Name: -7857209327501974146
> org.apache.hadoop.hbase.UnknownScannerException: Name: -7857209327501974146
>        at 
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1880)
>        at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
>        at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:657)
>        at 
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> I don't see any error in datanodes
>
> Appreciate any help
> thanks
> v
>
>
>

Reply via email to