Hi,
I am using hbase-0.19 on 20 node ec2 cluster.
I have a map-reduce program which performs some analysis on each row.
when i process about 17k rows in ec2 cluster, after performing 65%, my job
fails
after going through the logs, in the UI we found out that the job failed
because of a Scanner Timeout Exception.
My map function reads data from one table 'table1' performs analysis, if
analysis is completed, i mark the status of the row to 'analyzed' (table1
has a column-family called status). and i write the result of the analyzed
data into table2. (All this happens in my map function. i have no reduce for
this).
i did go through the archives.. where someone mentioned to increase the
reagion lease period. so i increased the lease period to 360000 ms (1 hour).
despite that i came across Scanner Timeout Exception.
Your help will be greatly appreciated as this scanner timeout exception is a
blocker to my application.
Thanks,
Raakhi