I was trying to bulk increment some files into a HBAse (0.89) table and found 
this problem..

If a file does not fit into any of the regions in the existing table, then the 
tool gets into an infinite loop of splitting the files.. I have attached a 
sample output.. Todd, is this a known issue?

Vidhya

10/09/07 01:57:29 INFO mapreduce.LoadIncrementalHFiles: Trying to load 
hfile=hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/8375781572558986795
 first=0000003511885973 last=0000003511999994
10/09/07 01:57:29 INFO mapreduce.LoadIncrementalHFiles: HFile at 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/8375781572558986795
 no longer fits inside a single region. Splitting...
10/09/07 01:57:37 INFO mapreduce.LoadIncrementalHFiles: Successfully split into 
new HFiles 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/fae6ef95297635e32e24c572bec9056e.bottom
 and 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/fae6ef95297635e32e24c572bec9056e.top
10/09/07 01:57:37 INFO mapreduce.LoadIncrementalHFiles: Trying to load 
hfile=hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/fae6ef95297635e32e24c572bec9056e.top
 first=0000003511885973 last=0000003511999994
10/09/07 01:57:37 INFO mapreduce.LoadIncrementalHFiles: HFile at 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/fae6ef95297635e32e24c572bec9056e.top
 no longer fits inside a single region. Splitting...
10/09/07 01:57:44 INFO mapreduce.LoadIncrementalHFiles: Successfully split into 
new HFiles 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.bottom
 and 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.top
10/09/07 01:57:44 INFO mapreduce.LoadIncrementalHFiles: Trying to load 
hfile=hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.top
 first=0000003511885973 last=0000003511999994
10/09/07 01:57:44 INFO mapreduce.LoadIncrementalHFiles: HFile at 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.top
 no longer fits inside a single region. Splitting...
10/09/07 01:57:51 INFO mapreduce.LoadIncrementalHFiles: Successfully split into 
new HFiles 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.bottom
 and 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.top
10/09/07 01:57:51 INFO mapreduce.LoadIncrementalHFiles: Trying to load 
hfile=hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.top
 first=0000003511885973 last=0000003511999994
10/09/07 01:57:51 INFO mapreduce.LoadIncrementalHFiles: HFile at 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.top
 no longer fits inside a single region. Splitting...
10/09/07 01:57:59 INFO mapreduce.LoadIncrementalHFiles: Successfully split into 
new HFiles 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.bottom
 and 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.top
10/09/07 01:57:59 INFO mapreduce.LoadIncrementalHFiles: Trying to load 
hfile=hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.top
 first=0000003511885973 last=0000003511999994
10/09/07 01:57:59 INFO mapreduce.LoadIncrementalHFiles: HFile at 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.top
 no longer fits inside a single region. Splitting...
10/09/07 01:58:06 INFO mapreduce.LoadIncrementalHFiles: Successfully split into 
new HFiles 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/_tmp/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.bottom
 and 
hdfs://b3130080.yst.yahoo.net:4600/user/crawler/docd_inc_v1/bigColumn/_tmp/_tmp/_tmp/_tmp/_tmp/fae6ef95297635e32e24c572bec9056e.top

Reply via email to