[jira] [Updated] (HBASE-10549) when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxinen updated HBASE-10549: -- Description: First,I explan my test steps. 1.importtsv 2.split the region 3.delete the region info from .META.(make a hole) 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) I check the log,there are two issues 1.it create _tmp folder in an infinite loop. hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom 2.when slpliting the hfile,it put the first line data(1211) into two files(top and bottom) Input File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 Input File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 and then I check the code. So I think before spliting the hfile,we should check the consistency of startkey and endkey,if something wrong,we should throw the exception,and stop LoadIncrementalHFiles. > when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop. > > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.94.11 >Reporter: yuanxinen > Fix For: 0.96.2, 0.98.1, 0.99.0, 0.94.18 > > Attachments: HBASE-10549-trunk.patch > > > First,I explan my test steps. > 1.importtsv > 2.split the region > 3.delete the region info from .META.(make a hole) > 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) > I check the log,there are two issues > 1.it create _tmp folder in an infinite loop. > hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom > 2.when slpliting the hfile,it put the first line data(1211) into two > files(top and bottom) > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > and then I check the code. > So I think before spliting the hfile,we should check the consistency of > startkey and endkey,if something wrong,we should throw the exception,and stop > LoadIncrementalHFiles. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxinen updated HBASE-10549: -- Component/s: HFile > when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop. > > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.94.11 >Reporter: yuanxinen > Fix For: 0.96.2, 0.98.1, 0.99.0, 0.94.18 > > Attachments: HBASE-10549-trunk.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxinen updated HBASE-10549: -- Component/s: (was: HFile) > when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop. > > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug >Affects Versions: 0.94.11 >Reporter: yuanxinen > Fix For: 0.96.2, 0.98.1, 0.99.0, 0.94.18 > > Attachments: HBASE-10549-trunk.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxinen updated HBASE-10549: -- Fix Version/s: 0.94.18 0.98.1 0.96.2 Status: Patch Available (was: Open) > when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop. > > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.94.11 >Reporter: yuanxinen > Fix For: 0.96.2, 0.98.1, 0.99.0, 0.94.18 > > Attachments: HBASE-10549-trunk.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxinen updated HBASE-10549: -- Attachment: HBASE-10549-trunk.patch Here is the patch for trunk. In the patch checking for any region holes and throwing exception if any. Added test case to reproduce the issue and its passing with the fix. Please review. > when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop. > > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.94.11 >Reporter: yuanxinen > Fix For: 0.99.0 > > Attachments: HBASE-10549-trunk.patch > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxinen updated HBASE-10549: -- Status: Open (was: Patch Available) > when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop. > > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.94.11 >Reporter: yuanxinen > Fix For: 0.99.0 > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxinen updated HBASE-10549: -- Fix Version/s: 0.99.0 Status: Patch Available (was: Open) > when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop. > > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.94.11 >Reporter: yuanxinen > Fix For: 0.99.0 > > -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxinen updated HBASE-10549: -- Priority: Major (was: Minor) > when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop. > > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.94.11 >Reporter: yuanxinen > -- This message was sent by Atlassian JIRA (v6.1.5#6160)
