[jira] [Updated] (HBASE-10549) When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-10549: --- Resolution: Fixed Fix Version/s: (was: 0.98.2) Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) HTable construction is not checking whether table exists or not because of HBASE-10080 which is committed to trunk and 0.98 so not able to find the previous test case failures with the patch. Its not a problem. 0.96 build is successful with the test case. Hence resolving. I will raise separate jira to backport to 0.98. I think zombies in 0.98 might not be related to this patch. > When there is a hole, LoadIncrementalHFiles will hang in an infinite loop. > -- > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.98.0, 0.94.11, 0.96.1.1 >Reporter: yuanxinen >Assignee: yuanxinen > Fix For: 0.96.2, 0.99.0, 0.94.18 > > Attachments: HBASE-10549-0.94, HBASE-10549-addendum.patch, > HBASE-10549-trunk-2014-03-13.patch, HBASE-10549-trunk.patch > > > First,I explan my test steps. > 1.importtsv > 2.split the region > 3.delete the region info from .META.(make a hole) > 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) > I check the log,there are two issues > 1.it create _tmp folder in an infinite loop. > hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom > 2.when slpliting the hfile,it put the first line data(1211) into two > files(top and bottom) > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > and then I check the code. > So I think before spliting the hfile,we should check the consistency of > startkey and endkey,if something wrong,we should throw the exception,and stop > LoadIncrementalHFiles. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-10549: --- Assignee: yuanxinen (was: rajeshbabu) > When there is a hole, LoadIncrementalHFiles will hang in an infinite loop. > -- > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.98.0, 0.94.11, 0.96.1.1 >Reporter: yuanxinen >Assignee: yuanxinen > Fix For: 0.96.2, 0.99.0, 0.94.18, 0.98.2 > > Attachments: HBASE-10549-0.94, HBASE-10549-addendum.patch, > HBASE-10549-trunk-2014-03-13.patch, HBASE-10549-trunk.patch > > > First,I explan my test steps. > 1.importtsv > 2.split the region > 3.delete the region info from .META.(make a hole) > 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) > I check the log,there are two issues > 1.it create _tmp folder in an infinite loop. > hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom > 2.when slpliting the hfile,it put the first line data(1211) into two > files(top and bottom) > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > and then I check the code. > So I think before spliting the hfile,we should check the consistency of > startkey and endkey,if something wrong,we should throw the exception,and stop > LoadIncrementalHFiles. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-10549: --- Hadoop Flags: (was: Reviewed) Status: Patch Available (was: Reopened) > When there is a hole, LoadIncrementalHFiles will hang in an infinite loop. > -- > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.96.1.1, 0.94.11, 0.98.0 >Reporter: yuanxinen >Assignee: rajeshbabu > Fix For: 0.96.2, 0.99.0, 0.94.18, 0.98.2 > > Attachments: HBASE-10549-0.94, HBASE-10549-addendum.patch, > HBASE-10549-trunk-2014-03-13.patch, HBASE-10549-trunk.patch > > > First,I explan my test steps. > 1.importtsv > 2.split the region > 3.delete the region info from .META.(make a hole) > 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) > I check the log,there are two issues > 1.it create _tmp folder in an infinite loop. > hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom > 2.when slpliting the hfile,it put the first line data(1211) into two > files(top and bottom) > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > and then I check the code. > So I think before spliting the hfile,we should check the consistency of > startkey and endkey,if something wrong,we should throw the exception,and stop > LoadIncrementalHFiles. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-10549: --- Attachment: HBASE-10549-addendum.patch The main reason for the failure is HTable is getting constructed before creating table. I will check why trunk code accepting this. > When there is a hole, LoadIncrementalHFiles will hang in an infinite loop. > -- > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.98.0, 0.94.11, 0.96.1.1 >Reporter: yuanxinen >Assignee: rajeshbabu > Fix For: 0.96.2, 0.99.0, 0.94.18, 0.98.2 > > Attachments: HBASE-10549-0.94, HBASE-10549-addendum.patch, > HBASE-10549-trunk-2014-03-13.patch, HBASE-10549-trunk.patch > > > First,I explan my test steps. > 1.importtsv > 2.split the region > 3.delete the region info from .META.(make a hole) > 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) > I check the log,there are two issues > 1.it create _tmp folder in an infinite loop. > hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom > 2.when slpliting the hfile,it put the first line data(1211) into two > files(top and bottom) > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > and then I check the code. > So I think before spliting the hfile,we should check the consistency of > startkey and endkey,if something wrong,we should throw the exception,and stop > LoadIncrementalHFiles. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-10549: --- Fix Version/s: (was: 0.98.1) 0.98.2 > When there is a hole, LoadIncrementalHFiles will hang in an infinite loop. > -- > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.98.0, 0.94.11, 0.96.1.1 >Reporter: yuanxinen >Assignee: rajeshbabu > Fix For: 0.96.2, 0.99.0, 0.94.18, 0.98.2 > > Attachments: HBASE-10549-0.94, HBASE-10549-trunk-2014-03-13.patch, > HBASE-10549-trunk.patch > > > First,I explan my test steps. > 1.importtsv > 2.split the region > 3.delete the region info from .META.(make a hole) > 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) > I check the log,there are two issues > 1.it create _tmp folder in an infinite loop. > hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom > 2.when slpliting the hfile,it put the first line data(1211) into two > files(top and bottom) > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > and then I check the code. > So I think before spliting the hfile,we should check the consistency of > startkey and endkey,if something wrong,we should throw the exception,and stop > LoadIncrementalHFiles. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-10549: --- Resolution: Fixed Fix Version/s: (was: 0.98.2) (was: 0.94.19) 0.94.18 0.98.1 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed the patch to all versions. Thanks for the patch [~Auraro]. Thank you all for reviews. > When there is a hole, LoadIncrementalHFiles will hang in an infinite loop. > -- > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.98.0, 0.94.11, 0.96.1.1 >Reporter: yuanxinen >Assignee: yuanxinen > Fix For: 0.96.2, 0.98.1, 0.99.0, 0.94.18 > > Attachments: HBASE-10549-0.94, HBASE-10549-trunk-2014-03-13.patch, > HBASE-10549-trunk.patch > > > First,I explan my test steps. > 1.importtsv > 2.split the region > 3.delete the region info from .META.(make a hole) > 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) > I check the log,there are two issues > 1.it create _tmp folder in an infinite loop. > hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom > 2.when slpliting the hfile,it put the first line data(1211) into two > files(top and bottom) > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > and then I check the code. > So I think before spliting the hfile,we should check the consistency of > startkey and endkey,if something wrong,we should throw the exception,and stop > LoadIncrementalHFiles. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxinen updated HBASE-10549: -- Attachment: HBASE-10549-0.94 The patch is for 0.94 > When there is a hole, LoadIncrementalHFiles will hang in an infinite loop. > -- > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.98.0, 0.94.11, 0.96.1.1 >Reporter: yuanxinen >Assignee: yuanxinen > Fix For: 0.96.2, 0.99.0, 0.94.19, 0.98.2 > > Attachments: HBASE-10549-0.94, HBASE-10549-trunk-2014-03-13.patch, > HBASE-10549-trunk.patch > > > First,I explan my test steps. > 1.importtsv > 2.split the region > 3.delete the region info from .META.(make a hole) > 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) > I check the log,there are two issues > 1.it create _tmp folder in an infinite loop. > hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom > 2.when slpliting the hfile,it put the first line data(1211) into two > files(top and bottom) > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > and then I check the code. > So I think before spliting the hfile,we should check the consistency of > startkey and endkey,if something wrong,we should throw the exception,and stop > LoadIncrementalHFiles. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-10549: -- Fix Version/s: (was: 0.94.18) 0.94.19 > When there is a hole, LoadIncrementalHFiles will hang in an infinite loop. > -- > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.98.0, 0.94.11, 0.96.1.1 >Reporter: yuanxinen >Assignee: yuanxinen > Fix For: 0.96.2, 0.99.0, 0.94.19, 0.98.2 > > Attachments: HBASE-10549-trunk-2014-03-13.patch, > HBASE-10549-trunk.patch > > > First,I explan my test steps. > 1.importtsv > 2.split the region > 3.delete the region info from .META.(make a hole) > 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) > I check the log,there are two issues > 1.it create _tmp folder in an infinite loop. > hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom > 2.when slpliting the hfile,it put the first line data(1211) into two > files(top and bottom) > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > and then I check the code. > So I think before spliting the hfile,we should check the consistency of > startkey and endkey,if something wrong,we should throw the exception,and stop > LoadIncrementalHFiles. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu updated HBASE-10549: --- Fix Version/s: 0.98.2 0.94.18 0.99.0 0.96.2 > When there is a hole, LoadIncrementalHFiles will hang in an infinite loop. > -- > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.98.0, 0.94.11, 0.96.1.1 >Reporter: yuanxinen >Assignee: yuanxinen > Fix For: 0.96.2, 0.99.0, 0.94.18, 0.98.2 > > Attachments: HBASE-10549-trunk-2014-03-13.patch, > HBASE-10549-trunk.patch > > > First,I explan my test steps. > 1.importtsv > 2.split the region > 3.delete the region info from .META.(make a hole) > 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) > I check the log,there are two issues > 1.it create _tmp folder in an infinite loop. > hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom > 2.when slpliting the hfile,it put the first line data(1211) into two > files(top and bottom) > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > and then I check the code. > So I think before spliting the hfile,we should check the consistency of > startkey and endkey,if something wrong,we should throw the exception,and stop > LoadIncrementalHFiles. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanxinen updated HBASE-10549: -- Attachment: HBASE-10549-trunk-2014-03-13.patch Thank you for your comments. I made some changes, such as dividing the check into three branches,useing MetaEditor.deleteRegion instead of deleteMetaInfo method,and other small changes. Please review. > When there is a hole, LoadIncrementalHFiles will hang in an infinite loop. > -- > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.98.0, 0.94.11, 0.96.1.1 >Reporter: yuanxinen >Assignee: yuanxinen > Attachments: HBASE-10549-trunk-2014-03-13.patch, > HBASE-10549-trunk.patch > > > First,I explan my test steps. > 1.importtsv > 2.split the region > 3.delete the region info from .META.(make a hole) > 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) > I check the log,there are two issues > 1.it create _tmp folder in an infinite loop. > hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom > 2.when slpliting the hfile,it put the first line data(1211) into two > files(top and bottom) > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > and then I check the code. > So I think before spliting the hfile,we should check the consistency of > startkey and endkey,if something wrong,we should throw the exception,and stop > LoadIncrementalHFiles. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-10549: --- Affects Version/s: 0.98.0 0.96.1.1 Fix Version/s: (was: 0.94.18) (was: 0.99.0) (was: 0.98.1) (was: 0.96.2) > When there is a hole, LoadIncrementalHFiles will hang in an infinite loop. > -- > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.98.0, 0.94.11, 0.96.1.1 >Reporter: yuanxinen >Assignee: yuanxinen > Attachments: HBASE-10549-trunk.patch > > > First,I explan my test steps. > 1.importtsv > 2.split the region > 3.delete the region info from .META.(make a hole) > 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) > I check the log,there are two issues > 1.it create _tmp folder in an infinite loop. > hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom > 2.when slpliting the hfile,it put the first line data(1211) into two > files(top and bottom) > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > and then I check the code. > So I think before spliting the hfile,we should check the consistency of > startkey and endkey,if something wrong,we should throw the exception,and stop > LoadIncrementalHFiles. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HBASE-10549) When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
[ https://issues.apache.org/jira/browse/HBASE-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-10549: --- Summary: When there is a hole, LoadIncrementalHFiles will hang in an infinite loop. (was: when there is a hole,LoadIncrementalHFiles will hung up in an infinite loop.) > When there is a hole, LoadIncrementalHFiles will hang in an infinite loop. > -- > > Key: HBASE-10549 > URL: https://issues.apache.org/jira/browse/HBASE-10549 > Project: HBase > Issue Type: Bug > Components: HFile >Affects Versions: 0.94.11 >Reporter: yuanxinen > Fix For: 0.96.2, 0.98.1, 0.99.0, 0.94.18 > > Attachments: HBASE-10549-trunk.patch > > > First,I explan my test steps. > 1.importtsv > 2.split the region > 3.delete the region info from .META.(make a hole) > 4.LoadIncrementalHFiles (this step will hung up in an infinite loop) > I check the log,there are two issues > 1.it create _tmp folder in an infinite loop. > hdfs://hacluster/output3/i/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/test_table,136.bottom > 2.when slpliting the hfile,it put the first line data(1211) into two > files(top and bottom) > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.top,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > Input > File=hdfs://hacluster/output3/i/3ac6ec287c644a8fb72d96b13e31f576,outFile=hdfs://hacluster/output3/i/_tmp/test_table,2.bottom,KeyValue=1211/i:value/1390469306407/Put/vlen=1/ts=0 > and then I check the code. > So I think before spliting the hfile,we should check the consistency of > startkey and endkey,if something wrong,we should throw the exception,and stop > LoadIncrementalHFiles. -- This message was sent by Atlassian JIRA (v6.2#6252)
