[jira] [Commented] (HBASE-19331) Region start-key/end-key corruption in Hbase meta table
[ https://issues.apache.org/jira/browse/HBASE-19331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265694#comment-16265694 ] Shamith kumar commented on HBASE-19331: --- Every key that i inserted to table are long. hence why should there be a start/end key in HRegionInfo which is not long. > Region start-key/end-key corruption in Hbase meta table > --- > > Key: HBASE-19331 > URL: https://issues.apache.org/jira/browse/HBASE-19331 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.8 > Environment: Reproduced on HBase 0.98.8 on hadoop-2 >Reporter: Shamith kumar > Attachments: TestSplit.java > > > when a region split happens on a key with trailing byte equals zero, the end > key of the first resulting region and and start key of the second resulting > region in meta table gets corrupted. > Here is the link to code to reproduce this issue > https://bitbucket.org/flytxt/hbase-meta-corruption-test > > *+Test Result+* > [INFO] --- > [INFO] T E S T S > [INFO] --- > [INFO] Running com.flytxt.HbaseRegionMetaTest > log4j:WARN No appenders could be found for logger > (org.apache.hadoop.metrics2.lib.MutableMetricsFactory). > log4j:WARN Please initialize the log4j system properly. > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more > info. > 18:23:54.346 [main] INFO com.flytxt.HbaseRegionMetaTest - Dropping table > SAMPLE_TBL_1 > 18:23:56.094 [main] INFO com.flytxt.HbaseRegionMetaTest - Dropping table > SAMPLE_TBL_2 > 18:23:58.107 [main] INFO com.flytxt.HbaseRegionMetaTest - Creating new table > SAMPLE_TBL_1 > 18:23:58.658 [main] INFO com.flytxt.HbaseRegionMetaTest - Creating new table > SAMPLE_TBL_1 > 18:23:59.212 [main] INFO com.flytxt.HbaseRegionMetaTest - Starting puts to > table SAMPLE_TBL_1 > 18:24:00.046 [main] INFO com.flytxt.HbaseRegionMetaTest - Puts complete .. > lets split SAMPLE_TBL_1 > 18:24:00.500 [main] INFO com.flytxt.HbaseRegionMetaTest - Starting puts to > table SAMPLE_TBL_2 > 18:24:02.073 [main] INFO com.flytxt.HbaseRegionMetaTest - Puts complete .. > lets split SAMPLE_TBL_2 > 18:24:02.753 [main] INFO com.flytxt.HbaseRegionMetaTest - region split > complete .. Lets verify region infos for table SAMPLE_TBL_1 > 18:24:02.754 [main] INFO com.flytxt.HbaseRegionMetaTest - > === > 18:24:02.754 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : > SAMPLE_TBL_1,,1511355240515.56c8fd8e42228c3c1ec71f9a4da65f5f. > 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Id > :1511355240515 > 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - Region start key > :[] , Key length :0 > 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - Region end key : > [0, 0, 0, 0, 0, 19, -76] , Key length :7 > 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - > --- > 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - > === > 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : > SAMPLE_TBL_1,\x00\x00\x00\x00\x00\x13\xB4,1511355240515.c06afed17b2a5c4fb54bacf704dd8a9e. > 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Id > :1511355240515 > 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - Region start key > :[0, 0, 0, 0, 0, 19, -76] , Key length :7 > 18:24:02.763 [main] INFO com.flytxt.HbaseRegionMetaTest - Region end key : [] > , Key length :0 > 18:24:02.763 [main] INFO com.flytxt.HbaseRegionMetaTest - > --- > 18:24:03.005 [main] INFO com.flytxt.HbaseRegionMetaTest - region split > complete .. Lets verify region infos for table SAMPLE_TBL_2 > 18:24:03.006 [main] INFO com.flytxt.HbaseRegionMetaTest - > === > 18:24:03.006 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : > SAMPLE_TBL_2,,1511355242363.0679851100e16aad005c743af618452e. > 18:24:03.006 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Id > :1511355242363 > 18:24:03.007 [main] INFO com.flytxt.HbaseRegionMetaTest - Region start key > :[] , Key length :0 > 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - Region end key : > [0, 0, 0, 0, 0, 0, 19, -57] , Key length :8 > 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - > --- > 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - > === > 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest -
[jira] [Commented] (HBASE-19331) Region start-key/end-key corruption in Hbase meta table
[ https://issues.apache.org/jira/browse/HBASE-19331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265608#comment-16265608 ] Shamith kumar commented on HBASE-19331: --- I did not face any issued accessing table record from split regions. However i face issues while converting the start/end key bytes from HRegionInfo to long value. ie. Bytes.toLong() throws exception. > Region start-key/end-key corruption in Hbase meta table > --- > > Key: HBASE-19331 > URL: https://issues.apache.org/jira/browse/HBASE-19331 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.8 > Environment: Reproduced on HBase 0.98.8 on hadoop-2 >Reporter: Shamith kumar > Attachments: TestSplit.java > > > when a region split happens on a key with trailing byte equals zero, the end > key of the first resulting region and and start key of the second resulting > region in meta table gets corrupted. > Here is the link to code to reproduce this issue > https://bitbucket.org/flytxt/hbase-meta-corruption-test > > *+Test Result+* > [INFO] --- > [INFO] T E S T S > [INFO] --- > [INFO] Running com.flytxt.HbaseRegionMetaTest > log4j:WARN No appenders could be found for logger > (org.apache.hadoop.metrics2.lib.MutableMetricsFactory). > log4j:WARN Please initialize the log4j system properly. > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more > info. > 18:23:54.346 [main] INFO com.flytxt.HbaseRegionMetaTest - Dropping table > SAMPLE_TBL_1 > 18:23:56.094 [main] INFO com.flytxt.HbaseRegionMetaTest - Dropping table > SAMPLE_TBL_2 > 18:23:58.107 [main] INFO com.flytxt.HbaseRegionMetaTest - Creating new table > SAMPLE_TBL_1 > 18:23:58.658 [main] INFO com.flytxt.HbaseRegionMetaTest - Creating new table > SAMPLE_TBL_1 > 18:23:59.212 [main] INFO com.flytxt.HbaseRegionMetaTest - Starting puts to > table SAMPLE_TBL_1 > 18:24:00.046 [main] INFO com.flytxt.HbaseRegionMetaTest - Puts complete .. > lets split SAMPLE_TBL_1 > 18:24:00.500 [main] INFO com.flytxt.HbaseRegionMetaTest - Starting puts to > table SAMPLE_TBL_2 > 18:24:02.073 [main] INFO com.flytxt.HbaseRegionMetaTest - Puts complete .. > lets split SAMPLE_TBL_2 > 18:24:02.753 [main] INFO com.flytxt.HbaseRegionMetaTest - region split > complete .. Lets verify region infos for table SAMPLE_TBL_1 > 18:24:02.754 [main] INFO com.flytxt.HbaseRegionMetaTest - > === > 18:24:02.754 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : > SAMPLE_TBL_1,,1511355240515.56c8fd8e42228c3c1ec71f9a4da65f5f. > 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Id > :1511355240515 > 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - Region start key > :[] , Key length :0 > 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - Region end key : > [0, 0, 0, 0, 0, 19, -76] , Key length :7 > 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - > --- > 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - > === > 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : > SAMPLE_TBL_1,\x00\x00\x00\x00\x00\x13\xB4,1511355240515.c06afed17b2a5c4fb54bacf704dd8a9e. > 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Id > :1511355240515 > 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - Region start key > :[0, 0, 0, 0, 0, 19, -76] , Key length :7 > 18:24:02.763 [main] INFO com.flytxt.HbaseRegionMetaTest - Region end key : [] > , Key length :0 > 18:24:02.763 [main] INFO com.flytxt.HbaseRegionMetaTest - > --- > 18:24:03.005 [main] INFO com.flytxt.HbaseRegionMetaTest - region split > complete .. Lets verify region infos for table SAMPLE_TBL_2 > 18:24:03.006 [main] INFO com.flytxt.HbaseRegionMetaTest - > === > 18:24:03.006 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : > SAMPLE_TBL_2,,1511355242363.0679851100e16aad005c743af618452e. > 18:24:03.006 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Id > :1511355242363 > 18:24:03.007 [main] INFO com.flytxt.HbaseRegionMetaTest - Region start key > :[] , Key length :0 > 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - Region end key : > [0, 0, 0, 0, 0, 0, 19, -57] , Key length :8 > 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - > --- > 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - >
[jira] [Commented] (HBASE-19331) Region start-key/end-key corruption in Hbase meta table
[ https://issues.apache.org/jira/browse/HBASE-19331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262931#comment-16262931 ] Shamith kumar commented on HBASE-19331: --- [~anoop.hbase] If you could guide me to the branch and module of the source code, I can try. > Region start-key/end-key corruption in Hbase meta table > --- > > Key: HBASE-19331 > URL: https://issues.apache.org/jira/browse/HBASE-19331 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.8 > Environment: Reproduced on HBase 0.98.8 on hadoop-2 >Reporter: Shamith kumar > > when a region split happens on a key with trailing byte equals zero, the end > key of the first resulting region and and start key of the second resulting > region in meta table gets corrupted. > Here is the link to code to reproduce this issue > https://bitbucket.org/flytxt/hbase-meta-corruption-test > > *+Test Result+* > [INFO] --- > [INFO] T E S T S > [INFO] --- > [INFO] Running com.flytxt.HbaseRegionMetaTest > log4j:WARN No appenders could be found for logger > (org.apache.hadoop.metrics2.lib.MutableMetricsFactory). > log4j:WARN Please initialize the log4j system properly. > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more > info. > 18:23:54.346 [main] INFO com.flytxt.HbaseRegionMetaTest - Dropping table > SAMPLE_TBL_1 > 18:23:56.094 [main] INFO com.flytxt.HbaseRegionMetaTest - Dropping table > SAMPLE_TBL_2 > 18:23:58.107 [main] INFO com.flytxt.HbaseRegionMetaTest - Creating new table > SAMPLE_TBL_1 > 18:23:58.658 [main] INFO com.flytxt.HbaseRegionMetaTest - Creating new table > SAMPLE_TBL_1 > 18:23:59.212 [main] INFO com.flytxt.HbaseRegionMetaTest - Starting puts to > table SAMPLE_TBL_1 > 18:24:00.046 [main] INFO com.flytxt.HbaseRegionMetaTest - Puts complete .. > lets split SAMPLE_TBL_1 > 18:24:00.500 [main] INFO com.flytxt.HbaseRegionMetaTest - Starting puts to > table SAMPLE_TBL_2 > 18:24:02.073 [main] INFO com.flytxt.HbaseRegionMetaTest - Puts complete .. > lets split SAMPLE_TBL_2 > 18:24:02.753 [main] INFO com.flytxt.HbaseRegionMetaTest - region split > complete .. Lets verify region infos for table SAMPLE_TBL_1 > 18:24:02.754 [main] INFO com.flytxt.HbaseRegionMetaTest - > === > 18:24:02.754 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : > SAMPLE_TBL_1,,1511355240515.56c8fd8e42228c3c1ec71f9a4da65f5f. > 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Id > :1511355240515 > 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - Region start key > :[] , Key length :0 > 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - Region end key : > [0, 0, 0, 0, 0, 19, -76] , Key length :7 > 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - > --- > 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - > === > 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : > SAMPLE_TBL_1,\x00\x00\x00\x00\x00\x13\xB4,1511355240515.c06afed17b2a5c4fb54bacf704dd8a9e. > 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Id > :1511355240515 > 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - Region start key > :[0, 0, 0, 0, 0, 19, -76] , Key length :7 > 18:24:02.763 [main] INFO com.flytxt.HbaseRegionMetaTest - Region end key : [] > , Key length :0 > 18:24:02.763 [main] INFO com.flytxt.HbaseRegionMetaTest - > --- > 18:24:03.005 [main] INFO com.flytxt.HbaseRegionMetaTest - region split > complete .. Lets verify region infos for table SAMPLE_TBL_2 > 18:24:03.006 [main] INFO com.flytxt.HbaseRegionMetaTest - > === > 18:24:03.006 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : > SAMPLE_TBL_2,,1511355242363.0679851100e16aad005c743af618452e. > 18:24:03.006 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Id > :1511355242363 > 18:24:03.007 [main] INFO com.flytxt.HbaseRegionMetaTest - Region start key > :[] , Key length :0 > 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - Region end key : > [0, 0, 0, 0, 0, 0, 19, -57] , Key length :8 > 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - > --- > 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - > === > 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : >
[jira] [Updated] (HBASE-19331) Region start-key/end-key corruption in Hbase meta table
[ https://issues.apache.org/jira/browse/HBASE-19331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shamith kumar updated HBASE-19331: -- Description: when a region split happens on a key with trailing byte equals zero, the end key of the first resulting region and and start key of the second resulting region in meta table gets corrupted. Here is the link to code to reproduce this issue https://bitbucket.org/flytxt/hbase-meta-corruption-test *+Test Result+* [INFO] --- [INFO] T E S T S [INFO] --- [INFO] Running com.flytxt.HbaseRegionMetaTest log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. 18:23:54.346 [main] INFO com.flytxt.HbaseRegionMetaTest - Dropping table SAMPLE_TBL_1 18:23:56.094 [main] INFO com.flytxt.HbaseRegionMetaTest - Dropping table SAMPLE_TBL_2 18:23:58.107 [main] INFO com.flytxt.HbaseRegionMetaTest - Creating new table SAMPLE_TBL_1 18:23:58.658 [main] INFO com.flytxt.HbaseRegionMetaTest - Creating new table SAMPLE_TBL_1 18:23:59.212 [main] INFO com.flytxt.HbaseRegionMetaTest - Starting puts to table SAMPLE_TBL_1 18:24:00.046 [main] INFO com.flytxt.HbaseRegionMetaTest - Puts complete .. lets split SAMPLE_TBL_1 18:24:00.500 [main] INFO com.flytxt.HbaseRegionMetaTest - Starting puts to table SAMPLE_TBL_2 18:24:02.073 [main] INFO com.flytxt.HbaseRegionMetaTest - Puts complete .. lets split SAMPLE_TBL_2 18:24:02.753 [main] INFO com.flytxt.HbaseRegionMetaTest - region split complete .. Lets verify region infos for table SAMPLE_TBL_1 18:24:02.754 [main] INFO com.flytxt.HbaseRegionMetaTest - === 18:24:02.754 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : SAMPLE_TBL_1,,1511355240515.56c8fd8e42228c3c1ec71f9a4da65f5f. 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Id :1511355240515 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - Region start key :[] , Key length :0 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - Region end key : [0, 0, 0, 0, 0, 19, -76] , Key length :7 18:24:02.755 [main] INFO com.flytxt.HbaseRegionMetaTest - --- 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - === 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : SAMPLE_TBL_1,\x00\x00\x00\x00\x00\x13\xB4,1511355240515.c06afed17b2a5c4fb54bacf704dd8a9e. 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Id :1511355240515 18:24:02.762 [main] INFO com.flytxt.HbaseRegionMetaTest - Region start key :[0, 0, 0, 0, 0, 19, -76] , Key length :7 18:24:02.763 [main] INFO com.flytxt.HbaseRegionMetaTest - Region end key : [] , Key length :0 18:24:02.763 [main] INFO com.flytxt.HbaseRegionMetaTest - --- 18:24:03.005 [main] INFO com.flytxt.HbaseRegionMetaTest - region split complete .. Lets verify region infos for table SAMPLE_TBL_2 18:24:03.006 [main] INFO com.flytxt.HbaseRegionMetaTest - === 18:24:03.006 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : SAMPLE_TBL_2,,1511355242363.0679851100e16aad005c743af618452e. 18:24:03.006 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Id :1511355242363 18:24:03.007 [main] INFO com.flytxt.HbaseRegionMetaTest - Region start key :[] , Key length :0 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - Region end key : [0, 0, 0, 0, 0, 0, 19, -57] , Key length :8 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - --- 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - === 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Name : SAMPLE_TBL_2,\x00\x00\x00\x00\x00\x00\x13\xC7,1511355242363.326b5175036efdeae89f9493b436e114. 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - Region Id :1511355242363 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - Region start key :[0, 0, 0, 0, 0, 0, 19, -57] , Key length :8 18:24:03.008 [main] INFO com.flytxt.HbaseRegionMetaTest - Region end key : [] , Key length :0 18:24:03.009 [main] INFO com.flytxt.HbaseRegionMetaTest - --- [ERROR] Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 10.777 s <<< FAILURE! - in com.flytxt.HbaseRegionMetaTest [ERROR] testTableRegionStartAndEndKey[0](com.flytxt.HbaseRegionMetaTest) Time elapsed: 0.228 s <<< FAILURE!
[jira] [Created] (HBASE-19331) Region start-key/end-key corruption in Hbase meta table
Shamith kumar created HBASE-19331: - Summary: Region start-key/end-key corruption in Hbase meta table Key: HBASE-19331 URL: https://issues.apache.org/jira/browse/HBASE-19331 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 0.98.8 Environment: Reproduced on HBase 0.98.8 on hadoop-2 Reporter: Shamith kumar when a region split happens on a key with trailing byte equals zero, the end key of the first resulting region and and start key of the second resulting region in meta table gets corrupted. Here is the link to code to reproduce this issue https://bitbucket.org/flytxt/hbase-meta-corruption-test -- This message was sent by Atlassian JIRA (v6.4.14#64029)
