[
https://issues.apache.org/jira/browse/HBASE-12891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Purtell updated HBASE-12891:
-----------------------------------
Fix Version/s: (was: 0.98.10)
0.98.11
I can reproduce these failures upon the first run of TestHBaseFsck locally.
{noformat}
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.hadoop.hbase.util.TestHBaseFsck
Tests run: 49, Failures: 4, Errors: 0, Skipped: 1, Time elapsed: 264.92 sec <<<
FAILURE! - in org.apache.hadoop.hbase.util.TestHBaseFsck
testHbckWithExcessReplica(org.apache.hadoop.hbase.util.TestHBaseFsck) Time
elapsed: 3.016 sec <<< FAILURE!
java.lang.AssertionError: expected:<[]> but was:<[NOT_IN_HDFS, NOT_IN_HDFS,
NOT_IN_HDFS, NOT_IN_HDFS]>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at
org.apache.hadoop.hbase.util.hbck.HbckTestingUtil.assertNoErrors(HbckTestingUtil.java:89)
at
org.apache.hadoop.hbase.util.TestHBaseFsck.testHbckWithExcessReplica(TestHBaseFsck.java:676)
testHbckWithFewerReplica(org.apache.hadoop.hbase.util.TestHBaseFsck) Time
elapsed: 3.042 sec <<< FAILURE!
java.lang.AssertionError: expected:<[]> but was:<[NOT_IN_HDFS, NOT_IN_HDFS,
NOT_IN_HDFS, NOT_IN_HDFS]>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at
org.apache.hadoop.hbase.util.hbck.HbckTestingUtil.assertNoErrors(HbckTestingUtil.java:89)
at
org.apache.hadoop.hbase.util.TestHBaseFsck.testHbckWithFewerReplica(TestHBaseFsck.java:652)
testNotInHdfsWithReplicas(org.apache.hadoop.hbase.util.TestHBaseFsck) Time
elapsed: 1.487 sec <<< FAILURE!
java.lang.AssertionError: expected:<[NOT_IN_HDFS]> but was:<[NOT_IN_HDFS,
NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS]>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at
org.apache.hadoop.hbase.util.hbck.HbckTestingUtil.assertErrors(HbckTestingUtil.java:97)
at
org.apache.hadoop.hbase.util.TestHBaseFsck.testNotInHdfsWithReplicas(TestHBaseFsck.java:1335)
testHbckWithRegionReplica(org.apache.hadoop.hbase.util.TestHBaseFsck) Time
elapsed: 1.991 sec <<< FAILURE!
java.lang.AssertionError: expected:<[]> but was:<[NOT_IN_HDFS, NOT_IN_HDFS,
NOT_IN_HDFS, NOT_IN_HDFS]>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at
org.apache.hadoop.hbase.util.hbck.HbckTestingUtil.assertNoErrors(HbckTestingUtil.java:89)
at
org.apache.hadoop.hbase.util.TestHBaseFsck.testHbckWithRegionReplica(TestHBaseFsck.java:639)
Results :
Failed tests:
TestHBaseFsck.testHbckWithExcessReplica:676 expected:<[]> but
was:<[NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS]>
TestHBaseFsck.testHbckWithFewerReplica:652 expected:<[]> but
was:<[NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS]>
TestHBaseFsck.testHbckWithRegionReplica:639 expected:<[]> but
was:<[NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS]>
TestHBaseFsck.testNotInHdfsWithReplicas:1335 expected:<[NOT_IN_HDFS]> but
was:<[NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS, NOT_IN_HDFS]>
Tests run: 49, Failures: 4, Errors: 0, Skipped: 1
{noformat}
Moving out of 0.98.10.
> have hbck do region consistency checks in parallel
> --------------------------------------------------
>
> Key: HBASE-12891
> URL: https://issues.apache.org/jira/browse/HBASE-12891
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 2.0.0, 0.98.10, 1.1.0
> Reporter: churro morales
> Assignee: churro morales
> Fix For: 1.0.0, 2.0.0, 1.1.0, 0.98.11
>
> Attachments: HBASE-12891.98.patch, HBASE-12891.patch,
> HBASE-12891.patch
>
>
> We have a lot of regions on our cluster ~500k and noticed that hbck took
> quite some time in checkAndFixConsistency(). [~davelatham] patched our
> cluster to do this check in parallel to speed things up. I'll attach the
> patch.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
