Andrew, maybe you can turn your ITBLL notes into docs in the reference guide. There’s a whole section in there about testing.
On Sat, Feb 2, 2019 at 4:03 PM Andrew Purtell <[email protected]> wrote: > Thanks. As I am not able to produce those unit test results we will need > your help to diagnose the issues. Please file > > The ITBLL results may be a tool usage problem. The numbers in the failure > messages you posted are too round. I expect real failures to produce more > irregular numbers. ITBLL can a bit hard to use. Contact me offline and I’ll > give you notes on how I ran the tests myself. > > > > On Feb 2, 2019, at 3:45 PM, Xu Cang <[email protected]> > wrote: > > > > 2 jars sha12 verification: pass. > > Basic UI check: pass. > > Unit test. Some failures in hbase - server package. (see details below, > > not sure if these are flaky tests) > > ITBLL tests with slowDeterministic and serverKilling monky. Both got some > > failures. (Not sure if this is my environment issue since I am using *my > > laptop* to conduct this testing) > > Not voting for now since I have some doubts regarding my testing result. > > Will keep looking. > > > > > > - *Unit test failure: (failures are reproducable)* > > > > [INFO] Results: > > [INFO] > > [ERROR] Failures: > > [ERROR] > > > TestRegionLocationCaching.testCachingForHTableMultiPut:133->checkRegionLocationIsCached:148 > > Expected non-zero number of cached region locations. Actual: 0 > > [ERROR] > > > TestRegionLocationCaching.testCachingForHTableMultiplexerMultiPut:95->checkRegionLocationIsCached:148 > > Expected non-zero number of cached region locations. Actual: 0 > > [ERROR] > > > TestRegionLocationCaching.testCachingForHTableMultiplexerSinglePut:73->checkRegionLocationIsCached:148 > > Expected non-zero number of cached region locations. Actual: 0 > > [ERROR] > > > TestRegionLocationCaching.testCachingForHTableSinglePut:116->checkRegionLocationIsCached:148 > > Expected non-zero number of cached region locations. Actual: 0 > > [ERROR] TestReplicasClient.testHedgedRead:595 expected:<0> but was:<1> > > [ERROR] > > > TestFilterListOrOperatorWithBlkCnt.testMultiRowRangeWithFilterListOrOperatorWithBlkCnt:127 > > expected:<4> but was:<5> > > [ERROR] TestRegionServerMetrics.testRequestCount:137 Metrics Counters > > should be equal expected:<59> but was:<89> > > [INFO] > > [ERROR] Tests run: 1870, Failures: 7, Errors: 0, Skipped: 17 > > > > > > - > > *ITBLL testing result: (failures are reproducable) * > > > > ./bin/hbase org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList > Loop > > 1 1 25000000 /tmp/itbll 1 -m slowDeterministic > > > > 2019-02-01 23:31:03,746 INFO [main] mapreduce.Job: map 100% reduce 100% > > 2019-02-01 23:31:03,746 INFO [main] mapreduce.Job: Job > > job_local221831554_0003 completed successfully > > 2019-02-01 23:31:03,758 INFO [main] mapreduce.Job: 175000018 > > Input split bytes=679 > > Combine input records=0 > > Combine output records=0 > > Reduce input groups=75000000 > > Reduce shuffle bytes=5175000018 > > Reduce input records=150000000 > > Reduce output records=0 > > Spilled Records=561948580 > > Shuffled Maps =3 > > Failed Shuffles=0 > > Merged Map outputs=3 > > GC time elapsed (ms)=1859 > > Total committed heap usage (bytes)=1846542336 > > HBase Counters > > BYTES_IN_REMOTE_RESULTS=0 > > BYTES_IN_RESULTS=31125001574 > > MILLIS_BETWEEN_NEXTS=934178 > > NOT_SERVING_REGION_EXCEPTION=7 > > NUM_SCANNER_RESTARTS=0 > > NUM_SCAN_RESULTS_STALE=0 > > REGIONS_SCANNED=12 > > REMOTE_RPC_CALLS=0 > > REMOTE_RPC_RETRIES=0 > > ROWS_FILTERED=12 > > ROWS_SCANNED=75000012 > > RPC_CALLS=14607 > > RPC_RETRIES=7 > > Shuffle Errors > > BAD_ID=0 > > CONNECTION=0 > > IO_ERROR=0 > > WRONG_LENGTH=0 > > WRONG_MAP=0 > > WRONG_REDUCE=0 > > > org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList$Verify$Counts > > REFERENCED=75000000 > > File Input Format Counters > > Bytes Read=0 > > File Output Format Counters > > Bytes Written=108 > > 2019-02-01 23:31:03,764 ERROR [main] > > test.IntegrationTestBigLinkedList$Verify: *Expected referenced count does > > not match with actual referenced count. expected referenced=25000000 > > ,actual=75000000* > > > > > > ./bin/hbase org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList > Loop > > 1 4 1000000 /tmp/itbll 4 -m slowDeterministic > > 2019-02-02 00:34:27,009 ERROR [main] > > test.IntegrationTestBigLinkedList$Verify: Expected referenced count does > > not match with actual referenced count. expected referenced=4000000 > > ,actual=79000000 > > > > > >> On Fri, Feb 1, 2019 at 2:17 PM Andrew Purtell <[email protected]> > wrote: > >> > >> The first HBase 1.5.0 release candidate (RC0) is available for download > at > >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.5.0RC0/ and Maven > >> artifacts are available in the temporary repository > >> https://repository.apache.org/content/repositories/orgapachehbase-1250/ > >> > >> The git tag corresponding to the candidate is '1.5.0RC0' (ce6a6014da). > >> > >> A detailed source and binary compatibility report for this release is > >> available for your review at > >> > >> > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.5.0RC0/compat-check-report.html > >> . I do not believe there are any reported compatibility issues that are > in > >> violation of our compatibility policy for minor releases, but if you > find > >> something and feel differently, please file a JIRA. > >> > >> A list of the 88 issues resolved in this release can be found at > >> https://s.apache.org/K4Wk . The 1.5.0 changelog is derived from the > >> changelog of the last branch-1.4 release, 1.4.9. > >> > >> Please try out the candidate and vote +1/0/-1. > >> > >> The vote will be open for at least 72 hours. Unless objection I will > try to > >> close it Thursday February 28, 2019 if we have sufficient votes. > >> > >> Prior to making this announcement I made the following preflight checks: > >> > >> RAT check passes (7u80) > >> Unit test suite passes (7u80, 8u181) > >> Opened the UI in a browser, poked around > >> LTT load 100M rows with 100% verification and 20% updates (8u181) > >> ITBLL 1B rows with slowDeterministic monkey (8u181) > >> ITBLL 1B rows with serverKilling monkey (8u181) > >> > >> Some of this testing was done with recent 1.5.0-SNAPSHOT versions. > During > >> the month of February I plan to perform a number of additional tests, > >> including performance regression checks. As more results become > available I > >> will post them to this thread. > >> > >> -- > >> Best regards, > >> Andrew > >> >
