[
https://issues.apache.org/jira/browse/HBASE-5708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HBASE-5708:
-------------------------------
Attachment: D2601.2.patch
mbautin updated the revision "[jira] [HBASE-5708] [89-fb] Make
MiniMapRedCluster directory a subdirectory of target/test".
Reviewers: Kannan, Karthik, Liyin, JIRA, khemani
Made a lot of changes to the testing infrastructure in an attempt to make all
unit tests in 89-fb pass in a stable way. Got rid of static getTestDir() that
got its return value from a system property, and replaced it with calls to
TEST_UTIL.getTestDir() everywhere.
It turned out that it was impossible to change map-reduce test directory once
it was set because of a private static final LOG_DIR in TaskLog that was
initialized from the hadoop.log.dir system property. I fixed that using a
reflection hack.
I also addressed a few places where we instantiate a MiniMRCluster or
MiniDFSCluster without setting up system properties/configuration with proper
directory names with a randomly-generated component. However, HBaseTestCase and
HBaseClusterTestCase are a mess and I might need to fix them further.
Also, fixed TestLogSplitManager. there were some stuck retries, and a timeout
was not enough in testOrphanTaskAcquisition. Prakash: could you please take a
look at those changes?
I am trying to iron out more unit test failures by running the whole test
suite and zooming into nondeterministic tests (e.g. running them 100 times).
REVISION DETAIL
https://reviews.facebook.net/D2601
AFFECTED FILES
src/main/java/org/apache/hadoop/hbase/HConstants.java
src/main/java/org/apache/hadoop/hbase/master/OldLogsCleaner.java
src/main/java/org/apache/hadoop/hbase/master/RegionManager.java
src/main/java/org/apache/hadoop/hbase/master/SplitLogManager.java
src/test/java/org/apache/hadoop/hbase/HBaseTestCase.java
src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
src/test/java/org/apache/hadoop/hbase/TestFullLogReconstruction.java
src/test/java/org/apache/hadoop/hbase/TestZooKeeper.java
src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java
src/test/java/org/apache/hadoop/hbase/filter/TestColumnPrefixFilter.java
src/test/java/org/apache/hadoop/hbase/io/TestHalfStoreFileReader.java
src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheOnWrite.java
src/test/java/org/apache/hadoop/hbase/io/hfile/TestFixedFileTrailer.java
src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFile.java
src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlock.java
src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlockIndex.java
src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileDataBlockEncoder.java
src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFilePerformance.java
src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileSeek.java
src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileWriterV2.java
src/test/java/org/apache/hadoop/hbase/io/hfile/TestReseekTo.java
src/test/java/org/apache/hadoop/hbase/io/hfile/TestScannerSelectionUsingTTL.java
src/test/java/org/apache/hadoop/hbase/mapred/TestLegacyTableMapReduce.java
src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat.java
src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFiles.java
src/test/java/org/apache/hadoop/hbase/mapreduce/TestTableMapReduce.java
src/test/java/org/apache/hadoop/hbase/master/TestSplitLogManager.java
src/test/java/org/apache/hadoop/hbase/regionserver/TestBlocksRead.java
src/test/java/org/apache/hadoop/hbase/regionserver/TestColumnSeeking.java
src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactSelection.java
src/test/java/org/apache/hadoop/hbase/regionserver/TestCompoundBloomFilter.java
src/test/java/org/apache/hadoop/hbase/regionserver/TestFSErrorsExposed.java
src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
src/test/java/org/apache/hadoop/hbase/regionserver/TestMultiColumnScanner.java
src/test/java/org/apache/hadoop/hbase/regionserver/TestScannerResets.java
src/test/java/org/apache/hadoop/hbase/regionserver/TestStore.java
src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreFile.java
src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLog.java
src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLogMethods.java
src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
src/test/java/org/apache/hadoop/hbase/util/TestMiniClusterLoadSequential.java
src/test/resources/hbase-site.xml
> [89-fb] Make MiniMapRedCluster directory a subdirectory of target/test
> ----------------------------------------------------------------------
>
> Key: HBASE-5708
> URL: https://issues.apache.org/jira/browse/HBASE-5708
> Project: HBase
> Issue Type: Bug
> Reporter: Mikhail Bautin
> Priority: Minor
> Attachments: D2601.1.patch, D2601.2.patch
>
>
> Some map-reduce-based tests are failing when executed concurrently in 89-fb
> because mini-map-reduce cluster uses /tmp/hadoop-<username> for temporary
> data.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
