See <https://hudson.apache.org/hudson/job/HBase-TRUNK/1482/changes>
Changes:
[stack] HBASE-3039 Stuck in regionsInTransition because rebalance came in at
same time as a split
M src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
Add region name to warning log message (w/o it message is no good).
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
Add src of split message else need to deduce where it came from by looking
elsewhere.
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
Updated log messages to include region and where appropritate source
server name; debug hard w/o
Changed regionOnline and regionOffline to check for unexpected
states and log warnings rather than proceed regardless.
Added in fix for concurrent balance+split; split message now
updates regionsintransition where previous it did not.
Remove checkRegion method. Its a reimplementation of
what regionOnline and regionOffline do only less comprehensive
regards what gets updated (this.regions + this.servers rather
than this.regions, this.servers and regionsInTransition)
That they were less comprehensive is root of this bug.
M src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Make the message about why we are not running balancer richer
(print out how many reigons in transition and more of the
regionsintrnasition list).
M src/main/java/org/apache/hadoop/hbase/executor/RegionTransitionData.java
Javadoc and minor formatting.
[stack] Added note on hlog tool, that it can be used to look at files in
recovered edits file
------------------------------------------
[...truncated 759 lines...]
A src/main/resources/hbase-webapps/static/hbase.css
AU src/main/resources/hbase-webapps/static/hbase_logo_med.gif
A src/main/resources/hbase-webapps/regionserver
A src/main/resources/hbase-webapps/regionserver/regionserver.jsp
A src/main/resources/hbase-webapps/regionserver/index.html
A src/main/resources/hbase-webapps/master
A src/main/resources/hbase-webapps/master/zk.jsp
A src/main/resources/hbase-webapps/master/table.jsp
A src/main/resources/hbase-webapps/master/master.jsp
A src/main/resources/hbase-webapps/master/index.html
AU src/main/resources/hbase-default.xml
A src/main/resources/org
A src/main/resources/org/apache
A src/main/resources/org/apache/hadoop
A src/main/resources/org/apache/hadoop/hbase
A src/main/resources/org/apache/hadoop/hbase/thrift
AU src/main/resources/org/apache/hadoop/hbase/thrift/Hbase.thrift
A src/main/resources/org/apache/hadoop/hbase/mapreduce
AU
src/main/resources/org/apache/hadoop/hbase/mapreduce/RowCounter_Counters.properties
A src/main/resources/org/apache/hadoop/hbase/mapred
AU
src/main/resources/org/apache/hadoop/hbase/mapred/RowCounter_Counters.properties
A src/main/resources/org/apache/hadoop/hbase/rest
A src/main/resources/org/apache/hadoop/hbase/rest/protobuf
A
src/main/resources/org/apache/hadoop/hbase/rest/protobuf/TableSchemaMessage.proto
A
src/main/resources/org/apache/hadoop/hbase/rest/protobuf/ScannerMessage.proto
A
src/main/resources/org/apache/hadoop/hbase/rest/protobuf/StorageClusterStatusMessage.proto
A
src/main/resources/org/apache/hadoop/hbase/rest/protobuf/CellSetMessage.proto
A
src/main/resources/org/apache/hadoop/hbase/rest/protobuf/ColumnSchemaMessage.proto
A
src/main/resources/org/apache/hadoop/hbase/rest/protobuf/CellMessage.proto
A
src/main/resources/org/apache/hadoop/hbase/rest/protobuf/TableInfoMessage.proto
A
src/main/resources/org/apache/hadoop/hbase/rest/protobuf/TableListMessage.proto
A
src/main/resources/org/apache/hadoop/hbase/rest/protobuf/VersionMessage.proto
A src/main/resources/org/apache/hadoop/hbase/rest/XMLSchema.xsd
A src/site
A src/site/site.xml
A src/site/site.vm
A src/site/resources
A src/site/resources/images
AU src/site/resources/images/replication_overview.png
AU src/site/resources/images/asf_logo_wide.png
AU src/site/resources/images/architecture.gif
AU src/site/resources/images/hadoop-logo.jpg
AU src/site/resources/images/hbase_logo_med.gif
AU src/site/resources/images/favicon.ico
AU src/site/resources/images/hbase_small.gif
A src/site/resources/css
A src/site/resources/css/site.css
A src/site/xdoc
A src/site/xdoc/cygwin.xml
A src/site/xdoc/acid-semantics.xml
A src/site/xdoc/metrics.xml
A src/site/xdoc/index.xml
A src/site/xdoc/replication.xml
A src/site/xdoc/old_news.xml
A src/site/xdoc/bulk-loads.xml
A src/site/xdoc/pseudo-distributed.xml
A src/site/fml
A src/site/fml/faq.fml
A src/docbkx
A src/docbkx/sample_article.xml
A src/docbkx/book.xml
AU src/saveVersion.sh
A src/examples
A src/examples/thrift
A src/examples/thrift/DemoClient.java
A src/examples/thrift/DemoClient.cpp
A src/examples/thrift/DemoClient.rb
A src/examples/thrift/DemoClient.php
AU src/examples/thrift/DemoClient.py
A src/examples/thrift/README.txt
A src/examples/thrift/Makefile
A src/examples/mapreduce
A src/examples/mapreduce/org
A src/examples/mapreduce/org/apache
A src/examples/mapreduce/org/apache/hadoop
A src/examples/mapreduce/org/apache/hadoop/hbase
A src/examples/mapreduce/org/apache/hadoop/hbase/mapreduce
A
src/examples/mapreduce/org/apache/hadoop/hbase/mapreduce/SampleUploader.java
A
src/examples/mapreduce/org/apache/hadoop/hbase/mapreduce/IndexBuilder.java
A src/examples/mapreduce/index-builder-setup.rb
A src/examples/README.txt
A bin
AU bin/hbase-daemons.sh
A bin/rename_table.rb
AU bin/hbase
A bin/copy_table.rb
A bin/check_meta.rb
AU bin/start-hbase.sh
A bin/hirb.rb
A bin/set_meta_block_caching.rb
A bin/loadtable.rb
AU bin/hbase-daemon.sh
A bin/hbase-config.sh
A bin/local-regionservers.sh
AU bin/zookeepers.sh
A bin/local-master-backup.sh
A bin/add_table.rb
A bin/rolling-restart.sh
AU bin/regionservers.sh
AU bin/master-backup.sh
A bin/replication
A bin/replication/copy_tables_desc.rb
A bin/replication/add_peer.rb
AU bin/stop-hbase.sh
A pom.xml
A README.txt
U .
At revision 1001913
[locks-and-latches] Checking to see if we really have the locks
[locks-and-latches] Have all the locks, build can start
[trunk] $ /home/hudson/tools/maven/apache-maven-2.2.1/bin/mvn clean
-Dmaven.test.redirectTestOutputToFile=true deploy
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Building HBase
[INFO] task-segment: [clean, deploy]
[INFO] ------------------------------------------------------------------------
[INFO] [clean:clean {execution: default-clean}]
[WARNING] POM for 'commons-httpclient:commons-httpclient:pom:3.0.1:compile' is
invalid.
Its dependencies (if any) will NOT be available to the current build.
[INFO] [antrun:run {execution: generate}]
[INFO] Executing tasks
[mkdir] Created dir:
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/hbase-webapps>
[copy] Copying 4 files to
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/hbase-webapps>
[mkdir] Created dir:
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/hbase-webapps/master/WEB-INF>
[mkdir] Created dir:
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/hbase-webapps/regionserver/WEB-INF>
[INFO] Executed tasks
[INFO] [build-helper:add-source {execution: add-jspc-source}]
[INFO] Source directory:
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/jspc> added.
[INFO] [build-helper:add-source {execution: add-package-info}]
[INFO] Source directory:
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/generated-sources>
added.
[INFO] [resources:resources {execution: default-resources}]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 6 resources
[INFO] [compiler:compile {execution: default-compile}]
[INFO] Compiling 421 source files to
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/classes>
[INFO] [resources:testResources {execution: default-testResources}]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 4 resources
[INFO] [compiler:testCompile {execution: default-testCompile}]
[INFO] Compiling 168 source files to
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/test-classes>
[INFO] [surefire:test {execution: default-test}]
[INFO] Surefire report directory:
<https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/surefire-reports>
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.hadoop.hbase.regionserver.TestColumnSeeking
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.489 sec
Running org.apache.hadoop.hbase.client.TestMultipleTimestamps
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 106.606 sec
Running org.apache.hadoop.hbase.TestZooKeeper
Tests run: 4, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 155.547 sec <<<
FAILURE!
Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 104.03 sec
Running org.apache.hadoop.hbase.io.hfile.TestCachedBlockQueue
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.106 sec
Running org.apache.hadoop.hbase.filter.TestPrefixFilter
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.109 sec
Running org.apache.hadoop.hbase.util.TestMergeMeta
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 67.023 sec
Running org.apache.hadoop.hbase.io.TestImmutableBytesWritable
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.111 sec
Running org.apache.hadoop.hbase.io.TestHeapSize
Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.127 sec <<<
FAILURE!
Running org.apache.hadoop.hbase.rest.model.TestRowModel
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.48 sec
Running org.apache.hadoop.hbase.io.hfile.TestHFileSeek
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.267 sec
Running org.apache.hadoop.hbase.regionserver.TestStore
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.226 sec
Running org.apache.hadoop.hbase.zookeeper.TestHQuorumPeer
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.476 sec
Running org.apache.hadoop.hbase.rest.TestScannersWithFilters
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 60.792 sec <<<
FAILURE!
Running org.apache.hadoop.hbase.io.hfile.TestHFilePerformance
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.272 sec
Running org.apache.hadoop.hbase.io.TestHbaseObjectWritable
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.175 sec
Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.617 sec
Running org.apache.hadoop.hbase.thrift.TestThriftServer
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 71.283 sec
Running org.apache.hadoop.hbase.filter.TestColumnPrefixFilter
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.629 sec
Running org.apache.hadoop.hbase.master.TestZKBasedOpenCloseRegion
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.51 sec
Running org.apache.hadoop.hbase.TestCompare
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.137 sec
Running org.apache.hadoop.hbase.regionserver.TestExplicitColumnTracker
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.957 sec
Running org.apache.hadoop.hbase.util.TestEnvironmentEdgeManager
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.328 sec
Running org.apache.hadoop.hbase.util.TestDefaultEnvironmentEdge
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.065 sec
Running org.apache.hadoop.hbase.util.TestFSUtils
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.697 sec
Running org.apache.hadoop.hbase.master.TestMasterTransitions
Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 39.802 sec
Running org.apache.hadoop.hbase.regionserver.TestScanWildcardColumnTracker
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.347 sec
Running org.apache.hadoop.hbase.regionserver.TestKeyValueSkipListSet
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.12 sec
Running org.apache.hadoop.hbase.filter.TestPageFilter
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.116 sec
Running org.apache.hadoop.hbase.io.hfile.TestSeekTo
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.472 sec
Running org.apache.hadoop.hbase.filter.TestColumnPaginationFilter
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.113 sec
Running org.apache.hadoop.hbase.rest.TestStatusResource
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 40.119 sec <<<
FAILURE!
Running org.apache.hadoop.hbase.client.TestFromClientSide
Tests run: 38, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 335.938 sec
Running org.apache.hadoop.hbase.replication.TestReplication
Tests run: 5, Failures: 0, Errors: 0, Skipped: 5, Time elapsed: 0.221 sec
Running org.apache.hadoop.hbase.regionserver.TestCompaction
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 83.28 sec
Running org.apache.hadoop.hbase.filter.TestSingleColumnValueFilter
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.148 sec
Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 94.367 sec
Running org.apache.hadoop.hbase.mapreduce.TestSimpleTotalOrderPartitioner
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.324 sec
Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 172.841 sec
Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.217 sec
Running org.apache.hadoop.hbase.regionserver.TestScanDeleteTracker
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.5 sec
Running org.apache.hadoop.hbase.client.TestMetaScanner
killed.
[INFO] ------------------------------------------------------------------------
[ERROR] BUILD ERROR
[INFO] ------------------------------------------------------------------------
[INFO] Error while executing forked tests.; nested exception is
org.apache.maven.surefire.booter.shade.org.codehaus.plexus.util.cli.CommandLineTimeOutException:
Error while executing external command, process killed.
Process timeout out after 3600 seconds
[INFO] ------------------------------------------------------------------------
[INFO] For more information, run Maven with the -e switch
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 85 minutes 48 seconds
[INFO] Finished at: Mon Sep 27 22:42:09 UTC 2010
[INFO] Final Memory: 49M/522M
[INFO] ------------------------------------------------------------------------
[locks-and-latches] Releasing all the locks
[locks-and-latches] All the locks released
Archiving artifacts
Recording test results