I'm on this. St.Ack
On Tue, Aug 31, 2010 at 7:10 PM, Apache Hudson Server <hud...@hudson.apache.org> wrote: > See <https://hudson.apache.org/hudson/job/HBase-TRUNK/1440/changes> > > Changes: > > [jgray] HBASE-2944 cannot alter bloomfilter setting for a column family from > hbase shell (kannan via jgray) > > [stack] HBASE-2692 Master rewrite and cleanup for 0.90 > > Patch brought over from 0.90_master_rewrite branch. > > Replication test is broke as are some of the rest tests. > Others should be passing. > > Some of the changes made in this fat patch: > > + In HLogKey, we now use encoded region name instead of full region name. > + On split, daughters are opened on the parent's regionserver; let the new > balancer > sort them out later when it cuts in. > + Added move region from one server to another as well as enable/disable > balancer. > + All .META. and -ROOT- edits go via new *Editor and *Reader classes -- no > more > do we have 5 different ways of reading and editing .META. > + Rather than 3 different listeners to hlog each w/ own way of listening, > instead > we only have WALObserver now. > + New Server Interface that has whats common to HMaster and RegionServer. Also > new Services Interface. This should make test writing cleaner making it so > less need of full cluster context testing anything -- e.g. the new > Interfaces are good w/ Mockito. > + New balacner that runs on a period and takes into consideration all load > across cluster. > + Table online/offline is now a flag in ZK; the offline flag on a region is > just used splitting from here on out. > + Moved fixup of failed add of daughter edits to .META. into shutdown server > recover code (It used to be in basescanner). > + The heartbeat now sends master the regionserver load and is used sending > shutdown message from master to regionserver ONLY; all other messages are > via zk (HMsg is pretty bare now). > + No more Worker in RS and ToDoQueue in master. Both in master and > regionserver > we use handlers instead run out of Executors. > + Client can not send split, flush, compact direct to RS; no longer does > it go via master. > + Server shutdown runs differently now. All are watching a flag in zk. > When RS notices its gone, it closes all user-space regions. If thats all > it was carrying, then it goes down. Otherwise, waits on master to send > the shutdown msg via heartbeat. > > ------------------------------------------ > [...truncated 792 lines...] > AU src/site/resources/images/architecture.gif > AU src/site/resources/images/hadoop-logo.jpg > AU src/site/resources/images/hbase_logo_med.gif > AU src/site/resources/images/favicon.ico > AU src/site/resources/images/hbase_small.gif > A src/site/resources/css > A src/site/resources/css/site.css > A src/site/xdoc > A src/site/xdoc/cygwin.xml > A src/site/xdoc/acid-semantics.xml > A src/site/xdoc/metrics.xml > A src/site/xdoc/index.xml > A src/site/xdoc/replication.xml > A src/site/xdoc/old_news.xml > A src/site/xdoc/bulk-loads.xml > A src/site/xdoc/pseudo-distributed.xml > A src/site/fml > A src/site/fml/faq.fml > A src/docbkx > A src/docbkx/sample_article.xml > A src/docbkx/book.xml > AU src/saveVersion.sh > A src/examples > A src/examples/thrift > A src/examples/thrift/DemoClient.java > A src/examples/thrift/DemoClient.cpp > A src/examples/thrift/DemoClient.rb > A src/examples/thrift/DemoClient.php > AU src/examples/thrift/DemoClient.py > A src/examples/thrift/README.txt > A src/examples/thrift/Makefile > A src/examples/mapreduce > A src/examples/mapreduce/org > A src/examples/mapreduce/org/apache > A src/examples/mapreduce/org/apache/hadoop > A src/examples/mapreduce/org/apache/hadoop/hbase > A src/examples/mapreduce/org/apache/hadoop/hbase/mapreduce > A > src/examples/mapreduce/org/apache/hadoop/hbase/mapreduce/SampleUploader.java > A > src/examples/mapreduce/org/apache/hadoop/hbase/mapreduce/IndexBuilder.java > A src/examples/mapreduce/index-builder-setup.rb > A src/examples/README.txt > A bin > AU bin/hbase-daemons.sh > A bin/rename_table.rb > AU bin/hbase > A bin/copy_table.rb > A bin/check_meta.rb > AU bin/start-hbase.sh > A bin/hirb.rb > A bin/set_meta_block_caching.rb > A bin/loadtable.rb > AU bin/hbase-daemon.sh > A bin/hbase-config.sh > A bin/local-regionservers.sh > AU bin/zookeepers.sh > A bin/local-master-backup.sh > A bin/add_table.rb > A bin/rolling-restart.sh > AU bin/regionservers.sh > A bin/master-backup.sh > A bin/replication > A bin/replication/copy_tables_desc.rb > A bin/replication/add_peer.rb > AU bin/stop-hbase.sh > A pom.xml > A README.txt > U . > At revision 991408 > [locks-and-latches] Checking to see if we really have the locks > [locks-and-latches] Have all the locks, build can start > [trunk] $ /home/hudson/tools/maven/apache-maven-2.2.1/bin/mvn clean > -Dmaven.test.redirectTestOutputToFile=true deploy > [INFO] Scanning for projects... > [INFO] > ------------------------------------------------------------------------ > [INFO] Building HBase > [INFO] task-segment: [clean, deploy] > [INFO] > ------------------------------------------------------------------------ > [INFO] [clean:clean {execution: default-clean}] > [WARNING] POM for 'commons-httpclient:commons-httpclient:pom:3.0.1:compile' > is invalid. > > Its dependencies (if any) will NOT be available to the current build. > [INFO] [antrun:run {execution: generate}] > [INFO] Executing tasks > [mkdir] Created dir: > <https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/hbase-webapps> > [copy] Copying 4 files to > <https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/hbase-webapps> > [mkdir] Created dir: > <https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/hbase-webapps/master/WEB-INF> > [mkdir] Created dir: > <https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/hbase-webapps/regionserver/WEB-INF> > [INFO] Executed tasks > [INFO] [build-helper:add-source {execution: add-jspc-source}] > [INFO] Source directory: > <https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/jspc> added. > [INFO] [build-helper:add-source {execution: add-package-info}] > [INFO] Source directory: > <https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/generated-sources> > added. > [INFO] [resources:resources {execution: default-resources}] > [INFO] Using 'UTF-8' encoding to copy filtered resources. > [INFO] Copying 1 resource > [INFO] Copying 6 resources > [INFO] [compiler:compile {execution: default-compile}] > [INFO] Compiling 419 source files to > <https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/classes> > [INFO] [resources:testResources {execution: default-testResources}] > [INFO] Using 'UTF-8' encoding to copy filtered resources. > [INFO] Copying 4 resources > [INFO] [compiler:testCompile {execution: default-testCompile}] > [INFO] Compiling 164 source files to > <https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/test-classes> > [INFO] [surefire:test {execution: default-test}] > [INFO] Surefire report directory: > <https://hudson.apache.org/hudson/job/HBase-TRUNK/ws/trunk/target/surefire-reports> > > ------------------------------------------------------- > T E S T S > ------------------------------------------------------- > Running org.apache.hadoop.hbase.client.TestMultipleTimestamps > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 97.045 sec > Running org.apache.hadoop.hbase.TestZooKeeper > Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 81.175 sec > <<< FAILURE! > Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 109.384 sec > Running org.apache.hadoop.hbase.io.hfile.TestCachedBlockQueue > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.106 sec > Running org.apache.hadoop.hbase.filter.TestPrefixFilter > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.156 sec > Running org.apache.hadoop.hbase.util.TestMergeMeta > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 75.357 sec > Running org.apache.hadoop.hbase.io.TestHeapSize > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.143 sec > Running org.apache.hadoop.hbase.io.TestImmutableBytesWritable > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.111 sec > Running org.apache.hadoop.hbase.rest.model.TestRowModel > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.449 sec > Running org.apache.hadoop.hbase.io.hfile.TestHFileSeek > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.155 sec > Running org.apache.hadoop.hbase.regionserver.TestStore > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.393 sec > Running org.apache.hadoop.hbase.zookeeper.TestHQuorumPeer > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.531 sec > Running org.apache.hadoop.hbase.rest.TestScannersWithFilters > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.602 sec > Running org.apache.hadoop.hbase.io.hfile.TestHFilePerformance > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.433 sec > Running org.apache.hadoop.hbase.io.TestHbaseObjectWritable > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.219 sec > Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit > Tests run: 16, Failures: 0, Errors: 8, Skipped: 0, Time elapsed: 57.692 sec > <<< FAILURE! > Running org.apache.hadoop.hbase.thrift.TestThriftServer > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.396 sec > Running org.apache.hadoop.hbase.filter.TestColumnPrefixFilter > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.651 sec > Running org.apache.hadoop.hbase.master.TestZKBasedOpenCloseRegion > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.154 sec > Running org.apache.hadoop.hbase.TestCompare > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.135 sec > Running org.apache.hadoop.hbase.regionserver.TestExplicitColumnTracker > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.942 sec > Running org.apache.hadoop.hbase.util.TestEnvironmentEdgeManager > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.271 sec > Running org.apache.hadoop.hbase.util.TestDefaultEnvironmentEdge > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.067 sec > Running org.apache.hadoop.hbase.master.TestMasterTransitions > Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 35.316 sec > Running org.apache.hadoop.hbase.regionserver.TestScanWildcardColumnTracker > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.582 sec > Running org.apache.hadoop.hbase.regionserver.TestKeyValueSkipListSet > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.122 sec > Running org.apache.hadoop.hbase.io.hfile.TestSeekTo > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.602 sec > Running org.apache.hadoop.hbase.filter.TestPageFilter > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.04 sec > Running org.apache.hadoop.hbase.filter.TestColumnPaginationFilter > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.113 sec > Running org.apache.hadoop.hbase.rest.TestStatusResource > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.735 sec > Running org.apache.hadoop.hbase.client.TestFromClientSide > Tests run: 35, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 259.956 sec > Running org.apache.hadoop.hbase.replication.TestReplication > Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 156.192 sec > <<< FAILURE! > Running org.apache.hadoop.hbase.regionserver.TestCompaction > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 80.672 sec > Running org.apache.hadoop.hbase.TestMultiParallelPut > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 118.629 sec > Running org.apache.hadoop.hbase.filter.TestSingleColumnValueFilter > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.146 sec > Running org.apache.hadoop.hbase.mapreduce.TestTimeRangeMapRed > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.549 sec > Running org.apache.hadoop.hbase.mapreduce.TestSimpleTotalOrderPartitioner > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.395 sec > Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 180.29 sec > Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.577 sec > Running org.apache.hadoop.hbase.regionserver.TestScanDeleteTracker > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.551 sec > Running org.apache.hadoop.hbase.client.TestMetaScanner > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.853 sec > Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.124 sec > Running org.apache.hadoop.hbase.TestRegionRebalancing > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 93.581 sec > Running org.apache.hadoop.hbase.filter.TestSingleColumnValueExcludeFilter > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.115 sec > Running org.apache.hadoop.hbase.filter.TestInclusiveStopFilter > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.118 sec > Running org.apache.hadoop.hbase.rest.TestTableResource > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.091 sec > Running org.apache.hadoop.hbase.TestHBaseTestingUtility > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.009 sec > Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.367 sec > Running org.apache.hadoop.hbase.rest.TestSchemaResource > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.728 sec > Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.077 sec > Running org.apache.hadoop.hbase.regionserver.TestKeyValueScanFixture > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.115 sec > Running org.apache.hadoop.hbase.rest.model.TestTableListModel > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.484 sec > Running org.apache.hadoop.hbase.rest.model.TestColumnSchemaModel > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.323 sec > Running org.apache.hadoop.hbase.regionserver.TestStoreFile > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.228 sec > Running org.apache.hadoop.hbase.zookeeper.TestZooKeeperNodeTracker > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.116 sec > Running org.apache.hadoop.hbase.rest.model.TestScannerModel > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.497 sec > Running org.apache.hadoop.hbase.regionserver.wal.TestHLogMethods > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.426 sec > Running org.apache.hadoop.hbase.rest.TestVersionResource > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.884 sec > Running org.apache.hadoop.hbase.filter.TestFilter > Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.365 sec > Running org.apache.hadoop.hbase.regionserver.TestWideScanner > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.356 sec > Running org.apache.hadoop.hbase.regionserver.TestSplitTransaction > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.059 sec > Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink > killed. > [INFO] > ------------------------------------------------------------------------ > [ERROR] BUILD ERROR > [INFO] > ------------------------------------------------------------------------ > [INFO] Error while executing forked tests.; nested exception is > org.apache.maven.surefire.booter.shade.org.codehaus.plexus.util.cli.CommandLineTimeOutException: > Error while executing external command, process killed. > > Process timeout out after 3600 seconds > [INFO] > ------------------------------------------------------------------------ > [INFO] For more information, run Maven with the -e switch > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 91 minutes 15 seconds > [INFO] Finished at: Wed Sep 01 02:10:11 UTC 2010 > [INFO] Final Memory: 45M/225M > [INFO] > ------------------------------------------------------------------------ > [locks-and-latches] Releasing all the locks > [locks-and-latches] All the locks released > Archiving artifacts > Recording test results > >
