Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #368
See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/368/changes Changes: [tedyu] HBASE-6466 Revert, TestLogRolling failed twice on trunk build [tedyu] HBASE-6466 Enable multi-thread for memstore flush (Chunhui) [larsh] HBASE-7293 [replication] Remove dead sinks from ReplicationSource.currentPeers and pick new ones [stack] HBASE-7588 Fix two findbugs warning in MemStoreFlusher; REAPPLIED [jxiang] HBASE-7646 Make forkedProcessTimeoutInSeconds configurable [stack] HBASE-7588 Fix two findbugs warning in MemStoreFlusher; REVERTED [stack] HBASE-7588 Fix two findbugs warning in MemStoreFlusher [enis] HBASE-7642. HBase shell cannot set Compression -- [...truncated 18814 lines...] Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 157.606 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter4572466051151932072.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire4972972802871097313tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1859157632099713906141tmp Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 32, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 310.087 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter4936249003865219025.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire552267954696084120tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_186662074785732795204tmp Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplitCompressed Tests run: 32, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 306.393 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter6456381290743381510.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire8642330882714508348tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1877797764451863219197tmp Running org.apache.hadoop.hbase.regionserver.TestJoinedScanners Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 553.45 sec FAILURE! Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter8600258296411550918.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire3284155470931918530tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1886051872838271290110tmp Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Running org.apache.hadoop.hbase.regionserver.wal.TestHLogFiltering Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 70.913 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter2679276883926657201.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire9079640176117854912tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1893598698477458693250tmp Running org.apache.hadoop.hbase.regionserver.TestStoreScanner Tests run: 16,
[jira] [Created] (HBASE-7650) bin/hbase-config.sh is not executable
nkeywal created HBASE-7650: -- Summary: bin/hbase-config.sh is not executable Key: HBASE-7650 URL: https://issues.apache.org/jira/browse/HBASE-7650 Project: HBase Issue Type: Bug Components: scripts Affects Versions: 0.94.4, 0.96.0 Reporter: nkeywal And it strange that everything seems to work despite this... -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-7650) bin/hbase-config.sh is not executable
[ https://issues.apache.org/jira/browse/HBASE-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nkeywal resolved HBASE-7650. Resolution: Invalid must be sourced only... bin/hbase-config.sh is not executable - Key: HBASE-7650 URL: https://issues.apache.org/jira/browse/HBASE-7650 Project: HBase Issue Type: Bug Components: scripts Affects Versions: 0.96.0, 0.94.4 Reporter: nkeywal And it strange that everything seems to work despite this... -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Build failed in Jenkins: HBase-TRUNK #3782
See https://builds.apache.org/job/HBase-TRUNK/3782/ -- [...truncated 3517 lines...] Running org.apache.hadoop.hbase.regionserver.wal.TestMetricsWALSourceImpl Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec Running org.apache.hadoop.hbase.regionserver.TestMetricsRegionSourceImpl Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec Running org.apache.hadoop.hbase.regionserver.TestMetricsRegionServerSourceImpl Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec Running org.apache.hadoop.hbase.rest.TestMetricsRESTSourceImpl Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec Running org.apache.hadoop.hbase.metrics.TestBaseSourceImpl Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec Running org.apache.hadoop.hbase.replication.regionserver.TestMetricsReplicationSourceImpl Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.395 sec Results : Tests run: 16, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] --- maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (secondPartTestsExecution) @ hbase-hadoop2-compat --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:test-jar (default) @ hbase-hadoop2-compat --- [INFO] Building jar: /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-hadoop2-compat/target/hbase-hadoop2-compat-0.95-SNAPSHOT-tests.jar [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ hbase-hadoop2-compat --- [INFO] Building jar: /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-hadoop2-compat/target/hbase-hadoop2-compat-0.95-SNAPSHOT.jar [INFO] [INFO] --- apache-rat-plugin:0.8:check (default) @ hbase-hadoop2-compat --- [INFO] Exclude: **/*.log [INFO] Exclude: **/.* [INFO] Exclude: **/*.tgz [INFO] Exclude: **/*.orig [INFO] Exclude: **/test/** [INFO] Exclude: **/8e8ab58dcf39412da19833fcd8f687ac [INFO] Exclude: **/.git/** [INFO] Exclude: **/.idea/** [INFO] Exclude: **/target/** [INFO] Exclude: **/CHANGES.txt [INFO] Exclude: **/generated/** [INFO] Exclude: **/gen-*/** [INFO] Exclude: **/conf/* [INFO] Exclude: **/*.avpr [INFO] Exclude: **/*.svg [INFO] Exclude: **/META-INF/services/** [INFO] Exclude: **/html5shiv.js [INFO] Exclude: **/jquery.min.js [INFO] Exclude: **/*.vm [INFO] Exclude: **/control [INFO] Exclude: **/conffile [INFO] Exclude: docs/* [INFO] Exclude: **/src/site/resources/css/freebsd_docbook.css [INFO] Exclude: .git/** [INFO] Exclude: .svn/** [INFO] [INFO] [INFO] Building HBase - Integration Tests 0.95-SNAPSHOT [INFO] [INFO] [INFO] --- maven-remote-resources-plugin:1.4:process (default) @ hbase-it --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hbase-it --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/src/main/resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ hbase-it --- [INFO] No sources to compile [INFO] [INFO] --- maven-dependency-plugin:2.1:build-classpath (create-hbase-generated-classpath) @ hbase-it --- [INFO] Wrote classpath file '/x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/target/../../target/cached_classpath.txt'. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hbase-it --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 6 resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ hbase-it --- [INFO] Compiling 11 source files to /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (default-test) @ hbase-it --- [INFO] Surefire report directory: /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/target/surefire-reports [INFO] Using configured provider org.apache.maven.surefire.junitcore.JUnitCoreProvider --- T E S T S --- Results : Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] --- maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (secondPartTestsExecution) @ hbase-it --- [INFO] Surefire report directory: /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/target/surefire-reports [INFO] Using configured provider org.apache.maven.surefire.junitcore.JUnitCoreProvider --- T E S T S --- --- T E S T S
Build failed in Jenkins: HBase-TRUNK #3783
See https://builds.apache.org/job/HBase-TRUNK/3783/changes Changes: [jxiang] HBASE-7648 TestAcidGuarantees.testMixedAtomicity hangs sometimes -- [...truncated 3199 lines...] Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 103.04 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 90.947 sec Running org.apache.hadoop.hbase.replication.TestReplicationZookeeper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.888 sec Running org.apache.hadoop.hbase.TestFullLogReconstruction Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 123.001 sec Running org.apache.hadoop.hbase.replication.TestReplicationSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.989 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 113.201 sec Running org.apache.hadoop.hbase.master.TestMasterFailover Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 300.137 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.31 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.475 sec Running org.apache.hadoop.hbase.replication.TestReplicationSmallTests Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 162.316 sec Running org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 122.136 sec Running org.apache.hadoop.hbase.replication.TestMasterReplication Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 202.432 sec Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 379.897 sec Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 106.281 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.641 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 11.946 sec Running org.apache.hadoop.hbase.TestMultiVersions Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.277 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTrackerOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.358 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 66.3 sec Running org.apache.hadoop.hbase.replication.TestReplicationQueueFailover Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 118.433 sec Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.184 sec Running org.apache.hadoop.hbase.coprocessor.TestRowProcessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.154 sec Running org.apache.hadoop.hbase.catalog.TestMetaMigrationConvertingToPB Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 83.454 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.09 sec Running org.apache.hadoop.hbase.TestHBaseTestingUtility Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 159.215 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.546 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.9 sec Running org.apache.hadoop.hbase.coprocessor.TestClassLoading Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.024 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.206 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.393 sec Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.293 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.756 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.909 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0,
HBASE-7114 Increment does not extend Mutation but probably should
Hi, I want to get opinion on whether we should proceed with HBASE-7114 'Increment does not extend Mutation but probably should' in trunk. Is anyone using Increment.setWriteToWAL or Increment.getFamilyMap ? For Increment.setWriteToWAL, are you using the Increment returned ? Your feedback would be appreciated.
[jira] [Reopened] (HBASE-7268) correct local region location cache information can be overwritten w/stale information from an old server
[ https://issues.apache.org/jira/browse/HBASE-7268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reopened HBASE-7268: - Doesn't cover all cases, saw that it still removes from cache on error from different server... Original patch is valid, I'll make addendum patch correct local region location cache information can be overwritten w/stale information from an old server - Key: HBASE-7268 URL: https://issues.apache.org/jira/browse/HBASE-7268 Project: HBase Issue Type: Bug Affects Versions: 0.96.0 Reporter: Sergey Shelukhin Assignee: Sergey Shelukhin Priority: Minor Fix For: 0.96.0 Attachments: 7268-v6.patch, 7268-v8.patch, HBASE-7268-v0.patch, HBASE-7268-v0.patch, HBASE-7268-v1.patch, HBASE-7268-v2.patch, HBASE-7268-v2-plus-masterTs.patch, HBASE-7268-v2-plus-masterTs.patch, HBASE-7268-v3.patch, HBASE-7268-v4.patch, HBASE-7268-v5.patch, HBASE-7268-v6.patch, HBASE-7268-v7.patch, HBASE-7268-v8.patch, HBASE-7268-v9.patch Discovered via HBASE-7250; related to HBASE-5877. Test is writing from multiple threads. Server A has region R; client knows that. R gets moved from A to server B. B gets killed. R gets moved by master to server C. ~15 seconds later, client tries to write to it (on A?). Multiple client threads report from RegionMoved exception processing logic R moved from C to B, even though such transition never happened (neither in nor before the sequence described below). Not quite sure how the client learned of the transition to C, I assume it's from meta from some other thread... Then, put fails (it may fail due to accumulated errors that are not logged, which I am investigating... but the bogus cache update is there nonwithstanding). I have a patch but not sure if it works, test still fails locally for yet unknown reason. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Build failed in Jenkins: HBase-0.94 #754
See https://builds.apache.org/job/HBase-0.94/754/changes Changes: [jxiang] HBASE-7648 TestAcidGuarantees.testMixedAtomicity hangs sometimes -- [...truncated 2208 lines...] Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.535 sec Running org.apache.hadoop.hbase.regionserver.TestStoreFileBlockCacheSummary Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.321 sec Running org.apache.hadoop.hbase.regionserver.TestCompactionWithCoprocessor Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.925 sec Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.053 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.787 sec Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.548 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLog Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 74.921 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogBench Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.25 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 170.717 sec Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.13 sec Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.502 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.567 sec Running org.apache.hadoop.hbase.filter.TestColumnRangeFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.752 sec Running org.apache.hadoop.hbase.coprocessor.TestClassLoading Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.853 sec Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 163.091 sec Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.96 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.396 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.197 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit Tests run: 30, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 311.28 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.913 sec Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.106 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 51.496 sec Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplitCompressed Tests run: 30, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 325.016 sec Running org.apache.hadoop.hbase.coprocessor.example.TestZooKeeperScanPolicyObserver Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.081 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.914 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.165 sec Running org.apache.hadoop.hbase.coprocessor.TestBigDecimalColumnInterpreter Tests run: 38, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.578 sec Running org.apache.hadoop.hbase.coprocessor.example.TestBulkDeleteProtocol Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.252 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.053 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.954 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.646 sec Running org.apache.hadoop.hbase.mapred.TestTableInputFormat Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.006 sec Running org.apache.hadoop.hbase.mapreduce.TestHLogRecordReader Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time
[jira] [Resolved] (HBASE-6816) [WINDOWS] line endings on checkout for .sh files
[ https://issues.apache.org/jira/browse/HBASE-6816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar resolved HBASE-6816. -- Resolution: Fixed Fix Version/s: 0.96.0 Hadoop Flags: Reviewed Committed this. Thanks for the review Nicolas. [WINDOWS] line endings on checkout for .sh files Key: HBASE-6816 URL: https://issues.apache.org/jira/browse/HBASE-6816 Project: HBase Issue Type: Sub-task Reporter: Enis Soztutar Assignee: Enis Soztutar Fix For: 0.96.0 Attachments: hbase-16_v1.patch, hbase-6816_v1.patch On code checkout from svn or git, we need to ensure that the line endings for .sh files are LF, so that they work with cygwin. This is important for getting src/saveVersion.sh to work. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Build failed in Jenkins: HBase-TRUNK #3784
See https://builds.apache.org/job/HBase-TRUNK/3784/changes Changes: [tedyu] HBASE-6466 Enable multi-thread for memstore flush (Chunhui) -- [...truncated 3208 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.792 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.876 sec Running org.apache.hadoop.hbase.master.TestMasterFailover Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 203.779 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.932 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.927 sec Running org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 89.122 sec Running org.apache.hadoop.hbase.replication.TestReplicationSmallTests Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 122.515 sec Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 255.003 sec Running org.apache.hadoop.hbase.replication.TestMasterReplication Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 150.31 sec Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 88.143 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.183 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 12.426 sec Running org.apache.hadoop.hbase.TestMultiVersions Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.023 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTrackerOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.531 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 69.64 sec Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.763 sec Running org.apache.hadoop.hbase.replication.TestReplicationQueueFailover Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 136.373 sec Running org.apache.hadoop.hbase.catalog.TestMetaMigrationConvertingToPB Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.057 sec Running org.apache.hadoop.hbase.coprocessor.TestRowProcessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.351 sec Running org.apache.hadoop.hbase.TestHBaseTestingUtility Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 157.429 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.384 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.073 sec Running org.apache.hadoop.hbase.coprocessor.TestClassLoading Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.869 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.405 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.025 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.166 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.392 sec Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.87 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.484 sec Running org.apache.hadoop.hbase.thrift2.TestThriftHBaseServiceHandler Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.149 sec Running org.apache.hadoop.hbase.trace.TestHTraceHooks Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.806 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 103.157 sec Running org.apache.hadoop.hbase.thrift.TestThriftServerCmdLine Tests run: 32, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 75.838 sec Running org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster Tests run: 1, Failures: 0, Errors: 0,
[jira] [Resolved] (HBASE-6821) [WINDOWS] In TestMetaMigrationConvertingToPB .META. table name causes file system problems on windows
[ https://issues.apache.org/jira/browse/HBASE-6821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar resolved HBASE-6821. -- Resolution: Fixed Fix Version/s: 0.96.0 Hadoop Flags: Reviewed Committed this together with TestMetaMigrationConvertToPB.tgz. Removed the year in copyright notice per Ted's suggestion. Thanks for the reviews. [WINDOWS] In TestMetaMigrationConvertingToPB .META. table name causes file system problems on windows - Key: HBASE-6821 URL: https://issues.apache.org/jira/browse/HBASE-6821 Project: HBase Issue Type: Bug Affects Versions: 0.94.3, 0.96.0 Reporter: Enis Soztutar Assignee: Enis Soztutar Labels: windows Fix For: 0.96.0 Attachments: hbase-4388-root.dir.tgz, hbase-6821_v2_0.94.patch, hbase-6821_v2-trunk.patch, TestMetaMigrationConvertToPB.tgz TestMetaMigrationRemovingHTD untars a cluster dir having a .META. subdirectory. This causes mvn clean to fail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Build failed in Jenkins: HBase-0.94 #755
See https://builds.apache.org/job/HBase-0.94/755/ -- [...truncated 2221 lines...] Running org.apache.hadoop.hbase.master.TestDeadServer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.216 sec Running org.apache.hadoop.hbase.master.TestAssignmentManager Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.27 sec Running org.apache.hadoop.hbase.master.TestOpenedRegionHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.17 sec Running org.apache.hadoop.hbase.master.TestRollingRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 127.584 sec Running org.apache.hadoop.hbase.master.handler.TestTableDeleteFamilyHandler Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.267 sec Running org.apache.hadoop.hbase.master.TestMasterTransitions Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 41.51 sec Running org.apache.hadoop.hbase.master.TestZKBasedOpenCloseRegion Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.598 sec Running org.apache.hadoop.hbase.master.TestDefaultLoadBalancer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.56 sec Running org.apache.hadoop.hbase.master.TestRestartCluster Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.561 sec Running org.apache.hadoop.hbase.master.cleaner.TestHFileCleaner Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.93 sec Running org.apache.hadoop.hbase.master.cleaner.TestLogsCleaner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.956 sec Running org.apache.hadoop.hbase.master.TestClockSkewDetection Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.32 sec Running org.apache.hadoop.hbase.client.TestFromClientSideWithCoprocessor Tests run: 59, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 308.796 sec Running org.apache.hadoop.hbase.master.TestMaster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.302 sec Running org.apache.hadoop.hbase.master.TestSplitLogManager Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.363 sec Running org.apache.hadoop.hbase.master.TestMasterFailover Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 182.226 sec Running org.apache.hadoop.hbase.master.TestMasterZKSessionRecovery Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.536 sec Running org.apache.hadoop.hbase.master.TestMXBean Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.063 sec Running org.apache.hadoop.hbase.master.TestMasterFileSystem Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.434 sec Running org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.207 sec Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.293 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.704 sec Running org.apache.hadoop.hbase.replication.TestReplicationZookeeper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.072 sec Running org.apache.hadoop.hbase.TestFullLogReconstruction Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 66.809 sec Running org.apache.hadoop.hbase.replication.TestReplicationSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.021 sec Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 232.466 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.307 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.835 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.927 sec Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 84.919 sec Running org.apache.hadoop.hbase.replication.TestMasterReplication Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 132.483 sec Running org.apache.hadoop.hbase.TestMultiVersions Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.144 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.247 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.741 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 10.114 sec Running
Build failed in Jenkins: HBase-TRUNK #3785
See https://builds.apache.org/job/HBase-TRUNK/3785/changes Changes: [enis] HBASE-6821. [WINDOWS] In TestMetaMigrationConvertingToPB .META. table name causes file system problems on windows [apurtell] HBASE-7594. TestLocalHBaseCluster failing on ubuntu2 [enis] HBASE-6829. [WINDOWS] Tests should ensure that HLog is closed [enis] HBASE-6832. [WINDOWS] Tests should use explicit timestamp for Puts, and not rely on implicit RS timing [enis] HBASE-6816. [WINDOWS] line endings on checkout for .sh files -- [...truncated 3483 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec Running org.apache.hadoop.hbase.rest.TestMetricsRESTSourceImpl Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec Running org.apache.hadoop.hbase.metrics.TestBaseSourceImpl Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec Running org.apache.hadoop.hbase.replication.regionserver.TestMetricsReplicationSourceImpl Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.549 sec Results : Tests run: 16, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] --- maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (secondPartTestsExecution) @ hbase-hadoop2-compat --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.4:test-jar (default) @ hbase-hadoop2-compat --- [INFO] Building jar: /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-hadoop2-compat/target/hbase-hadoop2-compat-0.95-SNAPSHOT-tests.jar [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ hbase-hadoop2-compat --- [INFO] Building jar: /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-hadoop2-compat/target/hbase-hadoop2-compat-0.95-SNAPSHOT.jar [INFO] [INFO] --- apache-rat-plugin:0.8:check (default) @ hbase-hadoop2-compat --- [INFO] Exclude: **/*.log [INFO] Exclude: **/.* [INFO] Exclude: **/*.tgz [INFO] Exclude: **/*.orig [INFO] Exclude: **/test/** [INFO] Exclude: **/8e8ab58dcf39412da19833fcd8f687ac [INFO] Exclude: **/.git/** [INFO] Exclude: **/.idea/** [INFO] Exclude: **/target/** [INFO] Exclude: **/CHANGES.txt [INFO] Exclude: **/generated/** [INFO] Exclude: **/gen-*/** [INFO] Exclude: **/conf/* [INFO] Exclude: **/*.avpr [INFO] Exclude: **/*.svg [INFO] Exclude: **/META-INF/services/** [INFO] Exclude: **/html5shiv.js [INFO] Exclude: **/jquery.min.js [INFO] Exclude: **/*.vm [INFO] Exclude: **/control [INFO] Exclude: **/conffile [INFO] Exclude: docs/* [INFO] Exclude: **/src/site/resources/css/freebsd_docbook.css [INFO] Exclude: .git/** [INFO] Exclude: .svn/** [INFO] [INFO] [INFO] Building HBase - Integration Tests 0.95-SNAPSHOT [INFO] [INFO] [INFO] --- maven-remote-resources-plugin:1.4:process (default) @ hbase-it --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hbase-it --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/src/main/resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ hbase-it --- [INFO] No sources to compile [INFO] [INFO] --- maven-dependency-plugin:2.1:build-classpath (create-hbase-generated-classpath) @ hbase-it --- [INFO] Wrote classpath file '/x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/target/../../target/cached_classpath.txt'. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hbase-it --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 6 resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ hbase-it --- [INFO] Compiling 11 source files to /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (default-test) @ hbase-it --- [INFO] Surefire report directory: /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/target/surefire-reports [INFO] Using configured provider org.apache.maven.surefire.junitcore.JUnitCoreProvider --- T E S T S --- Results : Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] --- maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (secondPartTestsExecution) @ hbase-it --- [INFO] Surefire report directory: /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/target/surefire-reports [INFO] Using configured provider org.apache.maven.surefire.junitcore.JUnitCoreProvider --- T E S T S
[jira] [Created] (HBASE-7651) RegionServerSnapshotManager does not accept subsquent snapshots if previous fails with NotServingRegionException.
Jonathan Hsieh created HBASE-7651:
-
Summary: RegionServerSnapshotManager does not accept subsquent
snapshots if previous fails with NotServingRegionException.
Key: HBASE-7651
URL: https://issues.apache.org/jira/browse/HBASE-7651
Project: HBase
Issue Type: Sub-task
Components: snapshots
Affects Versions: hbase-7290
Reporter: Jonathan Hsieh
Priority: Blocker
I've reproduced this problem consistently on a 20 node cluster.
The first run fails on a node (jon-snaphots-2 in this case) to take snapshot
due to a NotServingRegionException (this is acceptable)
{code}
2013-01-23 13:32:48,631 DEBUG
org.apache.hadoop.hbase.errorhandling.ForeignExceptionDispatcher: accepting
received exception
org.apache.hadoop.hbase.errorhandling.ForeignException$ProxyThrowable via
jon-snapshots-2.ent.cloudera.com,22101,1358976524369:org.apache.hadoop.hbase.errorhandling.ForeignException$ProxyThrowable:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0002493652,1358976652443.b858147ad87a7812ac9a73dd8fef36ad. is closing
at
org.apache.hadoop.hbase.errorhandling.ForeignException.deserialize(ForeignException.java:184)
at
org.apache.hadoop.hbase.procedure.ZKProcedureCoordinatorRpcs.abort(ZKProcedureCoordinatorRpcs.java:240)
at
org.apache.hadoop.hbase.procedure.ZKProcedureCoordinatorRpcs$1.nodeCreated(ZKProcedureCoordinatorRpcs.java:182)
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:294)
at
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
Caused by:
org.apache.hadoop.hbase.errorhandling.ForeignException$ProxyThrowable:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0002493652,1358976652443.b858147ad87a7812ac9a73dd8fef36ad. is closing
at
org.apache.hadoop.hbase.regionserver.snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool.waitForOutstandingTasks(RegionServerSnapshotManager.java:343)
at
org.apache.hadoop.hbase.regionserver.snapshot.FlushSnapshotSubprocedure.flushSnapshot(FlushSnapshotSubprocedure.java:107)
at
org.apache.hadoop.hbase.regionserver.snapshot.FlushSnapshotSubprocedure.insideBarrier(FlushSnapshotSubprocedure.java:123)
at
org.apache.hadoop.hbase.procedure.Subprocedure.call(Subprocedure.java:181)
at
org.apache.hadoop.hbase.procedure.Subprocedure.call(Subprocedure.java:52)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
2013-01-23 13:32:48,631 DEBUG
org.apache.hadoop.hbase.errorhandling.ForeignExceptionDispatcher: Recieved
error, notifying listeners...
2013-01-23 13:32:48,730 ERROR org.apache.hadoop.hbase.procedure.Procedure:
Procedure 'pe-6' execution failed!
org.apache.hadoop.hbase.errorhandling.ForeignException$ProxyThrowable via
jon-snapshots-2.ent.cloudera.com,22101,1358976524369:org.apache.hadoop.hbase.errorhandling.ForeignException$ProxyThrowable:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0002493652,1358976652443.b858147ad87a7812ac9a73dd8fef36ad. is closing
at
org.apache.hadoop.hbase.errorhandling.ForeignExceptionDispatcher.rethrowException(ForeignExceptionDispatcher.java:84)
at
org.apache.hadoop.hbase.procedure.Procedure.waitForLatch(Procedure.java:357)
at org.apache.hadoop.hbase.procedure.Procedure.call(Procedure.java:203)
at org.apache.hadoop.hbase.procedure.Procedure.call(Procedure.java:68)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by:
org.apache.hadoop.hbase.errorhandling.ForeignException$ProxyThrowable:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0002493652,1358976652443.b858147ad87a7812ac9a73dd8fef36ad. is closing
at
org.apache.hadoop.hbase.regionserver.snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool.waitForOutstandingTasks(RegionServerSnapshotManager.java:343)
at
org.apache.hadoop.hbase.regionserver.snapshot.FlushSnapshotSubprocedure.flushSnapshot(FlushSnapshotSubprocedure.java:107)
at
Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #369
See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/369/changes Changes: [eclark] HBASE-7637 hbase-hadoop1-compat conflicts with -Dhadoop.profile=2.0 [tedyu] HBASE-5664 CP hooks in Scan flow for fast forward when filter filters out a row (Anoop) [enis] HBASE-6821. [WINDOWS] In TestMetaMigrationConvertingToPB .META. table name causes file system problems on windows [apurtell] HBASE-7594. TestLocalHBaseCluster failing on ubuntu2 [enis] HBASE-6829. [WINDOWS] Tests should ensure that HLog is closed [enis] HBASE-6832. [WINDOWS] Tests should use explicit timestamp for Puts, and not rely on implicit RS timing [enis] HBASE-6816. [WINDOWS] line endings on checkout for .sh files [tedyu] HBASE-6466 Enable multi-thread for memstore flush (Chunhui) [jxiang] HBASE-7648 TestAcidGuarantees.testMixedAtomicity hangs sometimes -- [...truncated 1946 lines...] A hbase-examples/src/main/perl/gen-perl/Hbase/Types.pm A hbase-examples/src/main/perl/gen-perl/Hbase/Constants.pm A hbase-examples/src/main/perl/gen-perl/Hbase/Hbase.pm A hbase-examples/src/main/perl/DemoClient.pl A hbase-examples/src/main/php A hbase-examples/src/main/php/DemoClient.php A hbase-examples/src/main/php/gen-php A hbase-examples/src/main/php/gen-php/Hbase A hbase-examples/src/main/php/gen-php/Hbase/Hbase.php A hbase-examples/src/main/php/gen-php/Hbase/Types.php A hbase-examples/src/main/sh A hbase-examples/src/main/sh/healthcheck A hbase-examples/src/main/sh/healthcheck/healthcheck.sh A hbase-examples/pom.xml A hbase-examples/README.txt A NOTICE.txt A LICENSE.txt A .gitignore A hbase-common A hbase-common/src A hbase-common/src/test A hbase-common/src/test/java A hbase-common/src/test/java/org A hbase-common/src/test/java/org/apache A hbase-common/src/test/java/org/apache/hadoop A hbase-common/src/test/java/org/apache/hadoop/hbase A hbase-common/src/test/java/org/apache/hadoop/hbase/MediumTests.java A hbase-common/src/test/java/org/apache/hadoop/hbase/TestKeyValue.java A hbase-common/src/test/java/org/apache/hadoop/hbase/IntegrationTests.java A hbase-common/src/test/java/org/apache/hadoop/hbase/SmallTests.java A hbase-common/src/test/java/org/apache/hadoop/hbase/Waiter.java A hbase-common/src/test/java/org/apache/hadoop/hbase/ResourceChecker.java A hbase-common/src/test/java/org/apache/hadoop/hbase/ResourceCheckerJUnitListener.java A hbase-common/src/test/java/org/apache/hadoop/hbase/TestCompoundConfiguration.java A hbase-common/src/test/java/org/apache/hadoop/hbase/ClassFinder.java A hbase-common/src/test/java/org/apache/hadoop/hbase/ClassTestFinder.java A hbase-common/src/test/java/org/apache/hadoop/hbase/HBaseCommonTestingUtility.java A hbase-common/src/test/java/org/apache/hadoop/hbase/LargeTests.java A hbase-common/src/test/java/org/apache/hadoop/hbase/TestClassFinder.java A hbase-common/src/test/java/org/apache/hadoop/hbase/util A hbase-common/src/test/java/org/apache/hadoop/hbase/util/TestByteRange.java A hbase-common/src/test/java/org/apache/hadoop/hbase/util/EnvironmentEdgeManagerTestHelper.java A hbase-common/src/test/java/org/apache/hadoop/hbase/util/TestDrainBarrier.java A hbase-common/src/test/java/org/apache/hadoop/hbase/util/TestEnvironmentEdgeManager.java A hbase-common/src/test/java/org/apache/hadoop/hbase/util/TestBytes.java A hbase-common/src/test/java/org/apache/hadoop/hbase/util/TestLoadTestKVGenerator.java A hbase-common/src/test/java/org/apache/hadoop/hbase/util/TestThreads.java A hbase-common/src/main A hbase-common/src/main/java A hbase-common/src/main/java/org A hbase-common/src/main/java/org/apache A hbase-common/src/main/java/org/apache/hbase A hbase-common/src/main/java/org/apache/hbase/Cell.java A hbase-common/src/main/java/org/apache/hbase/cell A hbase-common/src/main/java/org/apache/hbase/cell/CellComparator.java A hbase-common/src/main/java/org/apache/hbase/cell/CellOutputStream.java A hbase-common/src/main/java/org/apache/hbase/cell/CellTool.java A hbase-common/src/main/java/org/apache/hbase/cell/CellScannerPosition.java A hbase-common/src/main/java/org/apache/hadoop A hbase-common/src/main/java/org/apache/hadoop/hbase A hbase-common/src/main/java/org/apache/hadoop/hbase/VersionAnnotation.java A hbase-common/src/main/java/org/apache/hadoop/hbase/KeyValueTestUtil.java A hbase-common/src/main/java/org/apache/hadoop/hbase/KeyValueTool.java A hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java A
Build failed in Jenkins: HBase-TRUNK #3786
See https://builds.apache.org/job/HBase-TRUNK/3786/changes Changes: [eclark] HBASE-7637 hbase-hadoop1-compat conflicts with -Dhadoop.profile=2.0 [tedyu] HBASE-5664 CP hooks in Scan flow for fast forward when filter filters out a row (Anoop) -- [...truncated 3209 lines...] Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.946 sec Running org.apache.hadoop.hbase.master.TestMasterFailover Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 215.664 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.527 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.351 sec Running org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 117.844 sec Running org.apache.hadoop.hbase.replication.TestReplicationSmallTests Running org.apache.hadoop.hbase.replication.TestMasterReplication Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 144.985 sec Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 170.763 sec Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 107.587 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.965 sec Running org.apache.hadoop.hbase.TestMultiVersions Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.434 sec Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 344.793 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 14.205 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.291 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTrackerOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.52 sec Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.22 sec Running org.apache.hadoop.hbase.catalog.TestMetaMigrationConvertingToPB Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 80.759 sec Running org.apache.hadoop.hbase.coprocessor.TestRowProcessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.693 sec Running org.apache.hadoop.hbase.replication.TestReplicationQueueFailover Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 172.322 sec Running org.apache.hadoop.hbase.TestHBaseTestingUtility Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 175.095 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.378 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 94.015 sec Running org.apache.hadoop.hbase.coprocessor.TestClassLoading Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.415 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.039 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 111.992 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.929 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 68.014 sec FAILURE! Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.084 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.738 sec Running org.apache.hadoop.hbase.thrift2.TestThriftHBaseServiceHandler Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.395 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.207 sec Running org.apache.hadoop.hbase.trace.TestHTraceHooks Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.756 sec Running org.apache.hadoop.hbase.regionserver.TestRegionServerNoMaster Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.823 sec Running
Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #370
See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/370/ -- [...truncated 18869 lines...] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.633 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter7466885582520902486.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire1789082968294645048tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1766907440060488272037tmp Running org.apache.hadoop.hbase.TestAcidGuarantees Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 111.364 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter3094846852699030101.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire6270678267161246004tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1772577310826934078993tmp Running org.apache.hadoop.hbase.replication.TestReplicationSmallTests Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 142.04 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter2629501921757926799.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire1386705808415354324tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1785229533113040223677tmp Running org.apache.hadoop.hbase.replication.TestReplicationQueueFailover Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 150.027 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter4323902976785941939.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire5234025880045956425tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1791224661934173050001tmp Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.265 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter4968791986929881194.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire8031506973392405067tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1807835342129013284389tmp Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.03 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter3860543472520083031.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire5918390172219949771tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1818580332045660659008tmp Running
RE: Multiple RS for serving one region
Is that also possible to control which disk the blocks are assigned? Say when there are multiple disks on one node, I wish the blocks belong to the local region distribute evenly across the disks. At present, it seems to that it is not. Though if you take non local regions' replica blocks in consider, overall blocks are distribute evenly, but when you scan a table, you don't touch those replica blocks. Thus, a non evenly distribute local region's block might lead to hotspot disk. There is a jira after all. It is HBASE-4755. On Tue, Jan 22, 2013 at 10:38 AM, Devaraj Das d...@hortonworks.com wrote: I'll raise a jira shortly (couldn't locate jiras that talk about this) and update here. But as it stands, I take it that people here finds this feature beneficial (although not many people chimed in yet). Yes, we'd probably need to work with Hadoop core to see this feature go through. It'll be great to hear from some facebook devs on this topic. On Tue, Jan 22, 2013 at 10:31 AM, Ted Yu yuzhih...@gmail.com wrote: The feature depends on hdfs support. Once we have that, we can implement this feature in HBase. Cheers On Tue, Jan 22, 2013 at 8:49 AM, Otis Gospodnetic otis.gospodne...@gmail.com wrote: This sounds hugely useful to me and is one of those why doesn't HBase have that things that bugged me. Is there an issue to watch? http://search-hadoop.com/?q=region+failover+secondaryfc_project=HBa sefc_type=issuedoesn't find any. Thanks, Otis -- HBASE Performance Monitoring - http://sematext.com/spm/index.html On Mon, Jan 21, 2013 at 7:55 PM, Jonathan Hsieh j...@cloudera.com wrote: The main motivation is to maintain good performance on RS failovers. This is also tied with hdfs and its block placement policy. Let me explain as I understand it. If we control the hdfs block placement strategy we can write all blocks for a hfile (or for all hfiles related to a region) to the same set of data nodes. If the RS fails, they favor failover to a node that has a local copy of all the blocks. Today, when you write an hfile to hdfs, for each block the first replica goes to the local data node but the others get disbursed around the cluster randomly at a per block granularity. The problem here is that if the rs fails, the new rs that gets the responsibility for the region has to read files that are spread all over the cluster and with roughly 1/nth of the data local. This means that the recovered region is slower until a compaction localizes the data gain. They've gone in and modified hdfs and their hbase to take advantage of this idea. I believe the randomization policy is enforced per region -- if an rs serves 25 region, all the files within a each region are sent to the same set of secondary/tertiary nodes, but each region sends to a different set of secondary/tertiary nodes. Jon. On Mon, Jan 21, 2013 at 3:48 PM, Devaraj Das d...@hortonworks.com wrote: In 0.89-fb branch I stumbled upon stuff that indicated that there is a concept of secondary and tertiary regionserver. Could someone with more insights please shed some light on this? Might be useful to do the analysis on whether it makes sense for trunk.. Thanks Devaraj -- // Jonathan Hsieh (shay) // Software Engineer, Cloudera // j...@cloudera.com
Re: HBASE-7114 Increment does not extend Mutation but probably should
The reason was that Increment was serialized differently (compared to all other mutations). In trunk that is no longer an issue, since the serialization logic is no longer part of the object to be serialized. -- Lars From: Ted Yu yuzhih...@gmail.com To: dev@hbase.apache.org; u...@hbase.apache.org Sent: Wednesday, January 23, 2013 10:25 AM Subject: HBASE-7114 Increment does not extend Mutation but probably should Hi, I want to get opinion on whether we should proceed with HBASE-7114 'Increment does not extend Mutation but probably should' in trunk. Is anyone using Increment.setWriteToWAL or Increment.getFamilyMap ? For Increment.setWriteToWAL, are you using the Increment returned ? Your feedback would be appreciated.
Build failed in Jenkins: HBase-TRUNK #3787
See https://builds.apache.org/job/HBase-TRUNK/3787/ -- [...truncated 3245 lines...] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.664 sec Running org.apache.hadoop.hbase.replication.TestReplicationSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.592 sec Running org.apache.hadoop.hbase.master.TestMasterFailover Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 256.595 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.511 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.773 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.87 sec Running org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 134.836 sec Running org.apache.hadoop.hbase.replication.TestReplicationSmallTests Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 170.459 sec Running org.apache.hadoop.hbase.replication.TestMasterReplication Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 207.609 sec Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 135.094 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.305 sec Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 393.499 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 14.363 sec Running org.apache.hadoop.hbase.TestMultiVersions Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 76.189 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 82.66 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTrackerOnCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.745 sec Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.64 sec Running org.apache.hadoop.hbase.replication.TestReplicationQueueFailover Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 171.274 sec Running org.apache.hadoop.hbase.catalog.TestMetaMigrationConvertingToPB Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 87.518 sec Running org.apache.hadoop.hbase.coprocessor.TestRowProcessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.59 sec Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.081 sec Running org.apache.hadoop.hbase.TestHBaseTestingUtility Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 207.297 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.193 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 80.349 sec Running org.apache.hadoop.hbase.coprocessor.TestClassLoading Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.906 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 69.384 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.852 sec Running org.apache.hadoop.hbase.coprocessor.TestWALObserver Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.811 sec Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.45 sec Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.099 sec Running org.apache.hadoop.hbase.thrift2.TestThriftHBaseServiceHandler Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.259 sec Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.509 sec Running org.apache.hadoop.hbase.trace.TestHTraceHooks Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.146 sec Running org.apache.hadoop.hbase.regionserver.TestRegionServerNoMaster Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.716 sec Running
Build failed in Jenkins: HBase-TRUNK #3789
See https://builds.apache.org/job/HBase-TRUNK/3789/changes Changes: [tedyu] HBASE-7268 correct local region location cache information can be overwritten (or deleted) w/stale information from an old server, Addendum (Sergey) -- [...truncated 3387 lines...] Running org.apache.hadoop.hbase.util.TestDefaultEnvironmentEdge Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.292 sec Running org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildOverlap Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.213 sec Running org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.097 sec Running org.apache.hadoop.hbase.TestInfoServers Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.398 sec Running org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildHole Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.858 sec Running org.apache.hadoop.hbase.util.TestHBaseFsck Tests run: 32, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 212.449 sec Results : Tests run: 1322, Failures: 0, Errors: 0, Skipped: 13 [INFO] [INFO] --- maven-jar-plugin:2.4:test-jar (default) @ hbase-server --- [INFO] Building jar: /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-server/target/hbase-server-0.95-SNAPSHOT-tests.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources) @ hbase-server --- [INFO] Building jar: /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-server/target/hbase-server-0.95-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ hbase-server --- [INFO] Building jar: /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-server/target/hbase-server-0.95-SNAPSHOT.jar [INFO] [INFO] --- apache-rat-plugin:0.8:check (default) @ hbase-server --- [INFO] Exclude: **/*.log [INFO] Exclude: **/.* [INFO] Exclude: **/*.tgz [INFO] Exclude: **/*.orig [INFO] Exclude: **/test/** [INFO] Exclude: **/8e8ab58dcf39412da19833fcd8f687ac [INFO] Exclude: **/.git/** [INFO] Exclude: **/.idea/** [INFO] Exclude: **/target/** [INFO] Exclude: **/CHANGES.txt [INFO] Exclude: **/generated/** [INFO] Exclude: **/gen-*/** [INFO] Exclude: **/conf/* [INFO] Exclude: **/*.avpr [INFO] Exclude: **/*.svg [INFO] Exclude: **/META-INF/services/** [INFO] Exclude: **/html5shiv.js [INFO] Exclude: **/jquery.min.js [INFO] Exclude: **/*.vm [INFO] Exclude: **/control [INFO] Exclude: **/conffile [INFO] Exclude: docs/* [INFO] Exclude: **/src/site/resources/css/freebsd_docbook.css [INFO] Exclude: .git/** [INFO] Exclude: .svn/** [INFO] [INFO] [INFO] Building HBase - Integration Tests 0.95-SNAPSHOT [INFO] [INFO] [INFO] --- maven-remote-resources-plugin:1.4:process (default) @ hbase-it --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hbase-it --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/src/main/resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ hbase-it --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hbase-it --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 6 resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ hbase-it --- [INFO] Compiling 11 source files to /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (default-test) @ hbase-it --- [INFO] Surefire report directory: /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/target/surefire-reports [INFO] Using configured provider org.apache.maven.surefire.junitcore.JUnitCoreProvider --- T E S T S --- Results : Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] --- maven-dependency-plugin:2.1:build-classpath (create-hbase-generated-classpath) @ hbase-it --- [INFO] Wrote classpath file '/x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/target/../../target/cached_classpath.txt'. [INFO] [INFO] --- maven-surefire-plugin:2.12-TRUNK-HBASE-2:test (secondPartTestsExecution) @ hbase-it --- [INFO] Surefire report directory: /x1/jenkins/jenkins-slave/workspace/HBase-TRUNK/trunk/hbase-it/target/surefire-reports [INFO] Using configured provider org.apache.maven.surefire.junitcore.JUnitCoreProvider
recent 0.94 failures
https://builds.apache.org/job/HBase-0.94/ Prime suspects are: HBASE-7599 (Devaraj), and HBASE-7638 (Sergey). If anybody has any ideas. Otherwise I'll start with reverting these changes. -- Lars
Re: recent 0.94 failures
Lars:
Here is what I put in HBASE-7638:
Sergey and I looked at the patch.
There is no potential for NullPointerException similar to what HBASE-7268
addendum fixes.
See deleteCachedLocation():
{code}
if (oldLocation != null) {
isStaleDelete = (source != null) !oldLocation.equals(source);
{code}
I also ran the tests that failed in recent 0.94 builds and they all passed:
1041 mt -Dtest=TestLruBlockCache,TestMiniClusterLoadParallel
1042 mt -Dtest=TestLruBlockCache
1043 mt -Dtest=TestCompactionState
1044 mt -Dtest=TestRSKilledWhenMasterInitializing
I would also loop the above tests to see if I can get test failure.
I understand it is important to have a green 0.94 build. So whether / what
to roll back is up to you.
Cheers
On Wed, Jan 23, 2013 at 8:03 PM, lars hofhansl la...@apache.org wrote:
https://builds.apache.org/job/HBase-0.94/
Prime suspects are: HBASE-7599 (Devaraj), and HBASE-7638 (Sergey).
If anybody has any ideas.
Otherwise I'll start with reverting these changes.
-- Lars
Re: recent 0.94 failures
I ran the tests 4 rounds and they all passed:
1046 ~/runtest.sh 4
TestLruBlockCache,TestMiniClusterLoadParallel,TestLruBlockCache,TestCompactionState,TestRSKilledWhenMasterInitializing
FYI
On Wed, Jan 23, 2013 at 8:07 PM, Ted Yu yuzhih...@gmail.com wrote:
Lars:
Here is what I put in HBASE-7638:
Sergey and I looked at the patch.
There is no potential for NullPointerException similar to what HBASE-7268
addendum fixes.
See deleteCachedLocation():
{code}
if (oldLocation != null) {
isStaleDelete = (source != null)
!oldLocation.equals(source);
{code}
I also ran the tests that failed in recent 0.94 builds and they all passed:
1041 mt -Dtest=TestLruBlockCache,TestMiniClusterLoadParallel
1042 mt -Dtest=TestLruBlockCache
1043 mt -Dtest=TestCompactionState
1044 mt -Dtest=TestRSKilledWhenMasterInitializing
I would also loop the above tests to see if I can get test failure.
I understand it is important to have a green 0.94 build. So whether / what
to roll back is up to you.
Cheers
On Wed, Jan 23, 2013 at 8:03 PM, lars hofhansl la...@apache.org wrote:
https://builds.apache.org/job/HBase-0.94/
Prime suspects are: HBASE-7599 (Devaraj), and HBASE-7638 (Sergey).
If anybody has any ideas.
Otherwise I'll start with reverting these changes.
-- Lars
Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #371
See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/371/changes Changes: [tedyu] HBASE-7268 correct local region location cache information can be overwritten (or deleted) w/stale information from an old server, Addendum (Sergey) -- [...truncated 18788 lines...] Running org.apache.hadoop.hbase.regionserver.TestPriorityRpc Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.868 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter6951842450142904387.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire4755863487888939329tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1818998121853398238028tmp Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 66.084 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter8006348990057342619.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire2650400947255232333tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1828305583845445141793tmp Running org.apache.hadoop.hbase.regionserver.TestCompactionState Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 141.3 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter5948802526404436656.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire8885799079811624133tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1834906663249462127023tmp Running org.apache.hadoop.hbase.regionserver.wal.TestHLog Tests run: 11, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 71.408 sec FAILURE! Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter2313372036820294015.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire3129759285344653209tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_1842626836566304244407tmp Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 221.329 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter6586284996075894112.jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire5797654184736754060tmp https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefire_185787801921562323887tmp Running org.apache.hadoop.hbase.regionserver.TestJoinedScanners Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 348.024 sec Forking command line: /bin/sh -c cd https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server /home/jenkins/tools/java/jdk1.6.0_27-32/jre/bin/java -enableassertions -Xmx1900m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -jar https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/ws/trunk/hbase-server/target/surefire/surefirebooter3197655583741631229.jar
Jenkins build is back to normal : HBase-0.94 #757
See https://builds.apache.org/job/HBase-0.94/757/
Re: recent 0.94 failures
Hmm... Also got a successful run now.
Maybe it was a temporary env issue. It is just strange that the same test would
fail twice in a row suddenly, along with other test that have not failed in a
while.
Looking at the runtime of TestMiniClusterLoadParallel on Ubuntu1 it tooK 104s.
In the latest run on Ubuntu5 it took 292s.
In the failed runs it over 500s.
-- Lars
From: Ted Yu yuzhih...@gmail.com
To: dev@hbase.apache.org; lars hofhansl la...@apache.org
Sent: Wednesday, January 23, 2013 8:34 PM
Subject: Re: recent 0.94 failures
I ran the tests 4 rounds and they all passed:
1046 ~/runtest.sh 4
TestLruBlockCache,TestMiniClusterLoadParallel,TestLruBlockCache,TestCompactionState,TestRSKilledWhenMasterInitializing
FYI
On Wed, Jan 23, 2013 at 8:07 PM, Ted Yu yuzhih...@gmail.com wrote:
Lars:
Here is what I put in HBASE-7638:
Sergey and I looked at the patch.
There is no potential for NullPointerException similar to what HBASE-7268
addendum fixes.
See deleteCachedLocation():
{code}
if (oldLocation != null) {
isStaleDelete = (source != null)
!oldLocation.equals(source);
{code}
I also ran the tests that failed in recent 0.94 builds and they all passed:
1041 mt -Dtest=TestLruBlockCache,TestMiniClusterLoadParallel
1042 mt -Dtest=TestLruBlockCache
1043 mt -Dtest=TestCompactionState
1044 mt -Dtest=TestRSKilledWhenMasterInitializing
I would also loop the above tests to see if I can get test failure.
I understand it is important to have a green 0.94 build. So whether / what
to roll back is up to you.
Cheers
On Wed, Jan 23, 2013 at 8:03 PM, lars hofhansl la...@apache.org wrote:
https://builds.apache.org/job/HBase-0.94/
Prime suspects are: HBASE-7599 (Devaraj), and HBASE-7638 (Sergey).
If anybody has any ideas.
Otherwise I'll start with reverting these changes.
-- Lars
Build failed in Jenkins: HBase-0.94 #758
See https://builds.apache.org/job/HBase-0.94/758/ -- [...truncated 2209 lines...] Running org.apache.hadoop.hbase.client.TestFromClientSide Tests run: 59, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 412.478 sec Running org.apache.hadoop.hbase.master.TestOpenedRegionHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 100.413 sec Running org.apache.hadoop.hbase.master.TestRollingRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 156.486 sec Running org.apache.hadoop.hbase.master.handler.TestTableDeleteFamilyHandler Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 141.248 sec Running org.apache.hadoop.hbase.master.TestMasterTransitions Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 57.943 sec Running org.apache.hadoop.hbase.master.TestDefaultLoadBalancer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.726 sec Running org.apache.hadoop.hbase.master.TestZKBasedOpenCloseRegion Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.289 sec Running org.apache.hadoop.hbase.master.cleaner.TestHFileCleaner Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.379 sec Running org.apache.hadoop.hbase.master.cleaner.TestLogsCleaner Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.581 sec Running org.apache.hadoop.hbase.master.TestClockSkewDetection Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.302 sec Running org.apache.hadoop.hbase.master.TestRestartCluster Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 99.312 sec Running org.apache.hadoop.hbase.master.TestMaster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.141 sec Running org.apache.hadoop.hbase.client.TestFromClientSideWithCoprocessor Tests run: 59, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 409.327 sec Running org.apache.hadoop.hbase.master.TestSplitLogManager Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 75.098 sec Running org.apache.hadoop.hbase.master.TestMXBean Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.542 sec Running org.apache.hadoop.hbase.master.TestMasterFailover Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 254.931 sec Running org.apache.hadoop.hbase.master.TestMasterZKSessionRecovery Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 80.045 sec Running org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.02 sec Running org.apache.hadoop.hbase.master.TestMasterFileSystem Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.445 sec Running org.apache.hadoop.hbase.metrics.TestMetricsMBeanBase Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.352 sec Running org.apache.hadoop.hbase.TestGlobalMemStoreSize Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.756 sec Running org.apache.hadoop.hbase.TestZooKeeper Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.94 sec Running org.apache.hadoop.hbase.replication.TestReplicationZookeeper Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.822 sec Running org.apache.hadoop.hbase.replication.TestReplicationSource Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.609 sec Running org.apache.hadoop.hbase.TestFullLogReconstruction Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 97.187 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.277 sec Running org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.295 sec Running org.apache.hadoop.hbase.master.TestDistributedLogSplitting Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 366.604 sec Running org.apache.hadoop.hbase.replication.TestMasterReplication Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 158.822 sec Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 89.352 sec Running org.apache.hadoop.hbase.TestMultiVersions Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.786 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditorNoCluster Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.62 sec Running org.apache.hadoop.hbase.catalog.TestMetaReaderEditor Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.402 sec Running org.apache.hadoop.hbase.catalog.TestCatalogTracker Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 11.778 sec Running org.apache.hadoop.hbase.TestHBaseTestingUtility Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 135.465 sec Running
[jira] [Reopened] (HBASE-7638) [0.94] region cache entry should only be removed on error if the error is from the server currently in cache
[ https://issues.apache.org/jira/browse/HBASE-7638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl reopened HBASE-7638: -- Reverted for now. (Will reapply if turns out not to be the issue) [0.94] region cache entry should only be removed on error if the error is from the server currently in cache Key: HBASE-7638 URL: https://issues.apache.org/jira/browse/HBASE-7638 Project: HBase Issue Type: Bug Affects Versions: 0.94.4 Reporter: Sergey Shelukhin Assignee: Sergey Shelukhin Priority: Minor Fix For: 0.94.5 Attachments: HBASE-7638-v0.patch See HBASE-7268. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Jenkins build is back to normal : HBase-0.94 #759
See https://builds.apache.org/job/HBase-0.94/759/changes
[jira] [Created] (HBASE-7652) Flag in the mutations to indicate asynchronous write to WAL
Devaraj Das created HBASE-7652: -- Summary: Flag in the mutations to indicate asynchronous write to WAL Key: HBASE-7652 URL: https://issues.apache.org/jira/browse/HBASE-7652 Project: HBase Issue Type: Improvement Reporter: Devaraj Das Today the mutation APIs accepts a flag that indicates whether to skip the WAL or not. As discussed in HBASE-5930, it'd be good to have an option to do asynchronous write to WAL if the user so desired. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
