Enis (or anyone): This test came in with:
HBASE-7305. ZK based Read/Write locks for table operations It fails rarely enough and seeminly only on 1.8. https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.3/lastCompletedBuild/jdk=latest1.8,label=Hadoop/testReport/org.apache.hadoop.hbase.master/TestTableLockManager/testReapAllTableLocks/history/ The failure is weird though. It is not supposed to happen. Error Message Timed out acquiring writelock for table:table4for:zero timeout after 0 ms. Stacktrace org.apache.hadoop.hbase.exceptions.LockTimeoutException: Timed out acquiring writelock for table:table4for:zero timeout after 0 ms. at org.apache.hadoop.hbase.master.TableLockManager$ZKTableLockManager$TableLockImpl.acquire(TableLockManager.java:282) at org.apache.hadoop.hbase.master.TestTableLockManager.testReapAllTableLocks(TestTableLockManager.java:283) See https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.3/lastCompletedBuild/jdk=latest1.8,label=Hadoop/testReport/org.apache.hadoop.hbase.master/TestTableLockManager/testReapAllTableLocks/ Any input? St.Ack On Fri, Nov 20, 2015 at 6:05 AM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.8,label=Hadoop/385/changes > > > > Changes: > > [ramkrishna] HBASE-14840 Sink cluster reports data replication request as > success > > ------------------------------------------ > [...truncated 45422 lines...] > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.filter.TestMultiRowRangeFilter > Running org.apache.hadoop.hbase.filter.TestFilterWithScanLimits > Running org.apache.hadoop.hbase.filter.TestScanRowPrefix > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.666 sec > - in org.apache.hadoop.hbase.filter.TestFilterWithScanLimits > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.TestGlobalMemStoreSize > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.957 sec > - in org.apache.hadoop.hbase.filter.TestScanRowPrefix > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.TestHBaseOnOtherDfsCluster > Running org.apache.hadoop.hbase.filter.TestFilterWrapper > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.025 sec > - in org.apache.hadoop.hbase.filter.TestFilterWrapper > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.174 > sec - in org.apache.hadoop.hbase.filter.TestMultiRowRangeFilter > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.128 sec > - in org.apache.hadoop.hbase.TestHBaseOnOtherDfsCluster > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.384 sec > - in org.apache.hadoop.hbase.TestGlobalMemStoreSize > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.TestNamespace > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.migration.TestUpgradeTo96 > Running org.apache.hadoop.hbase.replication.TestReplicationSource > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.507 sec > - in org.apache.hadoop.hbase.replication.TestReplicationSource > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.647 sec > - in org.apache.hadoop.hbase.migration.TestUpgradeTo96 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.migration.TestNamespaceUpgrade > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.149 sec > - in org.apache.hadoop.hbase.TestNamespace > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.replication.TestPerTableCFReplication > Running org.apache.hadoop.hbase.replication.TestReplicationWithTags > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.519 sec > - in org.apache.hadoop.hbase.replication.TestReplicationWithTags > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.647 sec > - in org.apache.hadoop.hbase.migration.TestNamespaceUpgrade > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.replication.TestMultiSlaveReplication > Running > org.apache.hadoop.hbase.replication.TestReplicationChangingPeerRegionservers > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.463 sec > - in org.apache.hadoop.hbase.replication.TestPerTableCFReplication > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.467 sec > - in > org.apache.hadoop.hbase.replication.TestReplicationChangingPeerRegionservers > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.replication.TestMasterReplication > Running org.apache.hadoop.hbase.replication.TestReplicationSmallTests > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.841 sec > - in org.apache.hadoop.hbase.replication.TestMultiSlaveReplication > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.replication.TestReplicationKillSlaveRS > Running > org.apache.hadoop.hbase.replication.regionserver.TestReplicationWALReaderManager > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.34 sec > - in org.apache.hadoop.hbase.replication.TestReplicationKillSlaveRS > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.584 > sec - in org.apache.hadoop.hbase.replication.TestReplicationSmallTests > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running > org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpointNoMaster > Running > org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.106 sec > - in > org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManager > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running > org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 233.352 > sec - in org.apache.hadoop.hbase.filter.TestFuzzyRowFilterEndToEnd > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.923 sec > - in org.apache.hadoop.hbase.replication.regionserver.TestReplicationSink > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.75 sec > - in > org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpointNoMaster > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 106.63 sec > - in org.apache.hadoop.hbase.replication.TestMasterReplication > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running > org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint > Running > org.apache.hadoop.hbase.replication.multiwal.TestReplicationKillMasterRSCompressedWithMultipleWAL > Running > org.apache.hadoop.hbase.replication.multiwal.TestReplicationEndpointWithMultipleWAL > Running > org.apache.hadoop.hbase.replication.multiwal.TestReplicationSyncUpToolWithMultipleWAL > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.609 sec > - in > org.apache.hadoop.hbase.replication.multiwal.TestReplicationKillMasterRSCompressedWithMultipleWAL > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.697 sec > - in > org.apache.hadoop.hbase.replication.multiwal.TestReplicationEndpointWithMultipleWAL > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.replication.TestReplicationStateZKImpl > Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.331 sec > - in org.apache.hadoop.hbase.replication.TestReplicationStateZKImpl > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.replication.TestReplicationEndpoint > Running org.apache.hadoop.hbase.replication.TestReplicationSyncUpTool > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.642 sec > - in org.apache.hadoop.hbase.replication.TestReplicationEndpoint > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 59.946 sec > - in > org.apache.hadoop.hbase.replication.multiwal.TestReplicationSyncUpToolWithMultipleWAL > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.replication.TestReplicationTrackerZKImpl > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.508 sec > - in org.apache.hadoop.hbase.replication.TestReplicationTrackerZKImpl > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.202 > sec - in > org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option > MaxPermSize=256m; support was removed in 8.0 > Running org.apache.hadoop.hbase.replication.TestReplicationKillMasterRS > Running > org.apache.hadoop.hbase.replication.TestReplicationKillMasterRSCompressed > Running > org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.259 sec > - in org.apache.hadoop.hbase.replication.TestReplicationSyncUpTool > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.211 sec > - in org.apache.hadoop.hbase.replication.TestReplicationKillMasterRS > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.13 sec > - in > org.apache.hadoop.hbase.replication.TestReplicationKillMasterRSCompressed > Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 233.131 > sec - in > org.apache.hadoop.hbase.replication.regionserver.TestReplicationWALReaderManager > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.571 sec > - in org.apache.hadoop.hbase.replication.TestReplicationDisableInactivePeer > > Results : > > Tests in error: > > org.apache.hadoop.hbase.master.TestTableLockManager.testReapAllTableLocks(org.apache.hadoop.hbase.master.TestTableLockManager) > Run 1: TestTableLockManager.testReapAllTableLocks:283 » LockTimeout > Timed out acquiri... > Run 2: TestTableLockManager.testReapAllTableLocks:283 » LockTimeout > Timed out acquiri... > Run 3: TestTableLockManager.testReapAllTableLocks:283 » LockTimeout > Timed out acquiri... > > > Tests run: 2395, Failures: 0, Errors: 1, Skipped: 39 > > [INFO] > ------------------------------------------------------------------------ > [INFO] Reactor Summary: > [INFO] > [INFO] Apache HBase ...................................... SUCCESS > [57.514s] > [INFO] Apache HBase - Checkstyle ......................... SUCCESS [4.781s] > [INFO] Apache HBase - Resource Bundle .................... SUCCESS [0.166s] > [INFO] Apache HBase - Annotations ........................ SUCCESS [1.292s] > [INFO] Apache HBase - Protocol ........................... SUCCESS > [18.335s] > [INFO] Apache HBase - Common ............................. SUCCESS > [2:08.375s] > [INFO] Apache HBase - Procedure .......................... SUCCESS > [2:38.599s] > [INFO] Apache HBase - Client ............................. SUCCESS > [1:20.977s] > [INFO] Apache HBase - Hadoop Compatibility ............... SUCCESS [8.319s] > [INFO] Apache HBase - Hadoop Two Compatibility ........... SUCCESS [8.133s] > [INFO] Apache HBase - Prefix Tree ........................ SUCCESS [8.530s] > [INFO] Apache HBase - Server ............................. FAILURE > [1:33:07.573s] > [INFO] Apache HBase - Testing Util ....................... SKIPPED > [INFO] Apache HBase - Thrift ............................. SKIPPED > [INFO] Apache HBase - Rest ............................... SKIPPED > [INFO] Apache HBase - Shell .............................. SKIPPED > [INFO] Apache HBase - Integration Tests .................. SKIPPED > [INFO] Apache HBase - Examples ........................... SKIPPED > [INFO] Apache HBase - External Block Cache ............... SKIPPED > [INFO] Apache HBase - Assembly ........................... SKIPPED > [INFO] Apache HBase - Shaded ............................. SKIPPED > [INFO] Apache HBase - Shaded - Client .................... SKIPPED > [INFO] Apache HBase - Shaded - Server .................... SKIPPED > [INFO] > ------------------------------------------------------------------------ > [INFO] BUILD FAILURE > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 1:41:24.229s > [INFO] Finished at: Fri Nov 20 14:03:15 UTC 2015 > [INFO] Final Memory: 94M/667M > [INFO] > ------------------------------------------------------------------------ > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test > (secondPartTestsExecution) on project hbase-server: There are test failures. > [ERROR] > [ERROR] Please refer to < > https://builds.apache.org/job/HBase-1.3/jdk=latest1.8,label=Hadoop/ws/hbase-server/target/surefire-reports> > for the individual test results. > [ERROR] -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, > please read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn <goals> -rf :hbase-server > Build step 'Invoke top-level Maven targets' marked build as failure > Performing Post build task... > Match found for :.* : True > Logical operation result is TRUE > Running script : # Post-build task script. TODO: Check this in and have > all builds reference check-in. > pwd && ls > # NOTE!!!! The below code has been copied and pasted from > ./dev-tools/run-test.sh > # Do not change here without syncing there and vice-versa. > ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test' > | wc -l` > if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then > echo "Suspicious java process found - waiting 30s to see if there are > just slow to stop" > sleep 30 > ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test' > | wc -l` > if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then > echo " {color:red}There appear to be $ZOMBIE_TESTS_COUNT zombie > tests{color}, they should have been killed by surefire but survived" > jps -v | grep surefirebooter | grep -e '-Dhbase.test' > jps -v | grep surefirebooter | grep -e '-Dhbase.test' | cut -d ' ' -f 1 > | xargs -n 1 jstack > # Exit with error > exit 1 > else > echo "We're ok: there is no zombie test, but some tests took some time > to stop" > fi > else > echo "We're ok: there is no zombie test" > fi > [Hadoop] $ /bin/bash -xe /tmp/hudson3916715209187251998.sh > + pwd > <https://builds.apache.org/job/HBase-1.3/jdk=latest1.8,label=Hadoop/ws/> > + ls > bin > CHANGES.txt > conf > dev-support > hbase-annotations > hbase-assembly > hbase-checkstyle > hbase-client > hbase-common > hbase-examples > hbase-external-blockcache > hbase-hadoop2-compat > hbase-hadoop-compat > hbase-it > hbase-native-client > hbase-prefix-tree > hbase-procedure > hbase-protocol > hbase-resource-bundle > hbase-rest > hbase-server > hbase-shaded > hbase-shell > hbase-spark > hbase-testing-util > hbase-thrift > LICENSE.txt > NOTICE.txt > pom.xml > README.txt > src > target > ++ jps -v > ++ grep surefirebooter > ++ grep -e -Dhbase.test > ++ wc -l > + ZOMBIE_TESTS_COUNT=0 > + [[ 0 != 0 ]] > + echo 'We'\''re ok: there is no zombie test' > We're ok: there is no zombie test > POST BUILD TASK : SUCCESS > END OF POST BUILD TASK : 0 > Archiving artifacts > Recording test results >