See
<https://builds.apache.org/job/HBase-1.4/jdk=latest1.7,label=yahoo-not-h2/276/changes>
Changes:
[eclark] HBASE-15935 Set up a concurrent walker that walks flushed circular
[stack] HBASE-15775 Canary launches two AuthUtil Chores
[liyu] NPE in RpcServer causing intermittent UT failure of
[liyu] Revert "NPE in RpcServer causing intermittent UT failure of
[liyu] HBASE-16201 NPE in RpcServer causing intermittent UT failure of
------------------------------------------
[...truncated 47690 lines...]
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.81 sec - in
org.apache.hadoop.hbase.zookeeper.TestZKMulti
Running org.apache.hadoop.hbase.zookeeper.TestHQuorumPeer
Running org.apache.hadoop.hbase.zookeeper.TestZooKeeperACL
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.616 sec - in
org.apache.hadoop.hbase.zookeeper.TestZooKeeperACL
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.095 sec - in
org.apache.hadoop.hbase.zookeeper.TestHQuorumPeer
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.182 sec - in
org.apache.hadoop.hbase.wal.TestDefaultWALProviderWithHLogKey
Running org.apache.hadoop.hbase.TestIOFencing
Running org.apache.hadoop.hbase.TestMovedRegionsCleaner
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.494 sec - in
org.apache.hadoop.hbase.zookeeper.lock.TestZKInterProcessReadWriteLock
Running org.apache.hadoop.hbase.backup.example.TestZooKeeperTableArchiveClient
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.644 sec - in
org.apache.hadoop.hbase.backup.example.TestZooKeeperTableArchiveClient
Running org.apache.hadoop.hbase.constraint.TestConstraint
Running org.apache.hadoop.hbase.backup.TestHFileArchiving
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.783 sec - in
org.apache.hadoop.hbase.TestMovedRegionsCleaner
Running org.apache.hadoop.hbase.tool.TestCanaryTool
Running org.apache.hadoop.hbase.TestHColumnDescriptorDefaultVersions
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.694 sec - in
org.apache.hadoop.hbase.constraint.TestConstraint
Running org.apache.hadoop.hbase.ipc.TestProtoBufRpc
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.452 sec - in
org.apache.hadoop.hbase.ipc.TestProtoBufRpc
Running org.apache.hadoop.hbase.ipc.TestHBaseClient
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.21 sec - in
org.apache.hadoop.hbase.ipc.TestHBaseClient
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.162 sec - in
org.apache.hadoop.hbase.TestHColumnDescriptorDefaultVersions
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 86.109 sec - in
org.apache.hadoop.hbase.backup.TestHFileArchiving
Running org.apache.hadoop.hbase.TestNamespace
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 127.204 sec -
in org.apache.hadoop.hbase.tool.TestCanaryTool
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 182.459 sec -
in org.apache.hadoop.hbase.TestIOFencing
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 67.444 sec - in
org.apache.hadoop.hbase.TestNamespace
Results :
Tests in error:
TestExportSnapshot.testExportFailure:321->runExportAndInjectFailures:348 »
TestTimedOut
Flaked tests:
org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancer2.testRegionReplicasOnMidClusterHighReplication(org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancer2)
Run 1:
TestStochasticLoadBalancer2.testRegionReplicasOnMidClusterHighReplication:79->BalancerTestBase.testWithCluster:423->BalancerTestBase.testWithCluster:451->BalancerTestBase.assertRegionReplicaPlacement:226
Two or more region replicas are hosted on the same host after balance
Run 2:
TestStochasticLoadBalancer2.testRegionReplicasOnMidClusterHighReplication:79->BalancerTestBase.testWithCluster:423->BalancerTestBase.testWithCluster:451->BalancerTestBase.assertRegionReplicaPlacement:226
Two or more region replicas are hosted on the same host after balance
Run 3: PASS
org.apache.hadoop.hbase.regionserver.TestScannerHeartbeatMessages.testScannerHeartbeatMessages(org.apache.hadoop.hbase.regionserver.TestScannerHeartbeatMessages)
Run 1:
TestScannerHeartbeatMessages.testScannerHeartbeatMessages:209->testImportanceOfHeartbeats:225
Heartbeat messages are enabled, exceptions should NOT be thrown. Exception
trace:org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after
attempts=36, exceptions:
Fri Jul 08 22:01:30 UTC 2016, null, java.net.SocketTimeoutException:
callTimeout=1000, callDuration=1003: Call to
asf910.gq1.ygridcore.net/67.195.81.154:57828 failed on local exception:
org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=133, waitTime=1002,
operationTimeout=1000 expired. row '' on table
'testScannerHeartbeatMessagesTable' at
region=testScannerHeartbeatMessagesTable,,1468015235248.67c833f9d78d1b5fbf75e9c355f548b4.,
hostname=asf910.gq1.ygridcore.net,57828,1468015226366, seqNum=2
at
org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:276)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:210)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:212)
at
org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:326)
at
org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:409)
at
org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:370)
at
org.apache.hadoop.hbase.regionserver.TestScannerHeartbeatMessages$3.call(TestScannerHeartbeatMessages.java:321)
at
org.apache.hadoop.hbase.regionserver.TestScannerHeartbeatMessages$3.call(TestScannerHeartbeatMessages.java:312)
at
org.apache.hadoop.hbase.regionserver.TestScannerHeartbeatMessages.testImportanceOfHeartbeats(TestScannerHeartbeatMessages.java:223)
at
org.apache.hadoop.hbase.regionserver.TestScannerHeartbeatMessages.testScannerHeartbeatMessages(TestScannerHeartbeatMessages.java:209)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:108)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:78)
at
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:54)
at
org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:144)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
Caused by: java.net.SocketTimeoutException: callTimeout=1000,
callDuration=1003: Call to asf910.gq1.ygridcore.net/67.195.81.154:57828 failed
on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call
id=133, waitTime=1002, operationTimeout=1000 expired. row '' on table
'testScannerHeartbeatMessagesTable' at
region=testScannerHeartbeatMessagesTable,,1468015235248.67c833f9d78d1b5fbf75e9c355f548b4.,
hostname=asf910.gq1.ygridcore.net,57828,1468015226366, seqNum=2
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:171)
at
org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Call to
asf910.gq1.ygridcore.net/67.195.81.154:57828 failed on local exception:
org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=133, waitTime=1002,
operationTimeout=1000 expired.
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient.wrapException(AbstractRpcClient.java:292)
at
org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1275)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:227)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:336)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:35396)
at
org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:223)
at
org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:64)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:212)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:364)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:338)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:137)
... 4 more
Caused by: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=133,
waitTime=1002, operationTimeout=1000 expired.
at org.apache.hadoop.hbase.ipc.Call.checkAndSetTimeout(Call.java:73)
at
org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1249)
... 13 more
Run 2: PASS
Tests run: 2566, Failures: 0, Errors: 1, Skipped: 57, Flakes: 2
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache HBase ...................................... SUCCESS [2:59.249s]
[INFO] Apache HBase - Checkstyle ......................... SUCCESS [15.748s]
[INFO] Apache HBase - Resource Bundle .................... SUCCESS [0.370s]
[INFO] Apache HBase - Annotations ........................ SUCCESS [1.469s]
[INFO] Apache HBase - Protocol ........................... SUCCESS [30.727s]
[INFO] Apache HBase - Common ............................. SUCCESS [3:52.344s]
[INFO] Apache HBase - Procedure .......................... SUCCESS [4:02.859s]
[INFO] Apache HBase - Client ............................. SUCCESS [1:50.701s]
[INFO] Apache HBase - Hadoop Compatibility ............... SUCCESS [12.820s]
[INFO] Apache HBase - Hadoop Two Compatibility ........... SUCCESS [18.837s]
[INFO] Apache HBase - Prefix Tree ........................ SUCCESS [15.717s]
[INFO] Apache HBase - Server ............................. FAILURE
[2:26:55.374s]
[INFO] Apache HBase - Testing Util ....................... SKIPPED
[INFO] Apache HBase - Thrift ............................. SKIPPED
[INFO] Apache HBase - Rest ............................... SKIPPED
[INFO] Apache HBase - Shell .............................. SKIPPED
[INFO] Apache HBase - Integration Tests .................. SKIPPED
[INFO] Apache HBase - Examples ........................... SKIPPED
[INFO] Apache HBase - External Block Cache ............... SKIPPED
[INFO] Apache HBase - Assembly ........................... SKIPPED
[INFO] Apache HBase - Shaded ............................. SKIPPED
[INFO] Apache HBase - Shaded - Client .................... SKIPPED
[INFO] Apache HBase - Shaded - Server .................... SKIPPED
[INFO] Apache HBase - Archetypes ......................... SKIPPED
[INFO] Apache HBase - Exemplar for hbase-client archetype SKIPPED
[INFO] Apache HBase - Exemplar for hbase-shaded-client archetype SKIPPED
[INFO] Apache HBase - Archetype builder .................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:42:14.446s
[INFO] Finished at: Fri Jul 08 22:54:33 UTC 2016
[INFO] Final Memory: 498M/742M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test
(secondPartTestsExecution) on project hbase-server: There was a timeout or
other error in the fork -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hbase-server
Build step 'Invoke top-level Maven targets' marked build as failure
Performing Post build task...
Match found for :.* : True
Logical operation result is TRUE
Running script : # Post-build task script. TODO: Check this in and have all
builds reference check-in.
pwd && ls
# NOTE!!!! The below code has been copied and pasted from
./dev-tools/run-test.sh
# Do not change here without syncing there and vice-versa.
ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test' | wc
-l`
if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
echo "Suspicious java process found - waiting 30s to see if there are just
slow to stop"
sleep 30
ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test' | wc
-l`
if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
echo " {color:red}There appear to be $ZOMBIE_TESTS_COUNT zombie
tests{color}, they should have been killed by surefire but survived"
jps -v | grep surefirebooter | grep -e '-Dhbase.test'
jps -v | grep surefirebooter | grep -e '-Dhbase.test' | cut -d ' ' -f 1 |
xargs -n 1 jstack
# Exit with error
exit 1
else
echo "We're ok: there is no zombie test, but some tests took some time to
stop"
fi
else
echo "We're ok: there is no zombie test"
fi
[yahoo-not-h2] $ /bin/bash -xe /tmp/hudson6249550770571214231.sh
+ pwd
<https://builds.apache.org/job/HBase-1.4/jdk=latest1.7,label=yahoo-not-h2/ws/>
+ ls
bin
CHANGES.txt
conf
dev-support
hbase-annotations
hbase-archetypes
hbase-assembly
hbase-checkstyle
hbase-client
hbase-common
hbase-examples
hbase-external-blockcache
hbase-hadoop2-compat
hbase-hadoop-compat
hbase-it
hbase-native-client
hbase-prefix-tree
hbase-procedure
hbase-protocol
hbase-resource-bundle
hbase-rest
hbase-server
hbase-shaded
hbase-shell
hbase-testing-util
hbase-thrift
LICENSE.txt
NOTICE.txt
pom.xml
README.txt
src
target
++ wc -l
++ grep -e -Dhbase.test
++ grep surefirebooter
++ jps -v
+ ZOMBIE_TESTS_COUNT=1
+ [[ 1 != 0 ]]
+ echo 'Suspicious java process found - waiting 30s to see if there are just
slow to stop'
Suspicious java process found - waiting 30s to see if there are just slow to
stop
+ sleep 30
++ jps -v
++ grep surefirebooter
++ grep -e -Dhbase.test
++ wc -l
+ ZOMBIE_TESTS_COUNT=0
+ [[ 0 != 0 ]]
+ echo 'We'\''re ok: there is no zombie test, but some tests took some time to
stop'
We're ok: there is no zombie test, but some tests took some time to stop
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Archiving artifacts
Recording test results
