See <https://builds.apache.org/job/HBase-1.0/139/changes>
Changes:
[stack] HBASE-11726 Master should fail-safe if starting with a pre 0.96 layout
(Esteban Guiterrez)
------------------------------------------
[...truncated 2064 lines...]
"GC task thread#9 (ParallelGC)" prio=10 tid=0xf6819000 nid=0x5d0 runnable
"GC task thread#10 (ParallelGC)" prio=10 tid=0xf681a400 nid=0x5d1 runnable
"GC task thread#11 (ParallelGC)" prio=10 tid=0xf681bc00 nid=0x5d2 runnable
"GC task thread#12 (ParallelGC)" prio=10 tid=0xf681d000 nid=0x5d3 runnable
"VM Periodic Task Thread" prio=10 tid=0xad75b000 nid=0x5dc waiting on condition
JNI global references: 1781
Found one Java-level deadlock:
=============================
"Camel (camel-26) thread #7 - jpa://org.apache.camel.examples.MultiSteps":
waiting for ownable synchronizer 0xe1c04ad8, (a
java.util.concurrent.locks.ReentrantLock$NonfairSync),
which is held by "main"
"main":
waiting for ownable synchronizer 0xe1b95008, (a
java.util.concurrent.locks.ReentrantLock$NonfairSync),
which is held by "Camel (camel-26) thread #7 -
jpa://org.apache.camel.examples.MultiSteps"
Java stack information for the threads listed above:
===================================================
"Camel (camel-26) thread #7 - jpa://org.apache.camel.examples.MultiSteps":
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0xe1c04ad8> (a
java.util.concurrent.locks.ReentrantLock$NonfairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:842)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1178)
at
java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:186)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:262)
at
org.apache.openjpa.kernel.StateManagerImpl.lock(StateManagerImpl.java:3382)
at
org.apache.openjpa.kernel.StateManagerImpl.assignObjectId(StateManagerImpl.java:576)
at
org.apache.openjpa.kernel.StateManagerImpl.fetchObjectId(StateManagerImpl.java:1528)
at
org.apache.openjpa.kernel.DetachedStateManager.<init>(DetachedStateManager.java:88)
at
org.apache.openjpa.kernel.DetachManager.detachInternal(DetachManager.java:469)
at
org.apache.openjpa.kernel.DetachManager.detachAll(DetachManager.java:334)
at
org.apache.openjpa.kernel.BrokerImpl.detachAllInternal(BrokerImpl.java:3472)
at org.apache.openjpa.kernel.BrokerImpl.detachAll(BrokerImpl.java:3436)
at
org.apache.openjpa.kernel.DelegatingBroker.detachAll(DelegatingBroker.java:1206)
at
org.apache.openjpa.persistence.EntityManagerImpl.clear(EntityManagerImpl.java:1172)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.springframework.orm.jpa.ExtendedEntityManagerCreator$ExtendedEntityManagerInvocationHandler.invoke(ExtendedEntityManagerCreator.java:366)
at com.sun.proxy.$Proxy19.clear(Unknown Source)
at
org.apache.camel.component.jpa.JpaConsumer$1.doInTransaction(JpaConsumer.java:139)
at
org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:131)
at org.apache.camel.component.jpa.JpaConsumer.poll(JpaConsumer.java:91)
at
org.apache.camel.impl.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:187)
at
org.apache.camel.impl.ScheduledPollConsumer.run(ScheduledPollConsumer.java:114)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at
java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
"main":
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0xe1b95008> (a
java.util.concurrent.locks.ReentrantLock$NonfairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:842)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1178)
at
java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:186)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:262)
at org.apache.openjpa.kernel.BrokerImpl.lock(BrokerImpl.java:4483)
at
org.apache.openjpa.kernel.BrokerImpl.beginOperation(BrokerImpl.java:1961)
at org.apache.openjpa.kernel.BrokerImpl.isActive(BrokerImpl.java:1933)
at
org.apache.openjpa.kernel.StateManagerImpl.beforeAccessField(StateManagerImpl.java:1650)
at
org.apache.openjpa.kernel.StateManagerImpl.accessingField(StateManagerImpl.java:1586)
at org.apache.camel.examples.MultiSteps.getId(MultiSteps.java)
at org.apache.camel.examples.MultiSteps.toString(MultiSteps.java:92)
at java.lang.String.valueOf(String.java:2826)
at java.lang.StringBuilder.append(StringBuilder.java:115)
at
org.apache.camel.component.jpa.JpaWithNamedQueryTest$4.doInTransaction(JpaWithNamedQueryTest.java:133)
at
org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:131)
at
org.apache.camel.component.jpa.JpaWithNamedQueryTest.testProducerInsertsIntoDatabaseThenConsumerFiresMessageExchange(JpaWithNamedQueryTest.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
Found 1 deadlock.
2014-08-29 20:43:25
Full thread dump Java HotSpot(TM) Server VM (23.25-b01 mixed mode):
"Camel (camel-109) thread #126 - pop3://[email protected]" daemon prio=10
tid=0xf675f800 nid=0x4554 waiting on condition [0xae47d000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0xde4314a8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"Attach Listener" daemon prio=10 tid=0xaa400800 nid=0x4505 waiting on condition
[0x00000000]
java.lang.Thread.State: RUNNABLE
"Service Thread" daemon prio=10 tid=0xaa8f7000 nid=0x3275 runnable [0x00000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread1" daemon prio=10 tid=0xaa8f5400 nid=0x3274 waiting on
condition [0x00000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread0" daemon prio=10 tid=0xaa8f3400 nid=0x3273 waiting on
condition [0x00000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" daemon prio=10 tid=0xaa8f1800 nid=0x3272 runnable
[0x00000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" daemon prio=10 tid=0xaa8b7000 nid=0x3271 in Object.wait()
[0xaec7d000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xb4344280> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
- locked <0xb4344280> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189)
"Reference Handler" daemon prio=10 tid=0xaa8b5400 nid=0x3270 in Object.wait()
[0xaef7d000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xb401ac18> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:503)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
- locked <0xb401ac18> (a java.lang.ref.Reference$Lock)
"main" prio=10 tid=0xf6706800 nid=0x3261 waiting on condition [0xf68b1000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at
org.apache.camel.component.mail.MimeMultipartAlternativeTest.verifyTheRecivedEmail(MimeMultipartAlternativeTest.java:64)
at
org.apache.camel.component.mail.MimeMultipartAlternativeTest.testMultipartEmailWithRegularAttachments(MimeMultipartAlternativeTest.java:95)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
"VM Thread" prio=10 tid=0xaa7f8800 nid=0x326f runnable
"GC task thread#0 (ParallelGC)" prio=10 tid=0xf6710800 nid=0x3262 runnable
"GC task thread#1 (ParallelGC)" prio=10 tid=0xf6712000 nid=0x3263 runnable
"GC task thread#2 (ParallelGC)" prio=10 tid=0xf6713400 nid=0x3264 runnable
"GC task thread#3 (ParallelGC)" prio=10 tid=0xf6714c00 nid=0x3265 runnable
"GC task thread#4 (ParallelGC)" prio=10 tid=0xf6716400 nid=0x3266 runnable
"GC task thread#5 (ParallelGC)" prio=10 tid=0xf6717800 nid=0x3267 runnable
"GC task thread#6 (ParallelGC)" prio=10 tid=0xf6719000 nid=0x3268 runnable
"GC task thread#7 (ParallelGC)" prio=10 tid=0xf671a800 nid=0x3269 runnable
"GC task thread#8 (ParallelGC)" prio=10 tid=0xf671c000 nid=0x326a runnable
"GC task thread#9 (ParallelGC)" prio=10 tid=0xf671d400 nid=0x326b runnable
"GC task thread#10 (ParallelGC)" prio=10 tid=0xf671ec00 nid=0x326c runnable
"GC task thread#11 (ParallelGC)" prio=10 tid=0xf6720400 nid=0x326d runnable
"GC task thread#12 (ParallelGC)" prio=10 tid=0xf6721800 nid=0x326e runnable
"VM Periodic Task Thread" prio=10 tid=0xaa8f9000 nid=0x3276 waiting on
condition
JNI global references: 265
+ echo '************ END zombies jstack extract'
************ END zombies jstack extract
+ JIRA_COMMENT='
{color:red}-1 core zombie tests{color}. There are 2 zombie test(s):
at
org.apache.camel.component.jpa.JpaWithNamedQueryTest.testProducerInsertsIntoDatabaseThenConsumerFiresMessageExchange(JpaWithNamedQueryTest.java:112)
at
org.apache.camel.component.jpa.JpaWithNamedQueryTest.testProducerInsertsIntoDatabaseThenConsumerFiresMessageExchange(JpaWithNamedQueryTest.java:112)
at
org.apache.camel.component.mail.MimeMessageConsumeTest.testSendAndReceiveMails(MimeMessageConsumeTest.java:69)'
+ BAD=1
+ jps
+ grep surefirebooter
+ cut -d ' ' -f 1
+ xargs kill -9
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Archiving artifacts
Sending artifact delta relative to HBase-1.0 #138
Archived 1806 artifacts
Archive block size is 32768
Received 72 blocks and 671380609 bytes
Compression is 0.4%
Took 4 min 8 sec
Recording test results
Updating HBASE-11726