David, Apache mailing list doesn't seem to allow large attachments. Could you attach the stacktrace to the jira KAFKA-1533 (now reopened)?
Thanks, Jun On Sun, Jul 27, 2014 at 11:21 AM, David Corley <davidcor...@gmail.com> wrote: > Nope. It definitely sent. Are there some restrictions on mailing list > attachments I wonder? > I'll put it inline here: > ================================================================= > 2014-07-25 18:40:15 > Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.65-b04-462 mixed > mode): > > "Attach Listener" daemon prio=9 tid=7fcfb92a5000 nid=0x11a961000 waiting on > condition [00000000] > java.lang.Thread.State: RUNNABLE > > "kafka-scheduler-17" daemon prio=5 tid=7fcfbb80c000 nid=0x1387c3000 waiting > on condition [1387c2000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53b84d8> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "ReplicaFetcherThread-0-0" prio=5 tid=7fcfbb80b000 nid=0x1385bd000 runnable > [1385bb000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f53b7578> (a sun.nio.ch.Util$2) > - locked <7f53b7560> (a java.util.Collections$UnmodifiableSet) > - locked <7f5400668> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at sun.nio.ch.SocketAdaptor$SocketInputStream.read(SocketAdaptor.java:193) > - locked <7f53b7590> (a java.lang.Object) > at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:86) > - locked <7f5405530> (a sun.nio.ch.SocketAdaptor$SocketInputStream) > at > java.nio.channels.Channels$ReadableByteChannelImpl.read(Channels.java:221) > - locked <7f5407fc0> (a java.lang.Object) > at kafka.utils.Utils$.read(Utils.scala:380) > at > > kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54) > at kafka.network.Receive$class.readCompletely(Transmission.scala:56) > at > > kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29) > at kafka.network.BlockingChannel.receive(BlockingChannel.scala:108) > at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:71) > at > > kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:68) > - locked <7f5407ff0> (a java.lang.Object) > at > > kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SimpleConsumer.scala:112) > at > > kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:112) > at > > kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:112) > at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) > at > > kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply$mcV$sp(SimpleConsumer.scala:111) > at > > kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:111) > at > > kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:111) > at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) > at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:110) > at > > kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:96) > at > kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:88) > at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60) > > "Controller-0-to-broker-1-send-thread" prio=5 tid=7fcfbb809800 > nid=0x1384ba000 waiting on condition [1384b9000] > java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53eba88> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) > at > java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) > at > > kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:121) > at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60) > > "kafka-scheduler-16" daemon prio=5 tid=7fcfbb809000 nid=0x1383b7000 waiting > on condition [1383b6000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53b84d8> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-7" daemon prio=5 tid=7fcfbb808000 nid=0x1256b4000 > waiting on condition [1256b3000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53eef70> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-6" daemon prio=5 tid=7fcfbbbaf000 nid=0x1255b1000 > waiting on condition [1255b0000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53eef70> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-5" daemon prio=5 tid=7fcfbbbae000 nid=0x1254ae000 > waiting on condition [1254ad000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53eef70> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-4" daemon prio=5 tid=7fcfbb54b800 nid=0x1235ab000 > waiting on condition [1235aa000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53eef70> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-3" daemon prio=5 tid=7fcfb7089000 nid=0x1216a8000 > waiting on condition [1216a7000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53eef70> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-2" daemon prio=5 tid=7fcfbbbad800 nid=0x1215a5000 > waiting on condition [1215a4000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53eef70> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-1" daemon prio=5 tid=7fcfbbbac800 nid=0x120aa2000 > waiting on condition [120aa1000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53eef70> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-0" daemon prio=5 tid=7fcfb985e000 nid=0x11ed2f000 > waiting on condition [11ed2e000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53eef70> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "request-expiration-task" prio=5 tid=7fcfbc420800 nid=0x11e820000 waiting > on condition [11e81f000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53eefb8> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.poll(DelayQueue.java:201) > at > > kafka.server.RequestPurgatory$ExpiredRequestReaper.pollExpired(RequestPurgatory.scala:256) > at > > kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:212) > at java.lang.Thread.run(Thread.java:695) > > "request-expiration-task" prio=5 tid=7fcfbc41a800 nid=0x11c7c1000 waiting > on condition [11c7c0000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53eed00> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.poll(DelayQueue.java:201) > at > > kafka.server.RequestPurgatory$ExpiredRequestReaper.pollExpired(RequestPurgatory.scala:256) > at > > kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:212) > at java.lang.Thread.run(Thread.java:695) > > "kafka-scheduler-15" daemon prio=5 tid=7fcfbc41a000 nid=0x11c6be000 waiting > on condition [11c6bd000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53b84d8> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "kafka-socket-acceptor" prio=5 tid=7fcfb7009800 nid=0x11c5bb000 runnable > [11c5ba000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f53ef018> (a sun.nio.ch.Util$2) > - locked <7f53ef000> (a java.util.Collections$UnmodifiableSet) > - locked <7f53f05a0> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at kafka.network.Acceptor.run(SocketServer.scala:196) > at java.lang.Thread.run(Thread.java:695) > > "kafka-network-thread-61617-2" prio=5 tid=7fcfbbbaa800 nid=0x11c4b8000 > runnable [11c4b7000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f53eee38> (a sun.nio.ch.Util$2) > - locked <7f53eee20> (a java.util.Collections$UnmodifiableSet) > - locked <7f53d0998> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at kafka.network.Processor.run(SocketServer.scala:296) > at java.lang.Thread.run(Thread.java:695) > > "kafka-network-thread-61617-1" prio=5 tid=7fcfbb54b000 nid=0x11c2b2000 > runnable [11c2b1000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f53eed60> (a sun.nio.ch.Util$2) > - locked <7f53eed48> (a java.util.Collections$UnmodifiableSet) > - locked <7f53d3f08> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at kafka.network.Processor.run(SocketServer.scala:296) > at java.lang.Thread.run(Thread.java:695) > > "kafka-network-thread-61617-0" prio=5 tid=7fcfbb546000 nid=0x11c1af000 > runnable [11c1ae000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f53eb248> (a sun.nio.ch.Util$2) > - locked <7f53eb230> (a java.util.Collections$UnmodifiableSet) > - locked <7f53e8cd0> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at kafka.network.Processor.run(SocketServer.scala:296) > at java.lang.Thread.run(Thread.java:695) > > "Controller-0-to-broker-0-send-thread" prio=5 tid=7fcfbc420000 > nid=0x11c0ac000 waiting on condition [11c0ab000] > java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53eb0b0> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) > at > java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) > at > > kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:121) > at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60) > > "kafka-scheduler-14" daemon prio=5 tid=7fcfb929c000 nid=0x11bfa9000 waiting > on condition [11bfa8000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53b84d8> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "kafka-scheduler-13" daemon prio=5 tid=7fcfb3093000 nid=0x11b37f000 waiting > on condition [11b37e000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53b84d8> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "kafka-scheduler-12" daemon prio=5 tid=7fcfbb17e000 nid=0x11b076000 waiting > on condition [11b075000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53b84d8> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "Test worker-EventThread" daemon prio=5 tid=7fcfb929b800 nid=0x11a75b000 > waiting on condition [11a75a000] > java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53e1410> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) > at > java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:503) > > "Test worker-SendThread(localhost:59130)" daemon prio=5 tid=7fcfbb46b000 > nid=0x119a11000 runnable [119a10000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f53d0d58> (a sun.nio.ch.Util$2) > - locked <7f53b85f8> (a java.util.Collections$UnmodifiableSet) > - locked <7f53caa40> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1134) > > "ZkClient-EventThread-2842-127.0.0.1:59130" daemon prio=5 tid=7fcfbbba8000 > nid=0x119611000 waiting on condition [119610000] > java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53eae10> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) > at > java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) > at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:67) > > "kafka-scheduler-17" daemon prio=5 tid=7fcfbb47a000 nid=0x1386c0000 waiting > on condition [1386bf000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6dd8> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "kafka-scheduler-16" daemon prio=5 tid=7fcfbbba7800 nid=0x12099f000 waiting > on condition [12099e000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6dd8> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-7" daemon prio=5 tid=7fcfb31cd000 nid=0x12089c000 > waiting on condition [12089b000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6d18> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-6" daemon prio=5 tid=7fcfbc419000 nid=0x11fd21000 > waiting on condition [11fd20000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6d18> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-5" daemon prio=5 tid=7fcfbbba6800 nid=0x11fc1e000 > waiting on condition [11fc1d000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6d18> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-4" daemon prio=5 tid=7fcfbc418800 nid=0x11f038000 > waiting on condition [11f037000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6d18> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-3" daemon prio=5 tid=7fcfb3150800 nid=0x11ef35000 > waiting on condition [11ef34000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6d18> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-2" daemon prio=5 tid=7fcfbc41b800 nid=0x11ee32000 > waiting on condition [11ee31000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6d18> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-1" daemon prio=5 tid=7fcfbbba1000 nid=0x11ea26000 > waiting on condition [11ea25000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6d18> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "kafka-request-handler-0" daemon prio=5 tid=7fcfbbba0800 nid=0x11c3b5000 > waiting on condition [11c3b4000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6d18> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at > java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347) > at kafka.network.RequestChannel.receiveRequest(RequestChannel.scala:161) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:47) > at java.lang.Thread.run(Thread.java:695) > > "request-expiration-task" prio=5 tid=7fcfb30ec000 nid=0x11b4a6000 waiting > on condition [11b4a5000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53db648> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.poll(DelayQueue.java:209) > at > > kafka.server.RequestPurgatory$ExpiredRequestReaper.pollExpired(RequestPurgatory.scala:256) > at > > kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:212) > at java.lang.Thread.run(Thread.java:695) > > "request-expiration-task" prio=5 tid=7fcfb3152800 nid=0x11b27c000 waiting > on condition [11b27b000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53db6f0> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.poll(DelayQueue.java:201) > at > > kafka.server.RequestPurgatory$ExpiredRequestReaper.pollExpired(RequestPurgatory.scala:256) > at > > kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:212) > at java.lang.Thread.run(Thread.java:695) > > "kafka-scheduler-15" daemon prio=5 tid=7fcfbbba2800 nid=0x11b179000 waiting > on condition [11b178000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6dd8> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "kafka-socket-acceptor" prio=5 tid=7fcfbbba2000 nid=0x11af73000 runnable > [11af72000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f53d8c00> (a sun.nio.ch.Util$2) > - locked <7f53d8be8> (a java.util.Collections$UnmodifiableSet) > - locked <7f53b8388> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at kafka.network.Acceptor.run(SocketServer.scala:196) > at java.lang.Thread.run(Thread.java:695) > > "kafka-network-thread-61616-2" prio=5 tid=7fcfb986a800 nid=0x11ae70000 > runnable [11ae6f000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f53b8f70> (a sun.nio.ch.Util$2) > - locked <7f53b8f58> (a java.util.Collections$UnmodifiableSet) > - locked <7f53d9080> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at kafka.network.Processor.run(SocketServer.scala:296) > at java.lang.Thread.run(Thread.java:695) > > "kafka-network-thread-61616-1" prio=5 tid=7fcfb3074000 nid=0x11ad6d000 > runnable [11ad6c000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f53db750> (a sun.nio.ch.Util$2) > - locked <7f53db738> (a java.util.Collections$UnmodifiableSet) > - locked <7f53cac38> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at kafka.network.Processor.run(SocketServer.scala:296) > at java.lang.Thread.run(Thread.java:695) > > "kafka-network-thread-61616-0" prio=5 tid=7fcfb9861000 nid=0x11ac6a000 > runnable [11ac69000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f53b9558> (a sun.nio.ch.Util$2) > - locked <7f53b9540> (a java.util.Collections$UnmodifiableSet) > - locked <7f53b8fa0> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at kafka.network.Processor.run(SocketServer.scala:296) > at java.lang.Thread.run(Thread.java:695) > > "kafka-scheduler-14" daemon prio=5 tid=7fcfbb17b800 nid=0x11ab67000 waiting > on condition [11ab66000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6dd8> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "kafka-scheduler-13" daemon prio=5 tid=7fcfb9864000 nid=0x11aa64000 waiting > on condition [11aa63000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6dd8> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "kafka-scheduler-12" daemon prio=5 tid=7fcfbb113800 nid=0x11a85e000 waiting > on condition [11a85d000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53a6dd8> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "Test worker-EventThread" daemon prio=5 tid=7fcfbb469800 nid=0x11a658000 > waiting on condition [11a657000] > java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53b67b0> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) > at > java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:503) > > "Test worker-SendThread(localhost:59130)" daemon prio=5 tid=7fcfbb466000 > nid=0x119b55000 runnable [119b54000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f53b66d8> (a sun.nio.ch.Util$2) > - locked <7f53a6d48> (a java.util.Collections$UnmodifiableSet) > - locked <7f53967c0> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1134) > > "ZkClient-EventThread-2816-127.0.0.1:59130" daemon prio=5 tid=7fcfbb545000 > nid=0x11950e000 waiting on condition [11950d000] > java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f53b6db0> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) > at > java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) > at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:67) > > "daemon-producer" prio=5 tid=7fcfbb114800 nid=0x119205000 in Object.wait() > [119204000] > java.lang.Thread.State: TIMED_WAITING (on object monitor) > at java.lang.Object.wait(Native Method) > - waiting on <7f5356080> (a > org.apache.kafka.clients.producer.internals.Metadata) > at > > org.apache.kafka.clients.producer.internals.Metadata.awaitUpdate(Metadata.java:107) > - locked <7f5356080> (a > org.apache.kafka.clients.producer.internals.Metadata) > at > > org.apache.kafka.clients.producer.KafkaProducer.waitOnMetadata(KafkaProducer.java:277) > at > > org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:231) > at > > org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:164) > at > > kafka.api.ProducerFailureHandlingTest$ProducerScheduler$$anonfun$3.apply(ProducerFailureHandlingTest.scala:309) > at > > kafka.api.ProducerFailureHandlingTest$ProducerScheduler$$anonfun$3.apply(ProducerFailureHandlingTest.scala:308) > at > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > at > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > at scala.collection.immutable.Range$ByOne$class.foreach(Range.scala:282) > at scala.collection.immutable.Range$$anon$1.foreach(Range.scala:274) > at scala.collection.TraversableLike$class.map(TraversableLike.scala:206) > at scala.collection.immutable.Range.map(Range.scala:39) > at > > kafka.api.ProducerFailureHandlingTest$ProducerScheduler.doWork(ProducerFailureHandlingTest.scala:308) > at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60) > > "kafka-producer-network-thread" daemon prio=5 tid=7fcfb48f7800 > nid=0x118deb000 runnable [118dea000] > java.lang.Thread.State: RUNNABLE > at org.apache.kafka.common.metrics.Sensor.record(Sensor.java:93) > - locked <7f53363a8> (a org.apache.kafka.common.metrics.Sensor) > at org.apache.kafka.common.network.Selector.poll(Selector.java:213) > at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:178) > at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:175) > at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:115) > at java.lang.Thread.run(Thread.java:695) > > "kafka-producer-network-thread" daemon prio=5 tid=7fcfb6079000 > nid=0x11ec2c000 runnable [11ec2b000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f535fb88> (a sun.nio.ch.Util$2) > - locked <7f535fb70> (a java.util.Collections$UnmodifiableSet) > - locked <7f535a6a0> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at org.apache.kafka.common.network.Selector.select(Selector.java:317) > at org.apache.kafka.common.network.Selector.poll(Selector.java:211) > at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:178) > at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:175) > at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:115) > at java.lang.Thread.run(Thread.java:695) > > "kafka-producer-network-thread" daemon prio=5 tid=7fcfb6078000 > nid=0x11eb29000 runnable [11eb28000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f5365078> (a sun.nio.ch.Util$2) > - locked <7f5365060> (a java.util.Collections$UnmodifiableSet) > - locked <7f5326cf8> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at org.apache.kafka.common.network.Selector.select(Selector.java:317) > at org.apache.kafka.common.network.Selector.poll(Selector.java:211) > at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:178) > at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:175) > at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:115) > at java.lang.Thread.run(Thread.java:695) > > "kafka-producer-network-thread" daemon prio=5 tid=7fcfb632f000 > nid=0x11e923000 runnable [11e922000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f5360338> (a sun.nio.ch.Util$2) > - locked <7f5363598> (a java.util.Collections$UnmodifiableSet) > - locked <7f534a398> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at org.apache.kafka.common.network.Selector.select(Selector.java:317) > at org.apache.kafka.common.network.Selector.poll(Selector.java:211) > at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:178) > at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:175) > at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:115) > at java.lang.Thread.run(Thread.java:695) > > "Test worker-EventThread" daemon prio=5 tid=7fcfb60ba800 nid=0x11940b000 > waiting on condition [11940a000] > java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f5322a30> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) > at > java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:503) > > "Test worker-SendThread(localhost:59130)" daemon prio=5 tid=7fcfb6324000 > nid=0x119308000 runnable [119307000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f52e47b8> (a sun.nio.ch.Util$2) > - locked <7f52e47a0> (a java.util.Collections$UnmodifiableSet) > - locked <7f5327bf8> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1134) > > "ZkClient-EventThread-2707-127.0.0.1:59130" daemon prio=5 tid=7fcfb9003800 > nid=0x119102000 waiting on condition [119101000] > java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f530df88> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) > at > java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) > at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:67) > > "ProcessThread:-1" prio=5 tid=7fcfbb113000 nid=0x118f0e000 waiting on > condition [118f0d000] > java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f531ed58> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) > at > java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) > at > > org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:104) > > "SyncThread:0" prio=5 tid=7fcfbb467800 nid=0x118ce8000 waiting on condition > [118ce7000] > java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f5321410> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) > at > java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) > at > > org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:94) > > "SessionTracker" prio=5 tid=7fcfb985c000 nid=0x118be5000 in Object.wait() > [118be4000] > java.lang.Thread.State: TIMED_WAITING (on object monitor) > at java.lang.Object.wait(Native Method) > - waiting on <7f5325578> (a > org.apache.zookeeper.server.SessionTrackerImpl) > at > > org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:145) > - locked <7f5325578> (a org.apache.zookeeper.server.SessionTrackerImpl) > > "NIOServerCxn.Factory:/127.0.0.1:59130" daemon prio=5 tid=7fcfb647a000 > nid=0x114467000 runnable [114466000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f5322958> (a sun.nio.ch.Util$2) > - locked <7f5322940> (a java.util.Collections$UnmodifiableSet) > - locked <7f530e378> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at > > org.apache.zookeeper.server.NIOServerCnxn$Factory.run(NIOServerCnxn.java:232) > > "kafka-producer-network-thread" daemon prio=5 tid=7fcfbb55b000 > nid=0x11e71d000 runnable [11e71c000] > java.lang.Thread.State: RUNNABLE > at org.apache.kafka.common.metrics.Sensor.record(Sensor.java:93) > - locked <7f51f7a28> (a org.apache.kafka.common.metrics.Sensor) > at org.apache.kafka.common.network.Selector.poll(Selector.java:213) > at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:178) > at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:175) > at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:115) > at java.lang.Thread.run(Thread.java:695) > > "metrics-meter-tick-thread-2" daemon prio=5 tid=7fcfb89f9000 > nid=0x11990e000 waiting on condition [11990d000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f4564b88> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "metrics-meter-tick-thread-1" daemon prio=5 tid=7fcfb615c800 > nid=0x11980b000 waiting on condition [11980a000] > java.lang.Thread.State: TIMED_WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f4564b88> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) > at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) > at > > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) > at > > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917) > at java.lang.Thread.run(Thread.java:695) > > "AWT-AppKit" daemon prio=5 tid=7fcfb89b3800 nid=0x7fff7da27310 runnable > [00000000] > java.lang.Thread.State: RUNNABLE > > "Test worker" prio=5 tid=7fcfb89b2800 nid=0x113ed0000 waiting on condition > [113ecd000] > java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f5358b68> (a > java.util.concurrent.CountDownLatch$Sync) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281) > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:207) > at > kafka.utils.ShutdownableThread.awaitShutdown(ShutdownableThread.scala:50) > at kafka.utils.ShutdownableThread.shutdown(ShutdownableThread.scala:32) > at > > kafka.api.ProducerFailureHandlingTest$ProducerScheduler.shutdown(ProducerFailureHandlingTest.scala:321) > at > > kafka.api.ProducerFailureHandlingTest.testBrokerFailure(ProducerFailureHandlingTest.scala:276) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at junit.framework.TestCase.runTest(TestCase.java:164) > at junit.framework.TestCase.runBare(TestCase.java:130) > at junit.framework.TestResult$1.protect(TestResult.java:110) > at junit.framework.TestResult.runProtected(TestResult.java:128) > at junit.framework.TestResult.run(TestResult.java:113) > at junit.framework.TestCase.run(TestCase.java:120) > at junit.framework.TestSuite.runTest(TestSuite.java:228) > at junit.framework.TestSuite.run(TestSuite.java:223) > at > > org.junit.internal.runners.OldTestClassRunner.run(OldTestClassRunner.java:35) > at > > org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80) > at > > org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47) > at > > org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69) > at > > org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > > org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35) > at > > org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24) > at > > org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32) > at > > org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93) > at com.sun.proxy.$Proxy2.processTestClass(Unknown Source) > at > > org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > > org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35) > at > > org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24) > at > > org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355) > at > > org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) > at java.lang.Thread.run(Thread.java:695) > > "socket connection at /0:0:0:0:0:0:0:1%0:59127 with /0:0:0:0:0:0:0:1:59126 > workers Thread 2" prio=5 tid=7fcfb89b0000 nid=0x113dcd000 runnable > [113dcc000] > java.lang.Thread.State: RUNNABLE > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) > - locked <7f44e7120> (a sun.nio.ch.Util$2) > - locked <7f44e7138> (a java.util.Collections$UnmodifiableSet) > - locked <7f44e6ca0> (a sun.nio.ch.KQueueSelectorImpl) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84) > at > > org.gradle.messaging.remote.internal.inet.SocketConnection$SocketInputStream.read(SocketConnection.java:158) > at com.esotericsoftware.kryo.io.Input.fill(Input.java:139) > at com.esotericsoftware.kryo.io.Input.require(Input.java:159) > at com.esotericsoftware.kryo.io.Input.readByte(Input.java:255) > at > > org.gradle.messaging.remote.internal.hub.InterHubMessageSerializer$MessageReader.read(InterHubMessageSerializer.java:64) > at > > org.gradle.messaging.remote.internal.hub.InterHubMessageSerializer$MessageReader.read(InterHubMessageSerializer.java:53) > at > > org.gradle.messaging.remote.internal.inet.SocketConnection.receive(SocketConnection.java:83) > at > > org.gradle.messaging.remote.internal.hub.MessageHub$ConnectionReceive.run(MessageHub.java:230) > at > > org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) > at java.lang.Thread.run(Thread.java:695) > > "socket connection at /0:0:0:0:0:0:0:1%0:59127 with /0:0:0:0:0:0:0:1:59126 > workers" prio=5 tid=7fcfb89af000 nid=0x113cca000 waiting on condition > [113cc9000] > java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f4555300> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) > at > > org.gradle.messaging.remote.internal.hub.queue.EndPointQueue.take(EndPointQueue.java:49) > at > > org.gradle.messaging.remote.internal.hub.MessageHub$ConnectionDispatch.run(MessageHub.java:273) > at > > org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) > at java.lang.Thread.run(Thread.java:695) > > "Low Memory Detector" daemon prio=5 tid=7fcfb700a800 nid=0x1135c9000 > runnable [00000000] > java.lang.Thread.State: RUNNABLE > > "C2 CompilerThread1" daemon prio=9 tid=7fcfb4955000 nid=0x1134c6000 waiting > on condition [00000000] > java.lang.Thread.State: RUNNABLE > > "C2 CompilerThread0" daemon prio=9 tid=7fcfb881d000 nid=0x1133c3000 waiting > on condition [00000000] > java.lang.Thread.State: RUNNABLE > > "Signal Dispatcher" daemon prio=9 tid=7fcfb881c000 nid=0x1132c0000 runnable > [00000000] > java.lang.Thread.State: RUNNABLE > > "Surrogate Locker Thread (Concurrent GC)" daemon prio=5 tid=7fcfb881b800 > nid=0x1131bd000 waiting on condition [00000000] > java.lang.Thread.State: RUNNABLE > > "Finalizer" daemon prio=8 tid=7fcfb4934000 nid=0x112f5e000 in Object.wait() > [112f5d000] > java.lang.Thread.State: WAITING (on object monitor) > at java.lang.Object.wait(Native Method) > - waiting on <7f44e4f70> (a java.lang.ref.ReferenceQueue$Lock) > at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118) > - locked <7f44e4f70> (a java.lang.ref.ReferenceQueue$Lock) > at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134) > at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:171) > > "Reference Handler" daemon prio=10 tid=7fcfb3008800 nid=0x112e5b000 in > Object.wait() [112e5a000] > java.lang.Thread.State: WAITING (on object monitor) > at java.lang.Object.wait(Native Method) > - waiting on <7f44e13f8> (a java.lang.ref.Reference$Lock) > at java.lang.Object.wait(Object.java:485) > at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116) > - locked <7f44e13f8> (a java.lang.ref.Reference$Lock) > > "main" prio=5 tid=7fcfb7000800 nid=0x10a051000 waiting on condition > [10a050000] > java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <7f4563650> (a > java.util.concurrent.CountDownLatch$Sync) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:969) > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1281) > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:207) > at > > org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:68) > at > > org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:44) > at > > org.gradle.process.internal.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:78) > at > > org.gradle.process.internal.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:35) > at > > org.gradle.process.internal.child.ImplementationClassLoaderWorker.execute(ImplementationClassLoaderWorker.java:81) > at > > org.gradle.process.internal.child.ImplementationClassLoaderWorker.execute(ImplementationClassLoaderWorker.java:37) > at > > org.gradle.process.internal.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:43) > at > > org.gradle.process.internal.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:32) > at > > org.gradle.process.internal.launcher.BootstrapClassLoaderWorker.call(BootstrapClassLoaderWorker.java:46) > at > > org.gradle.process.internal.launcher.BootstrapClassLoaderWorker.call(BootstrapClassLoaderWorker.java:32) > at > > jarjar.org.gradle.process.internal.launcher.GradleWorkerMain.run(GradleWorkerMain.java:32) > at > > jarjar.org.gradle.process.internal.launcher.GradleWorkerMain.main(GradleWorkerMain.java:37) > > "VM Thread" prio=9 tid=7fcfb4933800 nid=0x112d58000 runnable > > "Gang worker#0 (Parallel GC Threads)" prio=9 tid=7fcfb6000800 > nid=0x10e405000 runnable > > "Gang worker#1 (Parallel GC Threads)" prio=9 tid=7fcfb3000800 > nid=0x10e508000 runnable > > "Gang worker#2 (Parallel GC Threads)" prio=9 tid=7fcfb4800800 > nid=0x10e60b000 runnable > > "Gang worker#3 (Parallel GC Threads)" prio=9 tid=7fcfb7002000 > nid=0x10e70e000 runnable > > "Gang worker#4 (Parallel GC Threads)" prio=9 tid=7fcfb4801000 > nid=0x10e811000 runnable > > "Gang worker#5 (Parallel GC Threads)" prio=9 tid=7fcfb3001000 > nid=0x10e914000 runnable > > "Gang worker#6 (Parallel GC Threads)" prio=9 tid=7fcfb3002000 > nid=0x10ea17000 runnable > > "Gang worker#7 (Parallel GC Threads)" prio=9 tid=7fcfb3002800 > nid=0x10eb1a000 runnable > > "Concurrent Mark-Sweep GC Thread" prio=9 tid=7fcfb3003800 nid=0x1129d9000 > runnable > "Gang worker#0 (Parallel CMS Threads)" prio=9 tid=7fcfb48dd800 > nid=0x111fd3000 runnable > > "Gang worker#1 (Parallel CMS Threads)" prio=9 tid=7fcfb3003000 > nid=0x1120d6000 runnable > > "VM Periodic Task Thread" prio=10 tid=7fcfb7014000 nid=0x1136cc000 waiting > on condition > > "Exception Catcher Thread" prio=10 tid=7fcfb7001800 nid=0x10b301000 > runnable > JNI global references: 1042 > > ================================================================================================ > > > On Fri, Jul 25, 2014 at 6:55 PM, Guozhang Wang <wangg...@gmail.com> wrote: > > > Did you miss the attachment? > > > > > > On Fri, Jul 25, 2014 at 10:44 AM, David Corley <davidcor...@gmail.com> > > wrote: > > > > > Sure. Attaching here. > > > > > > > > > > > > On Fri, Jul 25, 2014 at 4:16 PM, Guozhang Wang <wangg...@gmail.com> > > wrote: > > > > > >> Could you get a thread dump when it hangs? > > >> > > >> > > >> On Thu, Jul 24, 2014 at 11:01 PM, David Corley <davidcor...@gmail.com > > > > >> wrote: > > >> > > >> > Hey Gouzhang, > > >> > Yes, I spotted that commit and had updated my working copy to that, > > but > > >> the > > >> > test is still hanging. If it's any help, the test looks like it's > > doing > > >> > _something_ as the CPU usage ramps up significantly and stays there > > >> until > > >> > I kill the process. > > >> > /Dave > > >> > > > >> > > > >> > On Thu, Jul 24, 2014 at 4:10 PM, Guozhang Wang <wangg...@gmail.com> > > >> wrote: > > >> > > > >> > > Hi Dave, > > >> > > > > >> > > KAFKA-1533 has just been committed targeting at this issue. Did > your > > >> > update > > >> > > on trunk include this commit? > > >> > > > > >> > > commit ff05e9b3616a222e29a42f6e8fdf41945a417f41 > > >> > > Author: Guozhang Wang <guw...@linkedin.com> > > >> > > Date: Tue Jul 22 14:14:19 2014 -0700 > > >> > > > > >> > > Guozhang > > >> > > > > >> > > kafka-1533; transient unit test failure in > > >> > ProducerFailureHandlingTest; > > >> > > reviewed by Guozhang Wang; reviewed by Jun Rao > > >> > > > > >> > > > > >> > > > > >> > > > > >> > > On Thu, Jul 24, 2014 at 5:52 AM, David Corley < > > davidcor...@gmail.com> > > >> > > wrote: > > >> > > > > >> > > > Hey all, > > >> > > > I'm trying my hand at writing some patches for open issues, but > > I'm > > >> > > running > > >> > > > into issues with running gradlew test. > > >> > > > It hangs every time when trying to run testBrokerFailure in the > > >> > > > ProducerFailureHangingTest suite. > > >> > > > > > >> > > > It was working for a time, but I updated to trunk HEAD and it's > no > > >> > longer > > >> > > > working. > > >> > > > I'm running on OSX with JDK 1.6.0_65. > > >> > > > I tried increasing the HeapSize for the test target, but hit the > > >> same > > >> > > > issue. > > >> > > > Running against 3f1a9c4cee778d089d3ec3167555c2b89cdc48bb > > >> > > > > > >> > > > Would appreciate any help. > > >> > > > Regards, > > >> > > > Dave > > >> > > > > > >> > > > > >> > > > > >> > > > > >> > > -- > > >> > > -- Guozhang > > >> > > > > >> > > > >> > > >> > > >> > > >> -- > > >> -- Guozhang > > >> > > > > > > > > > > > > -- > > -- Guozhang > > >
