Hye Rachana, could you provide the full jstack outputs? Maybe it's same as https://issues.apache.org/jira/browse/SPARK-11104
Best Regards, Shixiong Zhu 2016-01-04 12:56 GMT-08:00 Rachana Srivastava < rachana.srivast...@markmonitor.com>: > Hello All, > > > > I am running my application on Spark cluster but under heavy load the > system is hung due to deadlock. I found similar issues resolved here > https://datastax-oss.atlassian.net/browse/JAVA-555 in Spark version > 2.1.3. But I am running on Spark 1.3 still getting the same issue. > > > > Here is the stack trace for reference: > > > > sun.misc.Unsafe.park(Native Method) > > java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) > > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) > > > org.apache.spark.streaming.ContextWaiter.waitForStopOrError(ContextWaiter.scala:63) > > > org.apache.spark.streaming.StreamingContext.awaitTermination(StreamingContext.scala:521) > > > org.apache.spark.streaming.api.java.JavaStreamingContext.awaitTermination(JavaStreamingContext.scala:592) > > > > sun.misc.Unsafe.park(Native Method) > > java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) > > > java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) > > > java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) > > > java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) > > java.util.concurrent.Semaphore.acquire(Semaphore.java:317) > > > org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:62) > > > org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply(AsynchronousListenerBus.scala:61) > > > org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply(AsynchronousListenerBus.scala:61) > > org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1617) > > > org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:60) > > > > sun.misc.Unsafe.park(Native Method) > > java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) > > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) > > > org.spark-project.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342) > > > org.spark-project.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526) > > > org.spark-project.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44) > > > org.spark-project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) > > java.lang.Thread.run(Thread.java:745) > > > > > > Thanks, > > > > Rachana > > >