Hi all, We are getting the following exception and this somehow blocks the parent thread from proceeding further.
17/11/14 16:50:09 SPARK_APP WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/11/14 16:50:17 SPARK_APP WARN SparkContext: Use an existing SparkContext, some configuration may not take effect. [Stage 4:> (13 + 1) / 200][Stage 5:> (1 + 0) / 8][Stage 8:> (0 + 0) / 8]Exception in thread "Shutdown-checker" java.lang.RuntimeException: eventfd_write() failed: Bad file descriptor at io.netty.channel.epoll.Native.eventFdWrite(Native Method) at io.netty.channel.epoll.EpollEventLoop.wakeup(EpollEventLoop.java:106) at io.netty.util.concurrent.SingleThreadEventExecutor.shutdownGracefully(SingleThreadEventExecutor.java:538) at io.netty.util.concurrent.MultithreadEventExecutorGroup.shutdownGracefully(MultithreadEventExecutorGroup.java:146) at io.netty.util.concurrent.AbstractEventExecutorGroup.shutdownGracefully(AbstractEventExecutorGroup.java:69) at com.datastax.driver.core.NettyOptions.onClusterClose(NettyOptions.java:193) at com.datastax.driver.core.Connection$Factory.shutdown(Connection.java:902) at com.datastax.driver.core.Cluster$Manager$ClusterCloseFuture$1.run(Cluster.java:2539) This is very hard to replicate, so I am not able to come up with a re-produceable recipe. Has anyone faced similar issue? Any help is appreciated. Spark Version: 2.0.1 Thanks and Regards Noorul