Spark Streaming 1.3.0 on YARN during Job Execution keeps generating the following error while the application is running:
ERROR LiveListenerBus: Listener EventLoggingListener threw an exception java.lang.reflect.InvocationTargetException etc etc Caused by: java.io.IOException: Filesystem closed at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794) This exception does NOT make the streaming job fail. Secondly, the streaming job does NOT perform ANY operations with HDFS and is really a basic streaming job to test a new Spark 1.3.0 deployment on CDH 5.4 The above exception is thrown by the Spark framework itself. I have seen some posts related to that exception which are about Spark Batch and confirmed as bug in spark which however is not critical. And btw this error appears well before any attempted stop of the spark streaming context and hence is not related to trying to stop the context Does anybody know how to get rid off this in Spark Streaming 1.3.0 on YARN on CDH 5.4 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-1-3-0-ERROR-LiveListenerBus-tp23411.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
