Srinivasarao Daruna created ZEPPELIN-4128:
---------------------------------------------

             Summary: Zeppelin - unable to stop spark streaming query when 
awaitTermination is used.
                 Key: ZEPPELIN-4128
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4128
             Project: Zeppelin
          Issue Type: Bug
    Affects Versions: 0.8.1
            Reporter: Srinivasarao Daruna


When basic spark streaming  example with zeppelin  is executed, its not been 
possible to stop the paragraph once its started.

cancel/stop the paragraph is not stopping the execution.

Sample code executed in zeppelin paragraph:

import org.apache.spark.sql.functions._
import org.apache.spark.sql.SparkSession

val spark = 
SparkSession.builder.appName("StructuredNetworkWordCount").getOrCreate()
 
import spark.implicits._

val lines = spark.readStream.format("socket").option("host", 
"localhost").option("port", 9999).load()

// Split the lines into words
val words = lines.as[String].flatMap(_.split(" "))

// Generate running word count
val wordCounts = words.groupBy("value").count()

val query = 
wordCounts.writeStream.outputMode("complete").format("console").start()

query.awaitTermination()

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to