varun sharma created SPARK-4276:
-----------------------------------
Summary: Spark streaming requires at least two working thread
Key: SPARK-4276
URL: https://issues.apache.org/jira/browse/SPARK-4276
Project: Spark
Issue Type: Bug
Components: Streaming
Affects Versions: 1.1.0
Reporter: varun sharma
Fix For: 1.1.0
Spark streaming requires at least two working threads.But example in
spark/examples/src/main/scala/org/apache/spark/examples/streaming/NetworkWordCount.scala
has
// Create the context with a 1 second batch size
val sparkConf = new SparkConf().setAppName("NetworkWordCount")
val ssc = new StreamingContext(sparkConf, Seconds(1))
which creates only 1 thread.
It should have atleast 2 threads:
http://spark.apache.org/docs/latest/streaming-programming-guide.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
