[
https://issues.apache.org/jira/browse/SPARK-4276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200571#comment-14200571
]
varun sharma commented on SPARK-4276:
-------------------------------------
[~srowen] Yeah right. I spent lot of time to figure this out as example in repo
and in documentation are different.
I now understood the concept of resource starvation here.
Thanks for pointing it out and sorry for the inconvenience.
> Spark streaming requires at least two working thread
> ----------------------------------------------------
>
> Key: SPARK-4276
> URL: https://issues.apache.org/jira/browse/SPARK-4276
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Affects Versions: 1.1.0
> Reporter: varun sharma
> Fix For: 1.1.0
>
>
> Spark streaming requires at least two working threads.But example in
> spark/examples/src/main/scala/org/apache/spark/examples/streaming/NetworkWordCount.scala
>
> has
> // Create the context with a 1 second batch size
> val sparkConf = new SparkConf().setAppName("NetworkWordCount")
> val ssc = new StreamingContext(sparkConf, Seconds(1))
> which creates only 1 thread.
> It should have atleast 2 threads:
> http://spark.apache.org/docs/latest/streaming-programming-guide.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
