[ https://issues.apache.org/jira/browse/SPARK-6431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482752#comment-14482752 ]
Alberto edited comment on SPARK-6431 at 4/7/15 7:43 AM: -------------------------------------------------------- You're absolutely right Cody. I've been having a look at my code and I've found out that I'm not creating the topic before creating the DirectStream. If you are interested here is the test I am running: https://github.com/ardlema/big-brother/blob/master/src/test/scala/org/ardlema/spark/DwellDetectorTest.scala I completely agree with you, If the topic doesn't exist it should be returning an error and not a misleading empty set. was (Author: ardlema): I think you're right Cody. I've been having a look at my code and I've found out that I'm not creating the topic before creating the DirectStream. If you are interested here is the test I am running: https://github.com/ardlema/big-brother/blob/master/src/test/scala/org/ardlema/spark/DwellDetectorTest.scala I completely agree with you, If the topic doesn't exist it should be returning an error and not a misleading empty set. > Couldn't find leader offsets exception when creating KafkaDirectStream > ---------------------------------------------------------------------- > > Key: SPARK-6431 > URL: https://issues.apache.org/jira/browse/SPARK-6431 > Project: Spark > Issue Type: Bug > Components: Streaming > Affects Versions: 1.3.0 > Reporter: Alberto > > When I try to create an InputDStream using the createDirectStream method of > the KafkaUtils class and the kafka topic does not have any messages yet am > getting the following error: > org.apache.spark.SparkException: Couldn't find leader offsets for Set() > org.apache.spark.SparkException: org.apache.spark.SparkException: Couldn't > find leader offsets for Set() > at > org.apache.spark.streaming.kafka.KafkaUtils$$anonfun$createDirectStream$2.apply(KafkaUtils.scala:413) > If I put a message in the topic before creating the DirectStream everything > works fine. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org