Hi team, I got an issue while integrating with the spark streaming using pyspark, I did receive the video stream data in a different consumer subscribe to the same topic.
Works fine with this command : *./kafka-console-consumer.sh --bootstrap-server <IP_ADDRESS>:9092 --topic spark-streaming-consumer --from-beginning* But not with this : > def processRecord(record): print(record) > sc = SparkContext(master="local[2]",appName="HNStreaming") sc.setLogLevel('DEBUG') ssc = StreamingContext(sc, 2) topic = "spark-stream-message" kvs = KafkaUtils.createDirectStream(ssc, [topic], {'metadata.broker.list': > brokers}) kvs.foreachRDD(self.processRecord) ssc.start() ssc.awaitTermination() > > Expecting help from your side asap. Thank you! -- Regards, biswajitGhosh