Re: Streaming data out of spark to a Kafka topic

Hi Gabor, I will look at the link and see what it provides. Thanks, Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *

Re: Streaming data out of spark to a Kafka topic

Hi Mich, Please take a look at how to write data into Kafka topic with DStreams: https://github.com/gaborgsomogyi/spark-dstream-secure-kafka-sink-app/blob/62d64ce368bc07b385261f85f44971b32fe41327/src/main/scala/com/cloudera/spark/examples/DirectKafkaSinkWordCount.scala#L77 (DStreams has no native

Streaming data out of spark to a Kafka topic

Hi, In a traditional we get data via Kafka into Spark streaming, do some work and write to a NoSQL database like Mongo, Hbase or Aerospike. That part can be done below and is best explained by the code as follows: Once a high value DF lookups is created I want send the data to a new topic for