Since you're completely new to Kafka, I would start with the Kafka docs ( https://kafka.apache.org/documentation). You should be able to get through the Getting Started part easily and there are some examples for setting up a basic Kafka server.
You don't need Kafka to start working with Spark Streaming (there are examples online to pull directly from Twitter, for example). But at a high level if you're sending data from one server to another, it can be beneficial to send the messages to a distributed queue first for durable storage (so data doesn't get lost in transmission) and other benefits. On Wed, Nov 16, 2016 at 2:12 PM, Mohammad Tariq <donta...@gmail.com> wrote: > Hi Karim, > > Are you looking for something specific? Some information about your > usecase would be really helpful in order to answer your question. > > > On Wednesday, November 16, 2016, Karim, Md. Rezaul < > rezaul.ka...@insight-centre.org> wrote: > >> Hi All, >> >> I am completely new with Kafka. I was wondering if somebody could provide >> me some guidelines on how to develop real-time streaming applications using >> Spark Streaming API with Kafka. >> >> I am aware the Spark Streaming and Kafka integration [1]. However, a >> real life example should be better to start? >> >> >> >> 1. http://spark.apache.org/docs/latest/streaming-kafka-0-10-integration.html >> >> >> >> >> >> Regards, >> _________________________________ >> *Md. Rezaul Karim* BSc, MSc >> PhD Researcher, INSIGHT Centre for Data Analytics >> National University of Ireland, Galway >> IDA Business Park, Dangan, Galway, Ireland >> Web: http://www.reza-analytics.eu/index.html >> <http://139.59.184.114/index.html> >> > > > -- > > > [image: http://] > > Tariq, Mohammad > about.me/mti > [image: http://] > <http://about.me/mti> > > >
