RE: IOT in Spark

Hi Gaurav, You can process IoT data using Spark. But where will you store the raw/processed data - Cassandra, Hive, HBase? You might want to look at the Hadoop cluster for data storage and processing (Spark using Yarn). For processing streaming data, you might also

Re: IOT in Spark

Hi Gaurav, You might want to look for Lambda Architecture with Spark. https://www.youtube.com/watch?v=xHa7pA94DbA Regards, Kuchekar, Nilesh On Thu, May 18, 2017 at 8:58 PM, Gaurav1809 wrote: > Hello gurus, > > How exactly it works in real world

Re: IOT in Spark

Hi Gaurav, Answer is - yes; you can do it on Spark. Note that, first you need to understand what Spark is used for. For the problem statement you mentioned, you need many more technology components - Kafka, Spark Streaming, and Spark - in addition to IoT related software at the edge and gateway.