Re: Spark Streaming to REST API

2017-12-21 Thread ashish rawat
Sorry, for not making it explicit. We are using Spark Streaming as the streaming solution and I was wondering if it is a common pattern to do per tuple redis read/write and write to a REST API through Spark Streaming. Regards, Ashish On Fri, Dec 22, 2017 at 4:00 AM, Gourav Sengupta wrote: > hi

Re: Spark Streaming to REST API

2017-12-21 Thread Gourav Sengupta
hi Ashish, I was just wondering if there is any particular reason why you are posting this to a SPARK group? Regards, Gourav On Thu, Dec 21, 2017 at 8:32 PM, ashish rawat wrote: > Hi, > > We are working on a streaming solution where multiple out of order streams > are flowing in the system and

Spark Streaming to REST API

2017-12-21 Thread ashish rawat
Hi, We are working on a streaming solution where multiple out of order streams are flowing in the system and we need to join the streams based on a unique id. We are planning to use redis for this, where for every tuple, we will lookup if the id exists, we join if it does or else put the tuple int