Getting started with stream processing

2017-10-10 Thread RedShift
Hi all Complete noob with regards to stream processing, this is my first attempt. I'm going to try and explain my thought process, here's what I'm trying to do: I would like to create a sum of "load" for every hour, for every device. Incoming stream of data: {"deviceId":"1234","data":{"tss":1

Re: Getting started with stream processing

2017-10-11 Thread RedShift
ours of the clock? On 10/10/2017 19:41, Matthias J. Sax wrote: Hi, if the aggregation returns a different type, you can use .aggregate(...) instead of .reduce(...) Also, for you time based computation, did you consider to use windowing? -Matthias On 10/10/17 6:27 AM, RedShift wrote: Hi all

Re: Kafka functionality

2018-01-22 Thread RedShift
On 21/01/2018 10:15, Aman Shaikh wrote: Dear sir/madam. Can we use Kafka for handling streams of data from gps device coming per sec from 1000's of device. Thanks and Regards, Aman Yes.