Kafka producer throw "TimeoutException: Batch Expired" when consumer begin to read data

2018-12-04 Thread JF Chen
I have a system keep sending data to kafka continuously, and a spark streaming application reading these data from kafka every 5 minutes However, I found the kafka producer throws "TimeoutException: Batch Expired" error when sparking streaming begin to read the kafka every 5 minutes. What's the

Re: How to pull the data from mobile app directly into Kafka broker

2018-12-04 Thread Satendra Pratap Singh
Hi Manoj, Can you tell me how to configure it. > On 05-Dec-2018, at 03:51, Manoj Khangaonkar wrote: > > There is an open source Kafka Rest API from confluent. You could use that > to POST to your broker. > > regards > > On Tue, Dec 4, 2018 at 5:32 AM Satendra Pratap Singh > wrote: > >>

Re: How to pull the data from mobile app directly into Kafka broker

2018-12-04 Thread Manoj Khangaonkar
There is an open source Kafka Rest API from confluent. You could use that to POST to your broker. regards On Tue, Dec 4, 2018 at 5:32 AM Satendra Pratap Singh wrote: > Hi Team, > > Can you help me out in general I wanted to know I developed an app and > installed in my mobile when I logged in

Kafka Summit NYC and London in 2019

2018-12-04 Thread Jun Rao
Hi, Everyone, We have two upcoming Kafka Summits, one in NYC and another in London. The deadline for summiting proposals is Dec 20 for both events. Please consider submitting a proposal if you are interested. The Links to submit abstracts are Kafka Summit NYC -

How to pull the data from mobile app directly into Kafka broker

2018-12-04 Thread Satendra Pratap Singh
Hi Team, Can you help me out in general I wanted to know I developed an app and installed in my mobile when I logged in or do any activity mobile generate a log j want to pull that logs directly from mobile to Kafka broker. Please let me know how to do it. How to build data pipeline.

Re: Session Window emitting null values when converted to stream?

2018-12-04 Thread Liam Clarke
Thanks Matthias, That's far cleaner :) Cheers, Liam Clarke On Mon, Dec 3, 2018 at 4:59 PM Matthias J. Sax wrote: > The nulls are expected. > > It's not about expired session windows though: sessions window are > stored as `<(key,start-timestamp,end-timestamp), value>`. If the window >