Re: Oversized Message 40k

2016-11-23 Thread Felipe Santos
ut it still works. > > > > > > -Dave > > > > > > -Original Message- > > > From: h...@confluent.io [mailto:h...@confluent.io] > > > Sent: Tuesday, November 22, 2016 1:41 PM > > > To: users@kafka.apache.org > > > Subje

Re: Oversized Message 40k

2016-11-22 Thread Ignacio Solis
0MB. These large > messages do slow down processing, but it still works. > > > > -Dave > > > > -Original Message- > > From: h...@confluent.io [mailto:h...@confluent.io] > > Sent: Tuesday, November 22, 2016 1:41 PM > > To: users@kafka.apache.or

Re: Oversized Message 40k

2016-11-22 Thread Gwen Shapira
rs@kafka.apache.org > Subject: Re: Oversized Message 40k > > The default config handles messages up to 1MB so you should be fine. > > -hans > >> On Nov 22, 2016, at 4:00 AM, Felipe Santos <felip...@gmail.com> wrote: >> >> I read on documentation that k

RE: Oversized Message 40k

2016-11-22 Thread Tauzell, Dave
: Oversized Message 40k The default config handles messages up to 1MB so you should be fine. -hans > On Nov 22, 2016, at 4:00 AM, Felipe Santos <felip...@gmail.com> wrote: > > I read on documentation that kafka is not optimized for big messages, > what is considered a big m

Re: Oversized Message 40k

2016-11-22 Thread hans
The default config handles messages up to 1MB so you should be fine. -hans > On Nov 22, 2016, at 4:00 AM, Felipe Santos wrote: > > I read on documentation that kafka is not optimized for big messages, what > is considered a big message? > > For us the messages will be on

Re: Oversized Message 40k

2016-11-22 Thread Dominik Safaric
Big is a relative term. And the question you ask is quite difficult to answer because not other information is available - including the configuration of the Kafka cluster, hardware specification etcetera. I suggest the following: (1) read a couple of benchmarks such as [1], (2) investigate

Oversized Message 40k

2016-11-22 Thread Felipe Santos
I read on documentation that kafka is not optimized for big messages, what is considered a big message? For us the messages will be on average from 20k ~ 40k? Is this a real problem? Thanks -- Felipe Santos