Ok, it means that, using the KafkaProducer class setting the config
max.request.size worked correctly, right?
Now you are wondering about the kafka-console-producer.sh utility, right?
if so, have you tried using the parameter:
--producer.config /path/to/the/config/producer.properties
Just let
setting max.request.size worked when i did it in producer code; don't
understand what producer.properties is for, seems like it's not used.
On Thu, Aug 15, 2019 at 2:25 PM Jonathan Santilli <
jonathansanti...@gmail.com> wrote:
> I have asked because I did not see that in your previous email when
I have asked because I did not see that in your previous email when you
tried the console producer.
Jonathan.
On Thu, Aug 15, 2019, 3:07 PM l vic wrote:
> yes, in producer.properties
>
> On Thu, Aug 15, 2019 at 9:59 AM Jonathan Santilli <
> jonathansanti...@gmail.com> wrote:
>
> > Just to be
yes, in producer.properties
On Thu, Aug 15, 2019 at 9:59 AM Jonathan Santilli <
jonathansanti...@gmail.com> wrote:
> Just to be sure, please confirm the configuration parameter is well
> set/configure at producer level:
>
> max.request.size = 12390 (for instance)
>
> Cheers!
> --
> Jonathan
. I have plans to do so in the future.
From: l vic
Sent: Thursday, August 15, 2019 13:48
To: users@kafka.apache.org
Subject: Re: RecordTooLargeException on 16M messages in Kafka?
** This mail has been sent from an external source. Treat hyperlinks and
attachments
I tested it with kafka-console-consumer and kafka-console-producer reading
from 16M text file (no newlines):
kafka-console-producer.sh --broker-list :6667 --topic test <
./large-file
The error comes out on producer side:
org.apache.kafka.common.errors.RecordTooLargeException: The message is
I tested it with kafka-console-consumer and kafka-console-producer reading
from large text file (no newlines):
kafka-console-producer.sh --broker-list 10.10.105.24:6667 --topic test <
./large-file
On Thu, Aug 15, 2019 at 4:49 AM Jonathan Santilli <
jonathansanti...@gmail.com> wrote:
>
Yes, it's still there
On Thu, Aug 15, 2019 at 4:49 AM Jonathan Santilli <
jonathansanti...@gmail.com> wrote:
> Hello, try to send and flush just one message of 16777239 bytes, to verify
> the error still shows up.
>
> Cheers!
> --
> Jonathan
>
>
>
> On Thu, Aug 15, 2019 at 2:23 AM l vic wrote:
Hello, try to send and flush just one message of 16777239 bytes, to verify
the error still shows up.
Cheers!
--
Jonathan
On Thu, Aug 15, 2019 at 2:23 AM l vic wrote:
> My kafka (1.0.0) producer errors out on large (16M) messages.
> ERROR Error when sending message to topic test with key:
My kafka (1.0.0) producer errors out on large (16M) messages.
ERROR Error when sending message to topic test with key: null, value:
16777239 bytes with error: (org.apache.kafka.clients.producer.internals.
ErrorLoggingCallback)
org.apache.kafka.common.errors.RecordTooLargeException: The message
10 matches
Mail list logo
