semistone commented on issue #22601:
URL: https://github.com/apache/pulsar/issues/22601#issuecomment-2089814280
we do many tests
current broker setting is
```
maxMessageSize=5242880
````
and producer setting (small batch message and big max bytes)
```
batchingMaxMessages: 500
batchingMaxBytes: 3145728
batchingMaxPublishDelayMicros: 500
```
payload
98% < 3K bytes
2% between 10-20K bytes
then it will show that error and publish throughput isn't good.
but if we change to
```
batchingMaxMessages: 1000
batchingMaxBytes: 3145728
batchingMaxPublishDelayMicros: 1000
```
and filter all data bigger than 15K bytes
then that error disappear
so we decide to create
one batch publisher to publish data < 15000 bytes
and one chunk publisher to publish data >= 15000 bytes
then it worked and performance is also better.
we still don't known why
but at least we have workaround solution now.
I don't how which producer configuration could fix this errors.
if you have any suggestions, we will still try it .
thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
