[
https://issues.apache.org/jira/browse/FLUME-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15183648#comment-15183648
]
Ryan Persaud edited comment on FLUME-2885 at 3/7/16 8:33 PM:
-------------------------------------------------------------
I ran into the same issue, and also noted that feedback was never provided to
AdaptiveReceiveBufferSizePredictor via previousReceiveBufferSize(), so the
buffer size is stuck at 2048 bytes, and datagrams larger than that will be
truncated. As a workaround, I built my own version of SyslogUDPSource that
uses the FixedBufferSizePredictor and exposes a setting named datagramSize. I
set datagramSize to the max datagram size we see in our environment.
was (Author: rpersaud):
I ran into the same issue, and also noted that feedback was never provided to
AdaptiveReceiveBufferSizePredictor via previousReceiveBufferSize(), so the
buffer size is stuck at 2048 bytes, and datagrams larger than that will be
truncated. As a workaround, I built my own version of SyslogUDPSource that
uses the FixedBufferSizePredictor and exposes a setting named datagramSize. I
set datagramSize the max datagram size we see in our environment.
> Handle payloads larger than 2k via SyslogUDPSource
> --------------------------------------------------
>
> Key: FLUME-2885
> URL: https://issues.apache.org/jira/browse/FLUME-2885
> Project: Flume
> Issue Type: Bug
> Reporter: Javier León de Antonio
>
> Syslog messages sent via UDP are truncated to 2k.
> After a research, I found this issue :
> https://issues.apache.org/jira/browse/FLUME-2130
> I saw you are using an AdaptiveReceiveBufferSizePredictorFactory to handle
> the buffer size from an initial size of 2k to a max size of 64k, but this
> BufferSizePredictor never grows. I searched a little more, and I found that
> AdaptiveReceiveBufferSizePredictorFactory only does his magic on
> NioDatagramWorker.
> SyslogUDPSource is not using NIO to handle UDP (It's using
> OioDatagramChannelFactory), so NioDatagramWorker is not been used.
> I don't know if it's better to change netty server to work with NIO on
> SyslogUDPSource, or to put 64k as buffer initial value.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
