[
https://issues.apache.org/jira/browse/FLUME-3262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhenzhao wang updated FLUME-3262:
---------------------------------
Attachment: FLUME-3262-0.patch
Status: Patch Available (was: Open)
> Improve Scribe Source With More Options
> ---------------------------------------
>
> Key: FLUME-3262
> URL: https://issues.apache.org/jira/browse/FLUME-3262
> Project: Flume
> Issue Type: New Feature
> Reporter: zhenzhao wang
> Priority: Major
> Attachments: FLUME-3262-0.patch, FLUME-3262-0.patch
>
>
> We're a heavy scribe source user with tremendous traffic. We found there're
> limit configuration options in original scribe source. So we add more options
> including:
> # ThriftServerType, user choose one of {THshaServer, TThreadedSelectorServer,
> TThreadPoolServer} base their own traffic pattern. More details on thrift
> server could be found on Apache Thrift project.
> # maxThriftFrameSizeBytes, the default max thrift frame size is 16M, it
> should be good most times, however there might some cases that the thrift
> size is bigger than 16M. The thrift server will just throw exception without
> too many valid info when a msg is bigger than the threshold. Some user might
> prefer receive, print out some msg before discard it, or some user just have
> event size bigger than 16M
> # Max read buffer size. The buffer size thrift used to handle requests,
> increase the buffer will benefit throughput under heavy load.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
