[ 
https://issues.apache.org/jira/browse/FLUME-3262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhenzhao wang updated FLUME-3262:
---------------------------------
    Issue Type: Improvement  (was: New Feature)

> Improve Scribe Source With More Options
> ---------------------------------------
>
>                 Key: FLUME-3262
>                 URL: https://issues.apache.org/jira/browse/FLUME-3262
>             Project: Flume
>          Issue Type: Improvement
>            Reporter: zhenzhao wang
>            Priority: Major
>         Attachments: FLUME-3262-0.patch, FLUME-3262-0.patch
>
>
> We're a heavy scribe source user with tremendous traffic. We found there're 
> limit configuration options in original scribe source. So we add more options 
> including:
> # ThriftServerType, user choose one of {THshaServer, TThreadedSelectorServer, 
> TThreadPoolServer} base their own traffic pattern. More details on thrift 
> server could be found on Apache Thrift project.
> # maxThriftFrameSizeBytes, the default max thrift frame size is 16M, it 
> should be good most times, however there might some cases that the thrift 
> size is bigger than 16M. The thrift server will just throw exception without 
> too many valid info when a msg is bigger than the threshold. Some user might 
> prefer receive, print out some msg before discard it, or some user just have 
> event size bigger than 16M
> # Max read buffer size. The buffer size thrift used to handle requests, 
> increase the buffer will benefit throughput under heavy load. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to