zhenzhao wang created FLUME-3262:
------------------------------------

             Summary: Improve Scribe Source With More Options
                 Key: FLUME-3262
                 URL: https://issues.apache.org/jira/browse/FLUME-3262
             Project: Flume
          Issue Type: New Feature
            Reporter: zhenzhao wang


We're a heavy scribe source user with tremendous traffic. We found there're 
limit configuration options in original scribe source. So we add more options 
including:
# ThriftServerType, user choose one of {THshaServer, TThreadedSelectorServer, 
TThreadPoolServer} base their own traffic pattern. More details on thrift 
server could be found on Apache Thrift project.
# maxThriftFrameSizeBytes, the default max thrift frame size is 16M, it should 
be good most times, however there might some cases that the thrift size is 
bigger than 16M. The thrift server will just throw exception without too many 
valid info when a msg is bigger than the threshold. Some user might prefer 
receive, print out some msg before discard it, or some user just have event 
size bigger than 16M
# Max read buffer size. The buffer size thrift used to handle requests, 
increase the buffer will benefit throughput under heavy load. 




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to