[
https://issues.apache.org/jira/browse/FLUME-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14732289#comment-14732289
]
Jackey Lyu commented on FLUME-2785:
-----------------------------------
here is the sample of flume log.
06 SEP 2015 15:46:52,599 INFO [SinkRunner-PollingRunner-DefaultSinkProcessor]
(org.apache.flume.sink.NullSink.process:93) - Null sink k2 successful
processed 30000 events.
06 SEP 2015 15:47:07,987 ERROR [Thread-2]
(org.apache.thrift.server.TThreadedSelectorServer$SelectorThread.run:544) -
run() exiting due to uncaught error
java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:714)
at
java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:949)
at
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1360)
at
org.apache.thrift.server.TThreadedSelectorServer.requestInvoke(TThreadedSelectorServer.java:310)
at
org.apache.thrift.server.AbstractNonblockingServer$AbstractSelectThread.handleRead(AbstractNonblockingServer.java:209)
at
org.apache.thrift.server.TThreadedSelectorServer$SelectorThread.select(TThreadedSelectorServer.java:576)
at
org.apache.thrift.server.TThreadedSelectorServer$SelectorThread.run(TThreadedSelectorServer.java:536)
> Add default non-zero threads value for Thrift source, to avoid
> OutofMemoryException
> -----------------------------------------------------------------------------------
>
> Key: FLUME-2785
> URL: https://issues.apache.org/jira/browse/FLUME-2785
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: 1.6
> Environment: linux_64 2.6.32.57, Oracle JDK 1.7
> Reporter: Jackey Lyu
> Priority: Minor
> Labels: patch
> Fix For: notrack
>
> Attachments:
> 0001-update-the-DEFAULT_THREADS-for-configuration-threads.patch
>
> Original Estimate: 10m
> Remaining Estimate: 10m
>
> The current implementation of thrift source in
> `flume-ng-core/src/main/java/org/apache/flume/source/ThriftSource.java`,
> there is something can be done to improve the usability of thrift source.
> If users did not config the `threads` parameter for thrift source, the
> default threads number will be Integer.MAX_VALUE, which may easily cause
> OutofMemoryException.
> It's better to add a non-zero default value for it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
