[
https://issues.apache.org/jira/browse/FLUME-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397031#comment-13397031
]
Mubarak Seyed commented on FLUME-1293:
--------------------------------------
It turns out that i am running ulimit for flume user as 1024 and multiple
client connections are talking to port 9090, let me bump up the ulimit for
flume user to 32k and test it out.
> NIO channel selector open throws "Too many open files" exception
> ----------------------------------------------------------------
>
> Key: FLUME-1293
> URL: https://issues.apache.org/jira/browse/FLUME-1293
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources
> Affects Versions: v1.1.0
> Environment: {code}
> -bash-3.2$ java -version
> java version "1.6.0_24"
> Java(TM) SE Runtime Environment (build 1.6.0_24-b07)
> Java HotSpot(TM) 64-Bit Server VM (build 19.1-b02, mixed mode)
> -bash-3.2$ uname -a
> Linux test.test.com 2.6.18-194.26.1.0.1.el5 #1 SMP Tue Nov 9 18:48:15 EST
> 2010 x86_64 x86_64 x86_64 GNU/Linux
> {code}
> Reporter: Mubarak Seyed
> Labels: newbie
> Attachments: flume-1293-stacktrace.txt
>
>
> {code}
> 2012-06-19 19:01:21,998 ERROR api.NettyAvroRpcClient: RPC connection error :
> java.io.IOException: Error connecting to /x.x.x.x:9090
> at
> org.apache.avro.ipc.NettyTransceiver.getChannel(NettyTransceiver.java:249)
> at
> org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:198)
> at
> org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:147)
> at
> org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:115)
> at
> org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:104)
> at
> org.apache.flume.api.NettyAvroRpcClient.<init>(NettyAvroRpcClient.java:89)
> at
> org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory.java:131)
> at org.apache.flume.sink.AvroSink.createConnection(AvroSink.java:148)
> at org.apache.flume.sink.AvroSink.verifyConnection(AvroSink.java:176)
> at org.apache.flume.sink.AvroSink.process(AvroSink.java:231)
> at
> org.apache.flume.sink.FailoverSinkProcessor.process(FailoverSinkProcessor.java:162)
> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: org.jboss.netty.channel.ChannelException: Failed to create a
> selector.
> at
> org.jboss.netty.channel.socket.nio.NioWorker.register(NioWorker.java:105)
> at
> org.jboss.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:403)
> at
> org.jboss.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:370)
> at
> org.jboss.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:292)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> ... 1 more
> Caused by: java.io.IOException: Too many open files
> at sun.nio.ch.IOUtil.initPipe(Native Method)
> at sun.nio.ch.EPollSelectorImpl.<init>(EPollSelectorImpl.java:49)
> at
> sun.nio.ch.EPollSelectorProvider.openSelector(EPollSelectorProvider.java:18)
> at java.nio.channels.Selector.open(Selector.java:209)
> at
> org.jboss.netty.channel.socket.nio.NioWorker.register(NioWorker.java:103)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
