Gavin: In our production, we have seen situation that Netty implementation uses too many threads. It uses a dedicated thread for each remote bolt worker. We have a fix to avoid that problem.
Our problem could be different, since we did not face too-many-file-descriptor issue. Can you post the stack trace? Andy On 3/5/14 1:26 AM, "李家宏" <[email protected]> wrote: >Also, the topology works fine on storm cluster of 0.9.0.1 with zmq as >message transport layer. >I guess netty must be the problem. > >Regards > > >2014-03-05 10:56 GMT+08:00 李家宏 <[email protected]>: > >> Hi, all >> I'm running a topology on storm cluster of 0.9.0.1 with netty as >>transport >> layer, this error occurs : >> Netty client failed to create a selector due to* too many open files >> exception*, the worker continuously halting with initialization error. >> >> I checked the ulimit -n(> 130000) which is much bigger than currently >> opened fds (sudo lsof | grep java | wc -l) which is about 6000 at most. >> >> By the way,this topology works fine with storm cluster of 0.8.0. >> >> What's the problem? >> >> Thanks >> >> -- >> >> ====================================================== >> >> Gvain >> >> Email: [email protected] >> > > > >-- > >====================================================== > >Gvain > >Email: [email protected]
