it's a general linux thing. https://www.google.com/webhp?#q=limit%20file%20descriptor%20linux
On Wed, May 18, 2016 at 9:24 AM, Gurusamy Thirupathy <[email protected]> wrote: > John, > > Can you explain about the --file descriptor limit for the user > executing storm workers, would recommend confirming it is > 1024 ? > > I couldn't understand this config. > > On Wed, May 18, 2016 at 11:12 AM, John Yost <[email protected]> wrote: > >> First question--file descriptor limit for the user executing storm >> workers, would recommend confirming it is > 1024. >> >> --John >> >> On Wed, May 18, 2016 at 10:59 AM, Gurusamy Thirupathy < >> [email protected]> wrote: >> >>> Hi, >>> >>> I have 8 storm workers to read data from Kafka with 8 partitions(using >>> kafka spout) and writing to Cassandra(Cassandra bolt). >>> I have 12g RAM and 4 CPU machine(centOs). I configured all 8 workers in >>> one machine(VM) >>> >>> I started loading data into kafka(20000 messages every 6 seconds), I ran >>> the test last 20 hour. I was performing well until 10 hours, I don’t see >>> any single failure. After that(from 11th hour) I am seeing failure in storm >>> UI. >>> So the write count also got reduced in Cassandra. >>> >>> Also I am seeing the folloing error in workers log. >>> >>> >>> b.s.m.n.Client [ERROR] connection attempt 32 to >>> Netty-Client-stormWorkers failed: java.lang.RuntimeException: Returned >>> channel was actually not established >>> >>> Anyone experienced this kind of issue? >>> >>> Thanks, >>> Guru >>> >> >> >
