John, Can you explain about the --file descriptor limit for the user executing storm workers, would recommend confirming it is > 1024 ?
I couldn't understand this config. On Wed, May 18, 2016 at 11:12 AM, John Yost <[email protected]> wrote: > First question--file descriptor limit for the user executing storm > workers, would recommend confirming it is > 1024. > > --John > > On Wed, May 18, 2016 at 10:59 AM, Gurusamy Thirupathy <[email protected] > > wrote: > >> Hi, >> >> I have 8 storm workers to read data from Kafka with 8 partitions(using >> kafka spout) and writing to Cassandra(Cassandra bolt). >> I have 12g RAM and 4 CPU machine(centOs). I configured all 8 workers in >> one machine(VM) >> >> I started loading data into kafka(20000 messages every 6 seconds), I ran >> the test last 20 hour. I was performing well until 10 hours, I don’t see >> any single failure. After that(from 11th hour) I am seeing failure in storm >> UI. >> So the write count also got reduced in Cassandra. >> >> Also I am seeing the folloing error in workers log. >> >> >> b.s.m.n.Client [ERROR] connection attempt 32 to Netty-Client-stormWorkers >> failed: java.lang.RuntimeException: Returned channel was actually not >> established >> >> Anyone experienced this kind of issue? >> >> Thanks, >> Guru >> > >
