Be careful with the unlimited value on ulimit, you could end up with a unresponsive server... I mean, you could not even connect via ssh if you don't have enough handles.
On Thu, Dec 16, 2010 at 9:59 AM, Amin Sakka, Novapost < amin.sa...@novapost.fr> wrote: > > I increased the amount of the allowed file descriptors to "unlimted". > Now, I get exactly the same exception after 3.500000 rows : > > *CustomTThreadPoolServer.java (line 104) Transport error occurred during > acceptance of message.* > *org.apache.thrift.transport.TTransportException: > java.net.SocketException: Too many open files* > * > * > What worries me is this / by zero exception when I try to restart cassandra > ! At least, I want to backup the 3.500000 rows to continue then my > insertion, is there a way to do this? > > * > Exception encountered during startup. > java.lang.ArithmeticException: / by zero > at > org.apache.cassandra.io.sstable.SSTable.estimateRowsFromIndex(SSTable.java:233) > > * > > > Thanks. > * > * > > > > > > 2010/12/15 Jake Luciani <jak...@gmail.com> > > >> http://www.riptano.com/docs/0.6/troubleshooting/index#java-reports-an-error-saying-there-are-too-many-open-files >> >> >> >> On Wed, Dec 15, 2010 at 11:13 AM, Amin Sakka, Novapost < >> amin.sa...@novapost.fr> wrote: >> >>> *Hello,* >>> *I'm using cassandra 0.7.0 rc1, a single node configuration, replication >>> factor 1, random partitioner, 2 GO heap size.* >>> *I ran my hector client to insert 5.000.000 rows but after a couple of >>> hours, the following Exception occurs : * >>> >>> >>> WARN [main] 2010-12-15 16:38:53,335 CustomTThreadPoolServer.java (line >>> 104) Transport error occurred during acceptance of message. >>> org.apache.thrift.transport.TTransportException: >>> java.net.SocketException: Too many open files >>> at >>> org.apache.thrift.transport.TServerSocket.acceptImpl(TServerSocket.java:124) >>> at >>> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:67) >>> at >>> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:38) >>> at >>> org.apache.thrift.transport.TServerTransport.accept(TServerTransport.java:31) >>> at >>> org.apache.cassandra.thrift.CustomTThreadPoolServer.serve(CustomTThreadPoolServer.java:98) >>> at >>> org.apache.cassandra.thrift.CassandraDaemon.start(CassandraDaemon.java:120) >>> at >>> org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:229) >>> at >>> org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:134) >>> Caused by: java.net.SocketException: Too many open files >>> at java.net.PlainSocketImpl.socketAccept(Native Method) >>> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) >>> at java.net.ServerSocket.implAccept(ServerSocket.java:453) >>> at java.net.ServerSocket.accept(ServerSocket.java:421) >>> at >>> org.apache.thrift.transport.TServerSocket.acceptImpl(TServerSocket.java:119) >>> >>> >>> *When I try to restart Cassandra, I have the following exception :* >>> >>> >>> ERROR 16:42:26,573 Exception encountered during startup. >>> java.lang.ArithmeticException: / by zero >>> at >>> org.apache.cassandra.io.sstable.SSTable.estimateRowsFromIndex(SSTable.java:233) >>> at >>> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:284) >>> at >>> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:200) >>> at >>> org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:225) >>> at >>> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:449) >>> at >>> org.apache.cassandra.db.ColumnFamilyStore.addIndex(ColumnFamilyStore.java:306) >>> at >>> org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:246) >>> at >>> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:449) >>> at >>> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:437) >>> at org.apache.cassandra.db.Table.initCf(Table.java:341) >>> at org.apache.cassandra.db.Table.<init>(Table.java:283) >>> at org.apache.cassandra.db.Table.open(Table.java:114) >>> at >>> org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:138) >>> at >>> org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:55) >>> at >>> org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:216) >>> at >>> org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:134) >>> >>> >>> I am looking for advice on how to debug this. >>> >>> Thanks, >>> >>> -- >>> >>> Amin >>> >>> >>> >>> >>> >> > > > -- > > Amin SAKKA > Research and Development Engineer > 32 rue de Paradis, 75010 Paris > *Tel:* +33 (0)6 34 14 19 25 > *Mail:* amin.sa...@novapost.fr > *Web:* www.novapost.fr / www.novapost-rh.fr > > > > > -- //GK german.kond...@gmail.com // sites http://twitter.com/germanklf http://www.facebook.com/germanklf http://ar.linkedin.com/in/germankondolf
