On Sun, Feb 9, 2014 at 12:51 PM, Chamila Wijayarathna <[email protected]>wrote:
> Hi , > Thank you for the information. > We are planning to run this for without stopping for a long time. So will > the 100000 limit exceed some day and give this error again? > If so is there any way of avoiding that? > Which is highly unlikely! So, don't worry! :) > > Thank You. > > > On Sun, Feb 9, 2014 at 12:41 PM, Bhathiya Jayasekara <[email protected]>wrote: > >> FYI: You can do the same by editing /etc/security/limits.conf file too. >> >> http://www.datastax.com/docs/1.0/troubleshooting/index#toomany >> >> >> >> On Sun, Feb 9, 2014 at 12:18 PM, Nirmal Fernando <[email protected]> wrote: >> >>> To avoid this please increase the open files limit of your OS. 'ulimit >>> -n' would give you the current number (by default it is 1024 - most of the >>> cases). >>> >>> You can uncomment >>> >>> #ulimit -n 100000 (after uncommenting it would be : ulimit -n 100000 ) >>> >>> in the wso2server.sh file of wso2 products in order to increase the >>> value. >>> >>> >>> On Sun, Feb 9, 2014 at 12:02 PM, Chamila Wijayarathna <[email protected] >>> > wrote: >>> >>>> Hello all, >>>> I am working on "Infra Log Analyzer" intern project which uses BAM and >>>> CEP. Here we uses 2 instances and BAM and CEP communicating with each >>>> other. >>>> When I add these two into a remote server and ran it I am getting >>>> following warning and error. >>>> >>>> [*2014-02-09 05:05:42,669] WARN >>>> {org.apache.cassandra.thrift.CustomTThreadPoolServer} - Transport error >>>> occurred during acceptance of message.* >>>> *org.apache.thrift.transport.TTransportException: >>>> java.net.SocketException: Too many open files* >>>> * at >>>> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:103)* >>>> * at >>>> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:39)* >>>> * at >>>> org.apache.thrift.transport.TServerTransport.accept(TServerTransport.java:31)* >>>> * at >>>> org.apache.cassandra.thrift.CustomTThreadPoolServer.serve(CustomTThreadPoolServer.java:100)* >>>> * at >>>> org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.run(CassandraDaemon.java:213)* >>>> *Caused by: java.net.SocketException: Too many open files* >>>> * at java.net.PlainSocketImpl.socketAccept(Native Method)* >>>> * at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)* >>>> * at java.net.ServerSocket.implAccept(ServerSocket.java:462)* >>>> * at java.net.ServerSocket.accept(ServerSocket.java:430)* >>>> * at >>>> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:97)* >>>> * ... 4 more* >>>> *[2014-02-09 05:05:42,666] ERROR {org.apache.thrift.transport.TSocket} >>>> - Could not configure socket.* >>>> *java.net.SocketException: Too many open files* >>>> * at java.net.Socket.createImpl(Socket.java:397)* >>>> * at java.net.Socket.getImpl(Socket.java:460)* >>>> * at java.net.Socket.setSoLinger(Socket.java:900)* >>>> * at org.apache.thrift.transport.TSocket.initSocket(TSocket.java:116)* >>>> * at org.apache.thrift.transport.TSocket.<init>(TSocket.java:107)* >>>> * at >>>> me.prettyprint.cassandra.connection.client.HThriftClient.open(HThriftClient.java:123)* >>>> * at >>>> me.prettyprint.cassandra.connection.client.HThriftClient.open(HThriftClient.java:26)* >>>> * at >>>> me.prettyprint.cassandra.connection.ConcurrentHClientPool.createClient(ConcurrentHClientPool.java:147)* >>>> * at >>>> me.prettyprint.cassandra.connection.ConcurrentHClientPool.<init>(ConcurrentHClientPool.java:53)* >>>> * at >>>> me.prettyprint.cassandra.connection.RoundRobinBalancingPolicy.createConnection(RoundRobinBalancingPolicy.java:67)* >>>> * at >>>> me.prettyprint.cassandra.connection.HConnectionManager.<init>(HConnectionManager.java:67)* >>>> * at >>>> me.prettyprint.cassandra.service.AbstractCluster.<init>(AbstractCluster.java:67)* >>>> * at >>>> me.prettyprint.cassandra.service.ThriftCluster.<init>(ThriftCluster.java:21)* >>>> * at >>>> org.wso2.carbon.bam.cassandra.data.archive.mapred.CassandraMapReduceRowDeletion$RowKeyMapper.setup(CassandraMapReduceRowDeletion.java:119)* >>>> * at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)* >>>> * at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)* >>>> * at org.apache.hadoop.mapred.MapTask.run(MapTask.java:369)* >>>> * at >>>> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:211)* >>>> >>>> I get this when server runs for a while about 1.5 - 2 hours. I get the >>>> same error in both BAM and CEP. >>>> I didn't get this when I ran them on my local machine. >>>> What is the reason for this? How can I avoid this? >>>> >>>> Thank You! >>>> >>>> -- >>>> *Chamila Wijayarathna* >>>> Engineering Intern, >>>> WSO2 Inc. >>>> >>>> >>>> _______________________________________________ >>>> Dev mailing list >>>> [email protected] >>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>> >>>> >>> >>> >>> -- >>> >>> Thanks & regards, >>> Nirmal >>> >>> Senior Software Engineer- Platform Technologies Team, WSO2 Inc. >>> Mobile: +94715779733 >>> Blog: http://nirmalfdo.blogspot.com/ >>> >>> >>> >>> _______________________________________________ >>> Dev mailing list >>> [email protected] >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> *Bhathiya Jayasekara* >> *Software Engineer,* >> *WSO2 inc., http://wso2.com <http://wso2.com>* >> >> *Phone: +94715478185 <%2B94715478185>* >> *LinkedIn: http://www.linkedin.com/in/bhathiyaj >> <http://www.linkedin.com/in/bhathiyaj>* >> *Twitter: https://twitter.com/bhathiyax <https://twitter.com/bhathiyax>* >> *Blog: http://movingaheadblog.blogspot.com >> <http://movingaheadblog.blogspot.com/>* >> > > > > -- > *Chamila Wijayarathna* > Engineering Intern, > WSO2 Inc. > > -- Thanks & regards, Nirmal Senior Software Engineer- Platform Technologies Team, WSO2 Inc. Mobile: +94715779733 Blog: http://nirmalfdo.blogspot.com/
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
