It's about the same time as the previous occasion. limit file had the following content.
Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size 0 unlimited bytes Max resident set unlimited unlimited bytes Max processes unlimited unlimited processes Max open files 32768 32768 files Max locked memory 65536 65536 bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 16382 16382 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Thank You. On Sun, Feb 9, 2014 at 5:16 PM, Nirmal Fernando <[email protected]> wrote: > hmm.. is it at least after sometime than the previous occasion? Also, did > you verify that the limit has been set correctly (using the limits file of > process)? > > > On Sun, Feb 9, 2014 at 5:04 PM, Chamila Wijayarathna <[email protected]>wrote: > >> Hi, I did edit the wso2server.sh files of both CEP and BAM. Now BAM is >> not giving the exception. But still CEP gives the same exception. >> >> Thank You. >> >> >> On Sun, Feb 9, 2014 at 1:04 PM, Chamila Wijayarathna <[email protected]>wrote: >> >>> Hi, >>> >>> Thank You for information. >>> >>> >>> On Sun, Feb 9, 2014 at 12:54 PM, Nirmal Fernando <[email protected]>wrote: >>> >>>> >>>> >>>> >>>> On Sun, Feb 9, 2014 at 12:51 PM, Chamila Wijayarathna <[email protected] >>>> > wrote: >>>> >>>>> Hi , >>>>> Thank you for the information. >>>>> We are planning to run this for without stopping for a long time. So >>>>> will the 100000 limit exceed some day and give this error again? >>>>> If so is there any way of avoiding that? >>>>> >>>> >>>> Which is highly unlikely! So, don't worry! :) >>>> >>>>> >>>>> Thank You. >>>>> >>>>> >>>>> On Sun, Feb 9, 2014 at 12:41 PM, Bhathiya Jayasekara < >>>>> [email protected]> wrote: >>>>> >>>>>> FYI: You can do the same by editing /etc/security/limits.conf file >>>>>> too. >>>>>> >>>>>> http://www.datastax.com/docs/1.0/troubleshooting/index#toomany >>>>>> >>>>>> >>>>>> >>>>>> On Sun, Feb 9, 2014 at 12:18 PM, Nirmal Fernando <[email protected]>wrote: >>>>>> >>>>>>> To avoid this please increase the open files limit of your OS. >>>>>>> 'ulimit -n' would give you the current number (by default it is 1024 - >>>>>>> most >>>>>>> of the cases). >>>>>>> >>>>>>> You can uncomment >>>>>>> >>>>>>> #ulimit -n 100000 (after uncommenting it would be : ulimit -n >>>>>>> 100000 ) >>>>>>> >>>>>>> in the wso2server.sh file of wso2 products in order to increase the >>>>>>> value. >>>>>>> >>>>>>> >>>>>>> On Sun, Feb 9, 2014 at 12:02 PM, Chamila Wijayarathna < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Hello all, >>>>>>>> I am working on "Infra Log Analyzer" intern project which uses BAM >>>>>>>> and CEP. Here we uses 2 instances and BAM and CEP communicating with >>>>>>>> each >>>>>>>> other. >>>>>>>> When I add these two into a remote server and ran it I am getting >>>>>>>> following warning and error. >>>>>>>> >>>>>>>> [*2014-02-09 05:05:42,669] WARN >>>>>>>> {org.apache.cassandra.thrift.CustomTThreadPoolServer} - Transport >>>>>>>> error >>>>>>>> occurred during acceptance of message.* >>>>>>>> *org.apache.thrift.transport.TTransportException: >>>>>>>> java.net.SocketException: Too many open files* >>>>>>>> * at >>>>>>>> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:103)* >>>>>>>> * at >>>>>>>> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:39)* >>>>>>>> * at >>>>>>>> org.apache.thrift.transport.TServerTransport.accept(TServerTransport.java:31)* >>>>>>>> * at >>>>>>>> org.apache.cassandra.thrift.CustomTThreadPoolServer.serve(CustomTThreadPoolServer.java:100)* >>>>>>>> * at >>>>>>>> org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.run(CassandraDaemon.java:213)* >>>>>>>> *Caused by: java.net.SocketException: Too many open files* >>>>>>>> * at java.net.PlainSocketImpl.socketAccept(Native Method)* >>>>>>>> * at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)* >>>>>>>> * at java.net.ServerSocket.implAccept(ServerSocket.java:462)* >>>>>>>> * at java.net.ServerSocket.accept(ServerSocket.java:430)* >>>>>>>> * at >>>>>>>> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:97)* >>>>>>>> * ... 4 more* >>>>>>>> *[2014-02-09 05:05:42,666] ERROR >>>>>>>> {org.apache.thrift.transport.TSocket} - Could not configure socket.* >>>>>>>> *java.net.SocketException: Too many open files* >>>>>>>> * at java.net.Socket.createImpl(Socket.java:397)* >>>>>>>> * at java.net.Socket.getImpl(Socket.java:460)* >>>>>>>> * at java.net.Socket.setSoLinger(Socket.java:900)* >>>>>>>> * at >>>>>>>> org.apache.thrift.transport.TSocket.initSocket(TSocket.java:116)* >>>>>>>> * at org.apache.thrift.transport.TSocket.<init>(TSocket.java:107)* >>>>>>>> * at >>>>>>>> me.prettyprint.cassandra.connection.client.HThriftClient.open(HThriftClient.java:123)* >>>>>>>> * at >>>>>>>> me.prettyprint.cassandra.connection.client.HThriftClient.open(HThriftClient.java:26)* >>>>>>>> * at >>>>>>>> me.prettyprint.cassandra.connection.ConcurrentHClientPool.createClient(ConcurrentHClientPool.java:147)* >>>>>>>> * at >>>>>>>> me.prettyprint.cassandra.connection.ConcurrentHClientPool.<init>(ConcurrentHClientPool.java:53)* >>>>>>>> * at >>>>>>>> me.prettyprint.cassandra.connection.RoundRobinBalancingPolicy.createConnection(RoundRobinBalancingPolicy.java:67)* >>>>>>>> * at >>>>>>>> me.prettyprint.cassandra.connection.HConnectionManager.<init>(HConnectionManager.java:67)* >>>>>>>> * at >>>>>>>> me.prettyprint.cassandra.service.AbstractCluster.<init>(AbstractCluster.java:67)* >>>>>>>> * at >>>>>>>> me.prettyprint.cassandra.service.ThriftCluster.<init>(ThriftCluster.java:21)* >>>>>>>> * at >>>>>>>> org.wso2.carbon.bam.cassandra.data.archive.mapred.CassandraMapReduceRowDeletion$RowKeyMapper.setup(CassandraMapReduceRowDeletion.java:119)* >>>>>>>> * at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)* >>>>>>>> * at >>>>>>>> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)* >>>>>>>> * at org.apache.hadoop.mapred.MapTask.run(MapTask.java:369)* >>>>>>>> * at >>>>>>>> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:211)* >>>>>>>> >>>>>>>> I get this when server runs for a while about 1.5 - 2 hours. I get >>>>>>>> the same error in both BAM and CEP. >>>>>>>> I didn't get this when I ran them on my local machine. >>>>>>>> What is the reason for this? How can I avoid this? >>>>>>>> >>>>>>>> Thank You! >>>>>>>> >>>>>>>> -- >>>>>>>> *Chamila Wijayarathna* >>>>>>>> Engineering Intern, >>>>>>>> WSO2 Inc. >>>>>>>> >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Dev mailing list >>>>>>>> [email protected] >>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> >>>>>>> Thanks & regards, >>>>>>> Nirmal >>>>>>> >>>>>>> Senior Software Engineer- Platform Technologies Team, WSO2 Inc. >>>>>>> Mobile: +94715779733 >>>>>>> Blog: http://nirmalfdo.blogspot.com/ >>>>>>> >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Dev mailing list >>>>>>> [email protected] >>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> *Bhathiya Jayasekara* >>>>>> *Software Engineer,* >>>>>> *WSO2 inc., http://wso2.com <http://wso2.com>* >>>>>> >>>>>> *Phone: +94715478185 <%2B94715478185>* >>>>>> *LinkedIn: http://www.linkedin.com/in/bhathiyaj >>>>>> <http://www.linkedin.com/in/bhathiyaj>* >>>>>> *Twitter: https://twitter.com/bhathiyax >>>>>> <https://twitter.com/bhathiyax>* >>>>>> *Blog: http://movingaheadblog.blogspot.com >>>>>> <http://movingaheadblog.blogspot.com/>* >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> *Chamila Wijayarathna* >>>>> Engineering Intern, >>>>> WSO2 Inc. >>>>> >>>>> >>>> >>>> >>>> -- >>>> >>>> Thanks & regards, >>>> Nirmal >>>> >>>> Senior Software Engineer- Platform Technologies Team, WSO2 Inc. >>>> Mobile: +94715779733 >>>> Blog: http://nirmalfdo.blogspot.com/ >>>> >>>> >>>> >>> >>> >>> -- >>> *Chamila Wijayarathna* >>> Engineering Intern, >>> WSO2 Inc. >>> >>> >> >> >> -- >> *Chamila Wijayarathna* >> Engineering Intern, >> WSO2 Inc. >> >> > > > -- > > Thanks & regards, > Nirmal > > Senior Software Engineer- Platform Technologies Team, WSO2 Inc. > Mobile: +94715779733 > Blog: http://nirmalfdo.blogspot.com/ > > > -- *Chamila Wijayarathna* Engineering Intern, WSO2 Inc.
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
