When I opened CEP wso2server.sh file it has "ulimit -n 100000 " line on it which I uncommented.
On Sun, Feb 9, 2014 at 5:41 PM, Nirmal Fernando <[email protected]> wrote: > It's not set it seems. You should see something like: > > Max open files 100000 100000 files > > > On Sun, Feb 9, 2014 at 5:37 PM, Chamila Wijayarathna <[email protected]>wrote: > >> It's about the same time as the previous occasion. >> >> limit file had the following content. >> >> Limit Soft Limit Hard Limit Units >> Max cpu time unlimited unlimited >> seconds >> Max file size unlimited unlimited bytes >> Max data size unlimited unlimited bytes >> Max stack size 8388608 unlimited bytes >> Max core file size 0 unlimited bytes >> Max resident set unlimited unlimited bytes >> Max processes unlimited unlimited >> processes >> Max open files 32768 32768 files >> Max locked memory 65536 65536 bytes >> Max address space unlimited unlimited bytes >> Max file locks unlimited unlimited locks >> Max pending signals 16382 16382 >> signals >> Max msgqueue size 819200 819200 bytes >> Max nice priority 0 0 >> Max realtime priority 0 0 >> Max realtime timeout unlimited unlimited us >> >> Thank You. >> >> >> On Sun, Feb 9, 2014 at 5:16 PM, Nirmal Fernando <[email protected]> wrote: >> >>> hmm.. is it at least after sometime than the previous occasion? Also, >>> did you verify that the limit has been set correctly (using the limits file >>> of process)? >>> >>> >>> On Sun, Feb 9, 2014 at 5:04 PM, Chamila Wijayarathna >>> <[email protected]>wrote: >>> >>>> Hi, I did edit the wso2server.sh files of both CEP and BAM. Now BAM is >>>> not giving the exception. But still CEP gives the same exception. >>>> >>>> Thank You. >>>> >>>> >>>> On Sun, Feb 9, 2014 at 1:04 PM, Chamila Wijayarathna >>>> <[email protected]>wrote: >>>> >>>>> Hi, >>>>> >>>>> Thank You for information. >>>>> >>>>> >>>>> On Sun, Feb 9, 2014 at 12:54 PM, Nirmal Fernando <[email protected]>wrote: >>>>> >>>>>> >>>>>> >>>>>> >>>>>> On Sun, Feb 9, 2014 at 12:51 PM, Chamila Wijayarathna < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Hi , >>>>>>> Thank you for the information. >>>>>>> We are planning to run this for without stopping for a long time. So >>>>>>> will the 100000 limit exceed some day and give this error again? >>>>>>> If so is there any way of avoiding that? >>>>>>> >>>>>> >>>>>> Which is highly unlikely! So, don't worry! :) >>>>>> >>>>>>> >>>>>>> Thank You. >>>>>>> >>>>>>> >>>>>>> On Sun, Feb 9, 2014 at 12:41 PM, Bhathiya Jayasekara < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> FYI: You can do the same by editing /etc/security/limits.conf file >>>>>>>> too. >>>>>>>> >>>>>>>> http://www.datastax.com/docs/1.0/troubleshooting/index#toomany >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Sun, Feb 9, 2014 at 12:18 PM, Nirmal Fernando >>>>>>>> <[email protected]>wrote: >>>>>>>> >>>>>>>>> To avoid this please increase the open files limit of your OS. >>>>>>>>> 'ulimit -n' would give you the current number (by default it is 1024 >>>>>>>>> - most >>>>>>>>> of the cases). >>>>>>>>> >>>>>>>>> You can uncomment >>>>>>>>> >>>>>>>>> #ulimit -n 100000 (after uncommenting it would be : ulimit -n >>>>>>>>> 100000 ) >>>>>>>>> >>>>>>>>> in the wso2server.sh file of wso2 products in order to increase >>>>>>>>> the value. >>>>>>>>> >>>>>>>>> >>>>>>>>> On Sun, Feb 9, 2014 at 12:02 PM, Chamila Wijayarathna < >>>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> Hello all, >>>>>>>>>> I am working on "Infra Log Analyzer" intern project which uses >>>>>>>>>> BAM and CEP. Here we uses 2 instances and BAM and CEP communicating >>>>>>>>>> with >>>>>>>>>> each other. >>>>>>>>>> When I add these two into a remote server and ran it I am getting >>>>>>>>>> following warning and error. >>>>>>>>>> >>>>>>>>>> [*2014-02-09 05:05:42,669] WARN >>>>>>>>>> {org.apache.cassandra.thrift.CustomTThreadPoolServer} - Transport >>>>>>>>>> error >>>>>>>>>> occurred during acceptance of message.* >>>>>>>>>> *org.apache.thrift.transport.TTransportException: >>>>>>>>>> java.net.SocketException: Too many open files* >>>>>>>>>> * at >>>>>>>>>> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:103)* >>>>>>>>>> * at >>>>>>>>>> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:39)* >>>>>>>>>> * at >>>>>>>>>> org.apache.thrift.transport.TServerTransport.accept(TServerTransport.java:31)* >>>>>>>>>> * at >>>>>>>>>> org.apache.cassandra.thrift.CustomTThreadPoolServer.serve(CustomTThreadPoolServer.java:100)* >>>>>>>>>> * at >>>>>>>>>> org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.run(CassandraDaemon.java:213)* >>>>>>>>>> *Caused by: java.net.SocketException: Too many open files* >>>>>>>>>> * at java.net.PlainSocketImpl.socketAccept(Native Method)* >>>>>>>>>> * at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)* >>>>>>>>>> * at java.net.ServerSocket.implAccept(ServerSocket.java:462)* >>>>>>>>>> * at java.net.ServerSocket.accept(ServerSocket.java:430)* >>>>>>>>>> * at >>>>>>>>>> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:97)* >>>>>>>>>> * ... 4 more* >>>>>>>>>> *[2014-02-09 05:05:42,666] ERROR >>>>>>>>>> {org.apache.thrift.transport.TSocket} - Could not configure socket.* >>>>>>>>>> *java.net.SocketException: Too many open files* >>>>>>>>>> * at java.net.Socket.createImpl(Socket.java:397)* >>>>>>>>>> * at java.net.Socket.getImpl(Socket.java:460)* >>>>>>>>>> * at java.net.Socket.setSoLinger(Socket.java:900)* >>>>>>>>>> * at >>>>>>>>>> org.apache.thrift.transport.TSocket.initSocket(TSocket.java:116)* >>>>>>>>>> * at org.apache.thrift.transport.TSocket.<init>(TSocket.java:107)* >>>>>>>>>> * at >>>>>>>>>> me.prettyprint.cassandra.connection.client.HThriftClient.open(HThriftClient.java:123)* >>>>>>>>>> * at >>>>>>>>>> me.prettyprint.cassandra.connection.client.HThriftClient.open(HThriftClient.java:26)* >>>>>>>>>> * at >>>>>>>>>> me.prettyprint.cassandra.connection.ConcurrentHClientPool.createClient(ConcurrentHClientPool.java:147)* >>>>>>>>>> * at >>>>>>>>>> me.prettyprint.cassandra.connection.ConcurrentHClientPool.<init>(ConcurrentHClientPool.java:53)* >>>>>>>>>> * at >>>>>>>>>> me.prettyprint.cassandra.connection.RoundRobinBalancingPolicy.createConnection(RoundRobinBalancingPolicy.java:67)* >>>>>>>>>> * at >>>>>>>>>> me.prettyprint.cassandra.connection.HConnectionManager.<init>(HConnectionManager.java:67)* >>>>>>>>>> * at >>>>>>>>>> me.prettyprint.cassandra.service.AbstractCluster.<init>(AbstractCluster.java:67)* >>>>>>>>>> * at >>>>>>>>>> me.prettyprint.cassandra.service.ThriftCluster.<init>(ThriftCluster.java:21)* >>>>>>>>>> * at >>>>>>>>>> org.wso2.carbon.bam.cassandra.data.archive.mapred.CassandraMapReduceRowDeletion$RowKeyMapper.setup(CassandraMapReduceRowDeletion.java:119)* >>>>>>>>>> * at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)* >>>>>>>>>> * at >>>>>>>>>> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)* >>>>>>>>>> * at org.apache.hadoop.mapred.MapTask.run(MapTask.java:369)* >>>>>>>>>> * at >>>>>>>>>> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:211)* >>>>>>>>>> >>>>>>>>>> I get this when server runs for a while about 1.5 - 2 hours. I >>>>>>>>>> get the same error in both BAM and CEP. >>>>>>>>>> I didn't get this when I ran them on my local machine. >>>>>>>>>> What is the reason for this? How can I avoid this? >>>>>>>>>> >>>>>>>>>> Thank You! >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> *Chamila Wijayarathna* >>>>>>>>>> Engineering Intern, >>>>>>>>>> WSO2 Inc. >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> _______________________________________________ >>>>>>>>>> Dev mailing list >>>>>>>>>> [email protected] >>>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> >>>>>>>>> Thanks & regards, >>>>>>>>> Nirmal >>>>>>>>> >>>>>>>>> Senior Software Engineer- Platform Technologies Team, WSO2 Inc. >>>>>>>>> Mobile: +94715779733 >>>>>>>>> Blog: http://nirmalfdo.blogspot.com/ >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> _______________________________________________ >>>>>>>>> Dev mailing list >>>>>>>>> [email protected] >>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> *Bhathiya Jayasekara* >>>>>>>> *Software Engineer,* >>>>>>>> *WSO2 inc., http://wso2.com <http://wso2.com>* >>>>>>>> >>>>>>>> *Phone: +94715478185 <%2B94715478185>* >>>>>>>> *LinkedIn: http://www.linkedin.com/in/bhathiyaj >>>>>>>> <http://www.linkedin.com/in/bhathiyaj>* >>>>>>>> *Twitter: https://twitter.com/bhathiyax >>>>>>>> <https://twitter.com/bhathiyax>* >>>>>>>> *Blog: http://movingaheadblog.blogspot.com >>>>>>>> <http://movingaheadblog.blogspot.com/>* >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> *Chamila Wijayarathna* >>>>>>> Engineering Intern, >>>>>>> WSO2 Inc. >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> >>>>>> Thanks & regards, >>>>>> Nirmal >>>>>> >>>>>> Senior Software Engineer- Platform Technologies Team, WSO2 Inc. >>>>>> Mobile: +94715779733 >>>>>> Blog: http://nirmalfdo.blogspot.com/ >>>>>> >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> *Chamila Wijayarathna* >>>>> Engineering Intern, >>>>> WSO2 Inc. >>>>> >>>>> >>>> >>>> >>>> -- >>>> *Chamila Wijayarathna* >>>> Engineering Intern, >>>> WSO2 Inc. >>>> >>>> >>> >>> >>> -- >>> >>> Thanks & regards, >>> Nirmal >>> >>> Senior Software Engineer- Platform Technologies Team, WSO2 Inc. >>> Mobile: +94715779733 >>> Blog: http://nirmalfdo.blogspot.com/ >>> >>> >>> >> >> >> -- >> *Chamila Wijayarathna* >> Engineering Intern, >> WSO2 Inc. >> >> > > > -- > > Thanks & regards, > Nirmal > > Senior Software Engineer- Platform Technologies Team, WSO2 Inc. > Mobile: +94715779733 > Blog: http://nirmalfdo.blogspot.com/ > > > -- *Chamila Wijayarathna* Engineering Intern, WSO2 Inc.
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
