Re: Open Too Many Files
or change the index to a compound-index solrconfig.xml: useCompoundFiletrue/useCompoundFile so solr creates one index file and not thousands. - --- System One Server, 12 GB RAM, 2 Solr Instances, 7 Cores, 1 Core with 31 Million Documents other Cores 100.000 - Solr1 for Search-Requests - commit every Minute - 4GB Xmx - Solr2 for Update-Request - delta every 2 Minutes - 4GB Xmx -- View this message in context: http://lucene.472066.n3.nabble.com/Open-Too-Many-Files-tp2406289p2411736.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Open Too Many Files
Or decrease the mergeFactor. or change the index to a compound-index solrconfig.xml: useCompoundFiletrue/useCompoundFile so solr creates one index file and not thousands. - --- System One Server, 12 GB RAM, 2 Solr Instances, 7 Cores, 1 Core with 31 Million Documents other Cores 100.000 - Solr1 for Search-Requests - commit every Minute - 4GB Xmx - Solr2 for Update-Request - delta every 2 Minutes - 4GB Xmx
Re: Open Too Many Files
best option to use useCompoundFiletrue/useCompoundFile decreasing mergeFactor may cause indexing slow - Thanx: Grijesh http://lucidimagination.com -- View this message in context: http://lucene.472066.n3.nabble.com/Open-Too-Many-Files-tp2406289p2412415.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Open Too Many Files
Try it. ulimit -n20 2011/2/3 Grijesh pintu.grij...@gmail.com best option to use useCompoundFiletrue/useCompoundFile decreasing mergeFactor may cause indexing slow - Thanx: Grijesh http://lucidimagination.com -- View this message in context: http://lucene.472066.n3.nabble.com/Open-Too-Many-Files-tp2406289p2412415.html Sent from the Solr - User mailing list archive at Nabble.com.
Open Too Many Files
Dear all, I got an exception when querying the index within Solr. It told me that too many files are opened. How to handle this problem? Thanks so much! LB [java] org.apache.solr.client.solrj. SolrServerException: java.net.SocketException: Too many open files [java] at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:483) [java] at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244) [java] at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:89) [java] at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:118) [java] at com.greatfree.Solr.Broker.Search(Broker.java:145) [java] at com.greatfree.Solr.SolrIndex.SelectHubPageHashByHubKey(SolrIndex.java:116) [java] at com.greatfree.Web.HubCrawler.Crawl(Unknown Source) [java] at com.greatfree.Web.Worker.run(Unknown Source) [java] at java.lang.Thread.run(Thread.java:662) [java] Caused by: java.net.SocketException: Too many open files [java] at java.net.Socket.createImpl(Socket.java:397) [java] at java.net.Socket.init(Socket.java:371) [java] at java.net.Socket.init(Socket.java:249) [java] at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:80) [java] at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:122) [java] at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707) [java] at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361) [java] at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387) [java] at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) [java] at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) [java] at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) [java] at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:427) [java] ... 8 more [java] Exception in thread Thread-96 java.lang.NullPointerException [java] at com.greatfree.Solr.SolrIndex.SelectHubPageHashByHubKey(SolrIndex.java:117) [java] at com.greatfree.Web.HubCrawler.Crawl(Unknown Source) [java] at com.greatfree.Web.Worker.run(Unknown Source) [java] at java.lang.Thread.run(Thread.java:662)
Re: Open Too Many Files
increase the OS parameter for max file to open. it is less set as default depending on the OS. - Thanx: Grijesh http://lucidimagination.com -- View this message in context: http://lucene.472066.n3.nabble.com/Open-Too-Many-Files-tp2406289p2411217.html Sent from the Solr - User mailing list archive at Nabble.com.
