Re: Solr 3.6 optimize and field cache question

2013-07-10 Thread Marc Sturlese
Not a solution for the short term but sounds like a good use case to migrate to Solr 4.X and use DocValues instead of FieldCache for faceting. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-3-6-optimize-and-field-cache-question-tp4076398p4076822.html Sent from the

Solr 3.6 optimize and field cache question

2013-07-08 Thread Joshi, Shital
Hi, We have Solr 3.6 set up with master and two slaves, each one with 70GB JVM. We run into java.lang.OutOfMemoryError when we cross 250 million documents. Every time this happens we purge documents, bring it below 200 million and bounce both slaves. We have facets on 14 fields. We usually

RE: Solr 3.6 optimize and field cache question

2013-07-08 Thread Michael Ryan
, depending on how often your index is updated. -Michael -Original Message- From: Joshi, Shital [mailto:shital.jo...@gs.com] Sent: Monday, July 08, 2013 6:12 PM To: 'solr-user@lucene.apache.org' Subject: Solr 3.6 optimize and field cache question Hi, We have Solr 3.6 set up with master

Re: Solr 3.6 optimize and field cache question

2013-07-08 Thread Otis Gospodnetic
Hi, 70 GB heap and still OOMing? H sure, 14 fields for faceting, but still - 70 GB heap! Don't have source handy, but I quickly looked at FC src here - http://search-lucene.com/c/Lucene:core/src/java/org/apache/lucene/search/FieldCache.java - I see mentions of delete there, so I would