Thanks! Yes I agree (to a certain level) on me being naive. Currently I'm only using one server for this but will go into distributed snapshot/pull mode soon. Then I can tune the slaves differently then the master I believe. The master for instance do not need autowarming nor caches if not searched upon.
Since our company is quite new we cannot afford doing an architecture the "right" way (yes I'm a errrrr system/infrastructure arch). The box I'm running on has 2G memory and 4 resin processes + a quartz scheduler running. For instance on the same box (tailsweep3) a mysql (slave) and activemq server sits as well, and yes a lighttpd server. All of these guys compete for memory, cpu (idling) and i|o. So frankly I'm out of memory on the box (or swapping as hell). OK I got the conclusion myself. add memory to the box and get some more boxes :) Kindly //Marcus On 1/22/08, Chris Hostetter <[EMAIL PROTECTED]> wrote: > > > : I get OOE with Solr 1.3 Autowarm seem to be the villain in cojunction > with > : FieldCache somehow. > : JVM args: -Xmx512m -Xms512m -Xss128k > : > : Index size is ~4 Million docs, where I index text and store database > primary > > it seems naive to me to only allow 512MB for an index of 4 million docs -- > no matter how small the docs are. > > : I have removed "firstSearcher" and "newSearcher" since the queries I > used > : before killed performance on reindexing the whole index. I will add them > : later again when I get into a delta update index state. > > in that case you should change the autowarm counts of all your caches to 0 > as well ... that's what is causing your stack trace below: it's > autowarming the queryResultCache which wants to use the FieldCache (either > for sorting or faceting) > > Also note that you have maxWarmingSearchers set to 4 -- that's fine for a > master that's being updated frequently -- as long as you have the caches > disabled (or at least the autowarming of the caches disabled) > > > : [06:25:53.877] Error during auto-warming of key: > : [EMAIL PROTECTED]: > java.lang.OutOfMemoryError: > : Java heap space > > : [06:25:53.877] at org.apache.solr.search.SolrIndexSearcher.getDocListNC > ( > : SolrIndexSearcher.java:862) > > : [06:25:53.877] at org.apache.solr.search.LRUCache.warm(LRUCache.java > :192) > : [06:25:53.877] at org.apache.solr.search.SolrIndexSearcher.warm( > : SolrIndexSearcher.java:1393) > > > > -Hoss > > -- Marcus Herou Solution Architect and Java developer Tailsweep AB +46702561312 [EMAIL PROTECTED] http://www.tailsweep.com/ http://blogg.tailsweep.com/
