Daniel, 1.5 seconds is quite long and 60 seconds is....more than scary - smells like some is not set up right. You have a lot of fields of type text, but a number of field sound like they really need not be tokenized and should thus be of type string. Do you really need 6 warming searchers? I think "date" type is pretty granular. Do you really need that type of precision? I don't have shell handy here to check, but is that 'M' in -Xmx... recognized, or should it be lowercase 'm'? Have you noticed anything weird while looking at the Solr Java process with jConsole?
Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch ----- Original Message ---- > From: Daniel Andersson <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Saturday, May 3, 2008 7:06:10 PM > Subject: Help optimizing > > Hi (again) people > > We've now invested in a server with 8 GB of RAM after too many > OutOfMemory-errors. > > Our database/index is 3.5 GB and contains 4,352,471 documents. Most > documents are less than 1 kb. When performing a search, the results > vary between 1.5 seconds up to 60 seconds. > > I don't have a big problem with 1.5 seconds (even though below 1 would > be nice), but 60 seconds it just.. well, scary. > > How do I optimize Solr to better use all the RAM? I'm using java6, > 64bit version, and start Solr using: > java -Xmx7500M -Xms4096M -jar start.jar > > But according to top it only seems to be using 7.7% of the memory > (around 600 MB). > > Most queries are for make_id + model_id or city + state and almost all > of the queries are ordered by datetime_found (newest -> oldest). > > from schema.xml: > > required="true" /> > > multiValued="false" /> > > multiValued="false" /> > > multiValues="true" /> > > multiValued="false" /> > > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > multiValued="false" /> > > > multiValued="false" /> > > multiValued="false" /> > > > > stored="true" multiValued="false" /> > > > > multiValued="true"/> > > > > > > > from solrconfig.xml: > > class="solr.LRUCache" > size="4096" > initialSize="4096" > autowarmCount="2048"/> > > > class="solr.LRUCache" > size="4096" > initialSize="4096" > autowarmCount="2048"/> > > > class="solr.LRUCache" > size="4096" > initialSize="4096" > autowarmCount="0"/> > > 50 > > 1000 > > > > > datetime_found 0> str> 10 > > > > > > datetime_found 0> str> 10 > > > > true > 6 > > Any help much appreciated! > > Kind regards, > Daniel >
