hello mike,
this is the field definition:
<field name="msgid" type="slong" indexed="true" stored="true"
required="true" />
holds message id's, values range from 0 to 127132531
can I disable this cache?
Mike Klaas <[EMAIL PROTECTED]> wrote: On 28-Aug-07, at 6:19 AM, michael ravits
wrote:
> hello solrs,
>
> i have an index with 30M records, weights ~50GB. latest trunk
> version. heap size 1024mb.
> queries work fine until I specify a field to sort results by. even
> if the result set consists of only 2 documents, the CPU jumps high
> and after about 5 minutes I get the following exception:
Sorting requires a one-time generation of a fieldCache for the field,
which occupies 1, 2, 4, or 8 bytes per doc (possibly also the sum of
the size of the unique values in the field, if it is a string
field). What is the definition of the field you are trying to sort
by, and what kinds of values are indexed therein?
-Mike
> Any idea?
> thanks
>
> Java heap space
>
> java.lang.OutOfMemoryError: Java heap space
> at org.apache.lucene.index.SegmentTermEnum.termInfo
> (SegmentTermEnum.java:170)
> at org.apache.lucene.index.TermInfosReader.scanEnum
> (TermInfosReader.java:166)
> at org.apache.lucene.index.TermInfosReader.get
> (TermInfosReader.java:153)
> at org.apache.lucene.index.SegmentTermDocs.seek
> (SegmentTermDocs.java:54)
> at org.apache.lucene.index.MultiTermDocs.termDocs
> (MultiReader.java:429)
> at org.apache.lucene.index.MultiTermDocs.next(MultiReader.java:
> 380)
> at org.apache.lucene.search.FieldCacheImpl$10.createValue
> (FieldCacheImpl.java:383)
> at org.apache.lucene.search.FieldCacheImpl$Cache.get
> (FieldCacheImpl.java:72)
> at org.apache.lucene.search.FieldCacheImpl.getStringIndex
> (FieldCacheImpl.java:350)
> at org.apache.lucene.search.FieldSortedHitQueue.comparatorString
> (FieldSortedHitQueue.java:266)
> at org.apache.lucene.search.FieldSortedHitQueue$1.createValue
> (FieldSortedHitQueue.java:182)
> at org.apache.lucene.search.FieldCacheImpl$Cache.get
> (FieldCacheImpl.java:72)
> at
> org.apache.lucene.search.FieldSortedHitQueue.getCachedComparator
> (FieldSortedHitQueue.java:155)
> at org.apache.lucene.search.FieldSortedHitQueue.
> (FieldSortedHitQueue.java:56)
> at org.apache.solr.search.SolrIndexSearcher.getDocListNC
> (SolrIndexSearcher.java:862)
> at org.apache.solr.search.SolrIndexSearcher.getDocListC
> (SolrIndexSearcher.java:810)
> at org.apache.solr.search.SolrIndexSearcher.getDocList
> (SolrIndexSearcher.java:703)
> at
> org.apache.solr.handler.StandardRequestHandler.handleRequestBody
> (StandardRequestHandler.java:125)
> at org.apache.solr.handler.RequestHandlerBase.handleRequest
> (RequestHandlerBase.java:78)
> at org.apache.solr.core.SolrCore.execute(SolrCore.java:723)
> at org.apache.solr.servlet.SolrDispatchFilter.execute
> (SolrDispatchFilter.java:193)
> at org.apache.solr.servlet.SolrDispatchFilter.doFilter
> (SolrDispatchFilter.java:161)
> at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter
> (ServletHandler.java:1089)
> at org.mortbay.jetty.servlet.ServletHandler.handle
> (ServletHandler.java:365)
> at org.mortbay.jetty.security.SecurityHandler.handle
> (SecurityHandler.java:216)
> at org.mortbay.jetty.servlet.SessionHandler.handle
> (SessionHandler.java:181)
> at org.mortbay.jetty.handler.ContextHandler.handle
> (ContextHandler.java:712)
> at org.mortbay.jetty.webapp.WebAppContext.handle
> (WebAppContext.java:405)
> at org.mortbay.jetty.handler.ContextHandlerCollection.handle
> (ContextHandlerCollection.java:211)
> at org.mortbay.jetty.handler.HandlerCollection.handle
> (HandlerCollection.java:114)
> at org.mortbay.jetty.handler.HandlerWrapper.handle
> (HandlerWrapper.java:139)
> at org.mortbay.jetty.Server.handle(Server.java:285)
>
>
>
> ---------------------------------
> Looking for a deal? Find great prices on flights and hotels with
> Yahoo! FareChase.
---------------------------------
Park yourself in front of a world of choices in alternative vehicles.
Visit the Yahoo! Auto Green Center.
