Hi, i using solr that running on windows server 2008 32-bit.
I add about 100 million article into solr without set store attribute. (only
store document id) (index file size about 164 GB)
when try to get query without sort , it's return doc ids in some ms, but when
add sort command, i get below error:
TTP Status 500 - Java heap space java.lang.OutOfMemoryError: Java heap
space at
org.apache.lucene.search.FieldCacheImpl$LongCache.createValue(FieldCacheImpl.java:560)
at org.apache.lucene.search.FieldCacheImpl$Cache.get(FieldCacheImpl.java:208)
at
org.apache.lucene.search.FieldCacheImpl.getLongs(FieldCacheImpl.java:525) at
org.apache.lucene.search.FieldComparator$LongComparator.setNextReader(FieldComparator.java:391)
at
org.apache.lucene.search.TopFieldCollector$OneComparatorNonScoringCollector.setNextReader(TopFieldCollector.java:94)
at
org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:245) at
org.apache.lucene.search.Searcher.search(Searcher.java:171) at
org.apache.solr.search.SolrIndexSearcher.getDocListNC(SolrIndexSearcher.java:988)
at
Note: i set max heap size to 1600MB (tomcat service not start when apply more
heap size) but problem not solved
I check heap dump file with mat and see this info
org.apache.lucene.index.ReadOnlySegmentReader @ 0x253508e8 Shallow Size: 80 B
Retained Size: 449,4 MB
Problem Suspect 1
One instance of "org.apache.lucene.index.ReadOnlySegmentReader" loaded
by "org.apache.catalina.loader.WebappClassLoader @ 0x25350c80" occupies
471.244.848 (97,44%) bytes. The memory is accumulated in one instance of
"org.apache.lucene.index.TermInfosReader" loaded by
"org.apache.catalina.loader.WebappClassLoader @
0x25350c80".Keywords
org.apache.lucene.index.ReadOnlySegmentReader
org.apache.catalina.loader.WebappClassLoader
@ 0x25350c80
org.apache.lucene.index.TermInfosReader
Problem Suspect 1
how to decrease segment file size for solving this problem
Thanks in advanced
Hamid