Re: org.apache.lucene.util.fst.FST taking up lot of Java Heap Memory

2020-08-07 Thread sanjay dutt
Best explanation I found so far. Will migrate to LatLonPointSpatialField and try to share the benchmark data here. Thanks again David. Cheers,Sanjay Sent from Yahoo Mail on Android On Sat, Aug 8, 2020 at 3:31 AM, David Smiley wrote: Since you have a typical use-case (point data, queries

Re: org.apache.lucene.util.fst.FST taking up lot of Java Heap Memory

2020-08-07 Thread David Smiley
Since you have a typical use-case (point data, queries that are rectangles), I strongly encourage you to migrate to LatLonPointSpatialField: https://builds.apache.org/job/Solr-reference-guide-master/javadoc/spatial-search.html#latlonpointspatialfield It's based off an internal "BKD" tree index

Re: org.apache.lucene.util.fst.FST taking up lot of Java Heap Memory

2020-08-06 Thread sanjay dutt
FieldType defined with class solr.SpatialRecursivePrefixTreeFieldType In this we are adding points only although collection has few fields with points data and then other fieldTypes as well. And one of the queries looks like (my_field: [45,-94 TO 46,-93]+OR+my_field: [42,-94 TO 43,-93]) Thanks

Re: org.apache.lucene.util.fst.FST taking up lot of Java Heap Memory

2020-08-05 Thread David Smiley
What is the Solr field type definition for this field? And what sort of spatial data do you add here -- just points or what? ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Mon, Aug 3, 2020 at 10:09 PM sanjay dutt wrote: > Hello Solr community, >

Re: org.apache.lucene.util.fst.FST taking up lot of Java Heap Memory

2020-08-04 Thread Erick Erickson
Possibly https://issues.apache.org/jira/browse/LUCENE-9286? I’m not quite sure whether this only affects 8.5 or not. Also: https://issues.apache.org/jira/browse/LUCENE-8920 and https://issues.apache.org/jira/browse/LUCENE-9398 might be of interest. I have no idea whether these are relevant or

org.apache.lucene.util.fst.FST taking up lot of Java Heap Memory

2020-08-03 Thread sanjay dutt
Hello Solr community, On our Production SolrCloud Server, OutOfMemory has been occurring on lot of instances. When I download the HEAP DUMP and analyzed it. I got to know that in multiple HEAP DUMPS there are lots of instances of  org.apache.lucene.codecs.blocktree.BlockTreeTermsReader  which