Hi I scratched a simple qparser plugin to experiment with intervals in Solr. https://github.com/mkhludnev/solr-flexible-qparser I pushed the jar under releases, and described how to use it in README.md. Sjoerd, if spans really blows all heap, you can give a try with intervals with this plugin. Notice the minimum Solr version required.
On Wed, Dec 14, 2022 at 9:26 PM Mikhail Khludnev <m...@apache.org> wrote: > Developers, > Is it expected for Spans? Can IntervalsQuery help here? > > On Wed, Dec 14, 2022 at 5:41 PM Sjoerd Smeets <ssme...@gmail.com> wrote: > >> Hi, >> >> I've implemented a Span Query parser and when running the below query, I'm >> seeing Heap Size Space messages on certain shards: >> >> o.a.s.s.HttpSolrCall null:java.lang.RuntimeException: >> java.lang.OutOfMemoryError: Java heap space >> >> The span query that I'm running is the following: >> >> ((spanNear([unstemmed_text:charge, unstemmed_text:account], 4, false) >> spanNear([unstemmed_text:pledge, unstemmed_text:account], 4, false)) >> spanNear([unstemmed_text:pledge, unstemmed_text:deposit], 4, false)) >> spanNear([unstemmed_text:charge, unstemmed_text:deposit], 4, false) >> >> The heap size at the moment is set to 48Gb. We are running 4 shards in 1 >> JVM and the 4 shards combined have 24M docs evenly distributed across the >> shards. We do use the collapse feature as well. >> >> This is on Solr 8.6.0 >> >> What are the considerations for running Span Queries and heap sizes? >> >> Any suggestions are welcome >> >> Sjoerd >> > > > -- > Sincerely yours > Mikhail Khludnev > -- Sincerely yours Mikhail Khludnev
