You're hunting for a bottleneck. Here is how I would go about finding it: First I would run the query on a single shard and see how long it takes. If the single shard is slow you've found your bottleneck. If its fast then try the same query on each shard, one of the shards might be slow and you've found your bottleneck.
If all the shards are fast then it would seem the bottleneck is the aggregator node. Once you've found the bottleneck then you need to start improving the throughput. Let us know what you find and then we can move on to discuss how to improve the throughput at the bottleneck. If its very fast thats Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Apr 19, 2023 at 3:57 PM Rajani Maski <rajinima...@gmail.com> wrote: > Thank you, Mikhail. > > > On Wed, Apr 19, 2023 at 7:59 AM Mikhail Khludnev <m...@apache.org> wrote: > > > Hello, Rajani. > > I meant [SOLR-14765] optimize DocList creation by skipping sort for > > sort-irrelevant cases - ASF JIRA (apache.org) > > <https://issues.apache.org/jira/browse/SOLR-14765> > > > > On Wed, Apr 19, 2023 at 4:05 AM Rajani Maski <rajinima...@gmail.com> > > wrote: > > > > > Hi Mikhail, > > > > > > Yes, 9.1.1, that should be helpful, can you please point me to the > > > related jira(s) and/or docs? > > > > > > Thank you, > > > Rajani > > > > > > > > > > > > On Mon, Apr 17, 2023 at 2:09 AM Mikhail Khludnev <m...@apache.org> > > wrote: > > > > > > > Hello Rajani. > > > > Which version are you running? IIRC 9.1.2 has some > > > > improvement about caching short queries. > > > > > > > > On Sun, Apr 16, 2023 at 4:25 PM Rajani Maski <rajinima...@gmail.com> > > > > wrote: > > > > > > > > > Hi Solr Users, > > > > > > > > > > What are your suggestions to improve star queries latencies? By > star > > > > > queries I mean "*:*" or single term queries having boost formulas > > > (such > > > > as > > > > > doc recency and many others) taking 10 or more seconds. It is a > large > > > > > collection with good compute resources, however I am guessing this > > may > > > be > > > > > because each shard has too many documents and I noticed per shard > > > > response > > > > > time also is high. > > > > > > > > > > Splitting shards could be an option however it is already an > > > > > evenly distributed, composite router, 96 shards collection, I am > > > > > concerned that more than 100 shards per collection can lead to > > > > exhaustively > > > > > searching too many shards and aggregation issues. What are your > > > thoughts? > > > > > > > > > > Can we make use of any caches, query result cache or other caches, > in > > > > solr > > > > > that allows warming up and persisting these queries results in ram, > > and > > > > > that maybe helps reduce this query time? > > > > > > > > > > Thanks, > > > > > Rajani > > > > > > > > > > > > > > > > > -- > > > > Sincerely yours > > > > Mikhail Khludnev > > > > https://t.me/MUST_SEARCH > > > > A caveat: Cyrillic! > > > > > > > > > > > > > -- > > Sincerely yours > > Mikhail Khludnev > > https://t.me/MUST_SEARCH > > A caveat: Cyrillic! > > >
