Adrien Grand created LUCENE-8027:
------------------------------------

             Summary: Do not cache clauses if they might make the query more 
than X times slower
                 Key: LUCENE-8027
                 URL: https://issues.apache.org/jira/browse/LUCENE-8027
             Project: Lucene - Core
          Issue Type: Improvement
            Reporter: Adrien Grand
            Priority: Minor


Query caching can have a negative impact on tail latencies as the clause that 
is cached needs to be entirely consumed. Maybe we could leverage the fact that 
we can know the lead cost from any scorer now (LUCENE-7897) in order to 
implement heuristics that would look  like "do not cache clause X if its cost 
is 10x greater than the cost of the entire query". This would make sure that a 
fast query can not become absurdly slow just because it had to cache a costly 
filter. The filter will need to wait for a more costly query to be cached, or 
might never be cached at all.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to