Re: How To Interrupt Solr Query Execution
SOLR-5986 looks like a great enhancement for enforcing timeouts. I'm curious about how to handle *manual* cancellation. We're working on backup requests -- e.g. wait till 90% of shards have responded then send out a backup request for the lagging (e.g. GC, cache miss, overloaded, etc.) shards after a configurable delay -- and would like to be able to cancel the slower to respond shard. From what I can see in SOLR-5986, I'm not sure that Solr will check the interrupt status of a thread if it is manually interrupted. Am I reading that right? If so, would it make sense to add a check for the interrupt status in SolrQueryTimeoutImpl#shouldExit()[1]? [1] https://github.com/apache/lucene-solr/blob/trunk/solr/core/src/java/org/apache/solr/search/SolrQueryTimeoutImpl.java#L57:L63 On Fri, Dec 19, 2014 at 10:15 AM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > Also note SOLR-5986 which will help in such cases when queries are stuck > iterating through terms. This will be released with Solr 5.0 > > On Fri, Dec 19, 2014 at 9:14 AM, Mikhail Khludnev < > mkhlud...@griddynamics.com> wrote: > > > > Hello, > > Note, that timeout is checked only during the search. But for example, it > > isn't checked during facet counting. Check debugQuery=true output, to > > understand how the processing time is distributed across components. > > > > On Fri, Dec 19, 2014 at 12:05 PM, Vishnu Mishra > wrote: > > > > > > Hi, I am using solr 4.9 for searching over 90 million+ documents. My > > Solr > > > is > > > running on tomcat server and I am querying Solr from an application. > I > > > have a problem with long-running queries against Solr. Although I have > > set > > > timeAllowed to 4ms, but it seems that solr still running this query > > > until it processed fully. I read some articles where it is written that > > > > > > "*Internally, Solr does nothing to time out any requests -- it lets > both > > > updates and queries take however long they need to take to be processed > > > fully.*" > > > > > > Is this what Solr does? If so, is there a configuration option to > change > > > this behavior? or can I interrupt solr query execution. > > > > > > > > > > > > -- > > > View this message in context: > > > > > > http://lucene.472066.n3.nabble.com/How-To-Interrupt-Solr-Query-Execution-tp4175190.html > > > Sent from the Solr - User mailing list archive at Nabble.com. > > > > > > > > > -- > > Sincerely yours > > Mikhail Khludnev > > Principal Engineer, > > Grid Dynamics > > > > <http://www.griddynamics.com> > > > > > > > -- > Regards, > Shalin Shekhar Mangar. >
Re: How To Interrupt Solr Query Execution
Also note SOLR-5986 which will help in such cases when queries are stuck iterating through terms. This will be released with Solr 5.0 On Fri, Dec 19, 2014 at 9:14 AM, Mikhail Khludnev < mkhlud...@griddynamics.com> wrote: > > Hello, > Note, that timeout is checked only during the search. But for example, it > isn't checked during facet counting. Check debugQuery=true output, to > understand how the processing time is distributed across components. > > On Fri, Dec 19, 2014 at 12:05 PM, Vishnu Mishra wrote: > > > > Hi, I am using solr 4.9 for searching over 90 million+ documents. My > Solr > > is > > running on tomcat server and I am querying Solr from an application. I > > have a problem with long-running queries against Solr. Although I have > set > > timeAllowed to 4ms, but it seems that solr still running this query > > until it processed fully. I read some articles where it is written that > > > > "*Internally, Solr does nothing to time out any requests -- it lets both > > updates and queries take however long they need to take to be processed > > fully.*" > > > > Is this what Solr does? If so, is there a configuration option to change > > this behavior? or can I interrupt solr query execution. > > > > > > > > -- > > View this message in context: > > > http://lucene.472066.n3.nabble.com/How-To-Interrupt-Solr-Query-Execution-tp4175190.html > > Sent from the Solr - User mailing list archive at Nabble.com. > > > > > -- > Sincerely yours > Mikhail Khludnev > Principal Engineer, > Grid Dynamics > > <http://www.griddynamics.com> > > -- Regards, Shalin Shekhar Mangar.
Re: How To Interrupt Solr Query Execution
Hello, Note, that timeout is checked only during the search. But for example, it isn't checked during facet counting. Check debugQuery=true output, to understand how the processing time is distributed across components. On Fri, Dec 19, 2014 at 12:05 PM, Vishnu Mishra wrote: > > Hi, I am using solr 4.9 for searching over 90 million+ documents. My Solr > is > running on tomcat server and I am querying Solr from an application. I > have a problem with long-running queries against Solr. Although I have set > timeAllowed to 4ms, but it seems that solr still running this query > until it processed fully. I read some articles where it is written that > > "*Internally, Solr does nothing to time out any requests -- it lets both > updates and queries take however long they need to take to be processed > fully.*" > > Is this what Solr does? If so, is there a configuration option to change > this behavior? or can I interrupt solr query execution. > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/How-To-Interrupt-Solr-Query-Execution-tp4175190.html > Sent from the Solr - User mailing list archive at Nabble.com. > -- Sincerely yours Mikhail Khludnev Principal Engineer, Grid Dynamics <http://www.griddynamics.com>
How To Interrupt Solr Query Execution
Hi, I am using solr 4.9 for searching over 90 million+ documents. My Solr is running on tomcat server and I am querying Solr from an application. I have a problem with long-running queries against Solr. Although I have set timeAllowed to 4ms, but it seems that solr still running this query until it processed fully. I read some articles where it is written that "*Internally, Solr does nothing to time out any requests -- it lets both updates and queries take however long they need to take to be processed fully.*" Is this what Solr does? If so, is there a configuration option to change this behavior? or can I interrupt solr query execution. -- View this message in context: http://lucene.472066.n3.nabble.com/How-To-Interrupt-Solr-Query-Execution-tp4175190.html Sent from the Solr - User mailing list archive at Nabble.com.