RE: Synonyms impacting the performance

2008-11-12 Thread Kashyap, Raghu
: Tuesday, November 11, 2008 10:55 PM To: solr-user@lucene.apache.org Subject: Re: Synonyms impacting the performance Yeah. Though, 20 seconds still sounds like crazy, not something that I'd expect from that not terribly complex and demanding query. It's hard to tell where exactly the bottleneck

RE: Synonyms impacting the performance

2008-11-12 Thread Manepalli, Kalyan
such an adverse impact Thanks, Kalyan Manepalli -Original Message- From: Erik Hatcher [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 12, 2008 8:32 AM To: solr-user@lucene.apache.org Subject: Re: Synonyms impacting the performance On Nov 12, 2008, at 9:12 AM, Kashyap, Raghu wrote: {quote

Re: Synonyms impacting the performance

2008-11-12 Thread Erik Hatcher
On Nov 12, 2008, at 9:41 AM, Manepalli, Kalyan wrote: I did the index time synonyms and results do look much better than the query time indexing. But is there a reason for the searches to be that slow. I understand that we have a pretty long list of synonyms (one word contains atleast

Re: Synonyms impacting the performance

2008-11-12 Thread Walter Underwood
If there are twenty synonyms, then a one term query becomes a twenty term query, and that means 20X more disk accesses. wunder On 11/12/08 7:08 AM, Erik Hatcher [EMAIL PROTECTED] wrote: On Nov 12, 2008, at 9:41 AM, Manepalli, Kalyan wrote: I did the index time synonyms and results do look

RE: Synonyms impacting the performance

2008-11-12 Thread Manepalli, Kalyan
PROTECTED] Sent: Wednesday, November 12, 2008 9:09 AM To: solr-user@lucene.apache.org Subject: Re: Synonyms impacting the performance On Nov 12, 2008, at 9:41 AM, Manepalli, Kalyan wrote: I did the index time synonyms and results do look much better than the query time indexing

Re: Synonyms impacting the performance

2008-11-12 Thread Erik Hatcher
On Nov 12, 2008, at 9:12 AM, Kashyap, Raghu wrote: {quote}It's hard to tell where exactly the bottleneck is without looking at the server and a few other things. {quote} Can you suggest some areas where we can start looking into this issue? Using debugQuery=true will output the timings of

RE: Synonyms impacting the performance

2008-11-12 Thread Nguyen, Joe
Subject: Re: Synonyms impacting the performance If there are twenty synonyms, then a one term query becomes a twenty term query, and that means 20X more disk accesses. wunder On 11/12/08 7:08 AM, Erik Hatcher [EMAIL PROTECTED] wrote: On Nov 12, 2008, at 9:41 AM, Manepalli, Kalyan wrote: I did

Re: Synonyms impacting the performance

2008-11-12 Thread Chris Hostetter
two general comments on this thread as a whole... 1) it's hard to compare the timing of a query with no synonyms and a query with a lot of synonyms since the number of terms increases and (most likely) the number of documents matched in increases as well. the more clauses in the query, the

RE: Synonyms impacting the performance

2008-11-11 Thread Manepalli, Kalyan
PROTECTED] Sent: Tuesday, November 11, 2008 11:34 AM To: solr-user@lucene.apache.org Subject: RE: Synonyms impacting the performance Hi Otis, I tested by taking out the newly added synonyms data and the query time was back to normal ~125ms. I will verify the debugQuery and update you with the results

Re: Synonyms impacting the performance

2008-11-11 Thread Otis Gospodnetic
11, 2008 11:58:37 AM Subject: Synonyms impacting the performance Hi all, I recently implemented query time synonyms in my application and I am seeing drastic performance degradation. The synonyms file is counts around 1000 words. The average querytime without synonyms is around 125 ms

RE: Synonyms impacting the performance

2008-11-11 Thread Manepalli, Kalyan
, 2008 11:26 AM To: solr-user@lucene.apache.org Subject: Re: Synonyms impacting the performance Hi, That doesn't sound normal, no. Do you know what your query looks like after synonym expansion? (you can use debugQuery=true or peek at the logs) Is that really the only thing that changed

Re: Synonyms impacting the performance

2008-11-11 Thread Ryan McKinley
PROTECTED] Sent: Tuesday, November 11, 2008 11:34 AM To: solr-user@lucene.apache.org Subject: RE: Synonyms impacting the performance Hi Otis, I tested by taking out the newly added synonyms data and the query time was back to normal ~125ms. I will verify the debugQuery and update you with the results

Re: Synonyms impacting the performance

2008-11-11 Thread Otis Gospodnetic
- Solr - Nutch From: Ryan McKinley [EMAIL PROTECTED] To: solr-user@lucene.apache.org Sent: Tuesday, November 11, 2008 9:33:06 PM Subject: Re: Synonyms impacting the performance if performance is a problem, you can try adding the synonyms at index time

Re: Synonyms impacting the performance

2008-11-11 Thread Ryan McKinley
: Tuesday, November 11, 2008 11:58:37 AM Subject: Synonyms impacting the performance Hi all, I recently implemented query time synonyms in my application and I am seeing drastic performance degradation. The synonyms file is counts around 1000 words. The average querytime without synonyms