Re: Solr 1.3 - response time very long

[Matthew Runo]

Are you manipulating the query at all between the url like /test/ 
selector?cache=0&backend=solr&request=/relevance/search/D and what  
gets sent to Solr? To me, those don't look like solr requests (I could  
be missing something though). I'd be curious to see the actual  
requests to try and let you know why you're getting an error (what  
error is it giving you?).

Thanks for your time!
Matthew Runo
Software Engineer, Zappos.com
[EMAIL PROTECTED] - 702-943-7833

On Dec 3, 2008, at 1:02 AM, sunnyfr wrote:


Hi again,

In my test, I've maximum response time : 65 sec for an average at 3,
So it might come some request which provide error, for exemple in my  
test
for 50 000 requests I've around 30 requests which get back error,  
that's why
the max time response is 65sec.

I just don't get why I've this error on some request. like :
/test/selector?cache=0&backend=solr&request=/relevance/search/D
/test/selector?cache=0&backend=solr&request=/relevance/search/?f+you
/test/selector?cache=0&backend=solr&request=/relevance/search/?
/test/selector?cache=0&backend=solr&request=/relevance/search/the
/test/selector?cache=0&backend=solr&request=/relevance/search/?????
...
When I search it manually not by jMeter .. indeed it takes a long  
time and
then it get back ids.
What do you think?

Thanks a lot for your help.


sunnyfr wrote:

Hi Matthew, Hi Yonik,

...sorry for the flag .. didnt want to ...

Solr 1.3  / Apache 5.5

Data's directory size : 7.9G
I'm using jMeter to hit http request, I'm sending exactly the same  
on solr
and sphinx(mysql) by http either.

solr
http://test-search.com/test/selector?cache=0&backend=solr&request=/relevance/search/dog
sphinx
http://test-search.com/test/selector?cache=0&backend=mysql&request=/relevance/search/dog

when threads are more than 4 it's gettting slower, for a big test  
during
40mn with increasing to 100 threads/sec for solr like for sphinx,  
at the
end the average for solr is 3sec and for sphinx 1sec.

solrconfig.xml :  http://www.nabble.com/file/p20802690/solrconf.xml
solrconf.xml

schema.xml:
<fields>
   <field name="id"                        type="sint"     
indexed="true"
stored="true"  omitNorms="true" />

   <field name="duration"                  type="sint"     
indexed="true"
stored="false" omitNorms="true" />
   <field name="created"                   type="date"     
indexed="true"
stored="true" omitNorms="true" />
   <field name="modified"                  type="date"     
indexed="true"
stored="false" omitNorms="true" />
   <field name="rating_binrate"            type="sint"     
indexed="true"
stored="true" omitNorms="true" />
   <field name="user_id"                   type="sint"     
indexed="true"
stored="false" omitNorms="true" />
   <field name="country"                   type="string"   
indexed="true"
stored="false" omitNorms="true" />
   <field name="language"                  type="string"   
indexed="true"
stored="true" omitNorms="true" />
  ...
   <field name="stat_views"                type="sint"     
indexed="true"
stored="true" omitNorms="true" />
   <field name="stat_views_today"          type="sint"     
indexed="true"
stored="false" omitNorms="true" />
   <field name="stat_views_last_week"      type="sint"     
indexed="true"
stored="false" omitNorms="true" />
   <field name="stat_views_last_month"     type="sint"     
indexed="true"
stored="false" omitNorms="true" />
   <field name="stat_comments"             type="sint"     
indexed="true"
stored="false" omitNorms="true" />
   <field name="stat_comments_today"       type="sint"     
indexed="true"
stored="false" omitNorms="true" />
   <field name="stat_comments_last_week"   type="sint"     
indexed="true"
stored="false" omitNorms="true" />
   <field name="stat_comments_last_month"  type="sint"     
indexed="true"
stored="false" omitNorms="true" />
...
   <field name="title"                     type="text"
indexed="true" stored="true" />
   <field name="title_fr"                  type="text_fr"
indexed="true" stored="false" />
   <field name="title_en"                  type="text_en"
indexed="true" stored="false" />
   <field name="title_de"                  type="text_de"
indexed="true" stored="false" />
   <field name="title_es"                  type="text_es"
indexed="true" stored="false" />
   <field name="title_ru"                  type="text_ru"
indexed="true" stored="false" />
   <field name="title_pt"                  type="text_pt"
indexed="true" stored="false" />
   <field name="title_nl"                  type="text_nl"
indexed="true" stored="false" />
   <field name="title_el"                  type="text_el"
indexed="true" stored="false" />
   <field name="title_ja"                  type="text_ja"
indexed="true" stored="false" />
   <field name="title_it"                  type="text_it"
indexed="true" stored="false" />

   <field name="description"               type="text"     
indexed="true"
stored="true" />
   <field name="description_fr"            type="text_fr"
indexed="true" stored="false" />
   <field name="description_en"            type="text_en"
indexed="true" stored="false" />
   <field name="description_de"            type="text_de"
indexed="true" stored="false" />
   <field name="description_es"            type="text_es"
indexed="true" stored="false" />
   <field name="description_ru"            type="text_ru"
indexed="true" stored="false" />
   <field name="description_pt"            type="text_pt"
indexed="true" stored="false" />
   <field name="description_nl"            type="text_nl"
indexed="true" stored="false" />
   <field name="description_el"            type="text_el"
indexed="true" stored="false" />
   <field name="description_ja"            type="text_ja"
indexed="true" stored="false" />
....

  <field name="text" type="text" indexed="true" stored="false"
multiValued="true"/>
  <field name="timestamp" type="date" indexed="true" stored="true"
default="NOW" multiValued="false"/>
  <field name="spell" type="textSpell" indexed="true" stored="true"
multiValued="true"/>
  <dynamicField name="random*" type="random" />
</fields>

What would you reckon ???
Thanks a lot,




Matthew Runo wrote:

Could you provide more information? How big is the index? How are  
you
searching it? Some examples might help pin down the issue.

How long are the queries taking? How long did they take on Sphinx?

Thanks for your time!

Matthew Runo
Software Engineer, Zappos.com
[EMAIL PROTECTED] - 702-943-7833

On Dec 2, 2008, at 9:04 AM, sunnyfr wrote:


Hi,

I tested my old search engine which is sphinx and my new one which
solr and
I've got a uge difference of result.
How can I make it faster?

Thanks a lot,
--
View this message in context:
http://www.nabble.com/Solr-1.3---response-time-very-long-tp20795134p20795134.html
Sent from the Solr - User mailing list archive at Nabble.com.







--
View this message in context: 
http://www.nabble.com/Solr-1.3---response-time-very-long-tp20795134p20809121.html
Sent from the Solr - User mailing list archive at Nabble.com.