Unfortunately, TS does not support distributed indexes... I would like to, but it hasn't been a priority, and I'm not sure what the syntax would look like. Any suggestions on how it should be implemented are welcome.
-- Pat On 18/02/2010, at 10:19 AM, madhu wrote: > hi pat, > > I have sent my previous message to you by clicking on 'reply to > author' instead of posting here. Sorry about the spam. > > in short, the suggestion i got from 'sphinx forum' is to use > distributed indexing. Does TS support distributed indexing ? > > tx > madhu > > > > > On Feb 17, 12:52 pm, madhu <[email protected]> wrote: >> hello pat, >> >> Thank you very much for the quick response. I will check the same with >> sphinx group as well. I am trying to simplify the complex query >> structure. When i reduce max_match to :1000, i could save about >> 50-100ms. >> >> regards >> madhu >> >> On Feb 17, 12:38 am, Pat Allan <[email protected]> wrote: >> >>> Hi Madhu >> >>> I've never dealt with a Sphinx index of that size, so I'm not sure what the >>> best approach is. I recommend you ask this same question on the Sphinx >>> Forum, see if the people there can help.http://www.sphinxsearch.com/forum/ >> >>> Also, you may want to look into the following >>> setting:http://www.sphinxsearch.com/docs/manual-0.9.9.html#conf-preopen >> >>> It's also worth noting that queries get slower the more complex they are, >>> and your previous email was in a thread with a complex query you wanted... >>> if there's any way of simplifying that, then that should help speeds too. >>> Having an explicit max_matches much higher than 1000 also keeps Sphinx >>> running a bit slower. >> >>> Hope this is somewhat helpful. >> >>> Cheers >> >>> -- >>> Pat >> >>> On 17/02/2010, at 3:35 PM, madhu wrote: >> >>>> Is there any performance tuning parameters for sphinx. I am using the >>>> following values in my sphinx.yml: >>>> mem_limit: 256M >>>> read_buffer: 2M >>>> Is there any other things i can tune to improve the performance ? >> >>>> I have 10 million records and my sphinx index folder is about 2.5gb. >>>> and using "extended" search queries with max_matches: 2000. Its taking >>>> almost 1.5 seconds for one search query in sphinx. The average DB >>>> response time is 20 - 100ms. I want to reduce sphinx delay to 500ms or >>>> less. Is it possible ? >> >>>> Other thing I observed is though the index size is 2.5gb, searchd only >>>> occupies 500mb of RAM when started. then when the queries are running, >>>> the memory usage goes between 500mb and 700mb. Is there a way to load >>>> entire index to memory so that i can completely eliminate the IO >>>> reads ?(I have enough RAM) >> >>>> I am running sphinx server in one machine, DB in another machine and >>>> Web-Server on a third machine. >> >>>> appreciate any help. >> >>>> tx >>>> madhu >> >>>> -- >>>> You received this message because you are subscribed to the Google Groups >>>> "Thinking Sphinx" group. >>>> To post to this group, send email to [email protected]. >>>> To unsubscribe from this group, send email to >>>> [email protected]. >>>> For more options, visit this group >>>> athttp://groups.google.com/group/thinking-sphinx?hl=en. > > -- > You received this message because you are subscribed to the Google Groups > "Thinking Sphinx" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/thinking-sphinx?hl=en. > -- You received this message because you are subscribed to the Google Groups "Thinking Sphinx" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/thinking-sphinx?hl=en.
