On Thu, Feb 27, 2003 at 06:05:02PM +0100, Thomas Spahni wrote:
> Jesse
> 
> But then something else must be terribly wrong. As long as you are pulling
> ten thousands of hits from the server, it may be slow. But when you reduce
> the number of results with (let's say) 'LIMIT 100' I expect typical serch
> times of 0.02 sec. That's what I see on a comparable machine holding 200
> MB of text plus index.
> 
> Can you check for the response time on a not so common single word?

Sorry for the delay in following up. 

Even when I'm searching for relatively uncommon single words, it's
still often slower than I'd like, but certainly under a second in
most cases.

Still, the problem is that I really do often need to search
for very common words, and these are extremely slow. People
will need to do phrase searches on this material that includes
shorter words or stopwords, and while I'm willing to shorten
the ft_min_word_length and remove the stopword list and take
the storage hit, it's still not OK that a query like "SELECT
qt FROM q WHERE MATCH(qt) AGAINST ('"in the cut"' IN BOOLEAN
MODE)" will take 2m20s to return 37 rows, or '"his computer"'
IN BOOLEAN MODE will take 17s to return 117 rows, and that's
without sorting, or joining in five other tables some with
their own restrictions, etc.

Is there any way to improve the speed of these searches, given
that fulltext phrase searching is one of the main things I had
been hoping to use this database for? In many cases, other
restrictions from joined tables will even further reduce the
number of possible matches, but perhaps this doesn't matter if
the fulltext search is done independently of these; I don't know
how the optimizer handles this.

Thanks.

Jesse Sheidlower

---------------------------------------------------------------------
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/           (the list archive)

To request this thread, e-mail <[EMAIL PROTECTED]>
To unsubscribe, e-mail <[EMAIL PROTECTED]>
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php

Reply via email to