It's not just about the number of objects involved but things like index location, definition, file system used, locking methods, concurrency, read/write ratio, etc that all affect overall performance. Have you tried using a ramdisk and copying the index to it to see if helps? It would eliminate the disk IO side and some of the file based concurrency issues that might be affecting you. PHP is noisy with the file system and it might be causing problems. If you don't have access to a ramdisk - try moving the index to another disk from your PHP files (using the same approach as using a separate disk for DB log files to improve performance).
Generally this is why I prefer DB based storage - it's an optimised engine for dealing with data and keeps the search close to the data you're searching. With the Doctrine approach it scales with your DB, it's as simple as attaching a behaviour, you can use existing tools to manage & tweak the indexes and it's easily extendable. -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Thibault Jouannic Sent: 11 May 2009 11:01 To: symfony users Subject: [symfony-users] Re: Zend Search scalability Hello, Thank you for your answer. I've tried to tweak a few parameters, optimized the index, but didn't notice any difference. I've done some searches in the zend forum, and some zend developpers pretend that zend search performances are equivalent to java lucene, while some users report performance problems as I do. I'm considering using some alternative, like sphinx search. However, I'm puzzled about this scalability problem, since 60000 objects sounds reasonable to me. I can't believe I'm the first who tried to setup zend search with so many objects. I would realy appreciate any feedback. Regards. Thibault. On 10 mai, 14:00, "David Ashwood" <[email protected]> wrote: > Take a look here for optimising the index that may help:http://framework.zend.com/manual/en/zend.search.lucene.best-practice... . > nd.search.lucene.best-practice.indexing-performance > > I started using Zend Lucene but switched over to using the Doctrine > Behaviour that scales better in the test's I've run. You can find some > summary info about it here:http://www.doctrine-project.org/documentation/manual/1_1/en/behaviors.. . > ehaviors:searchable and some details here:http://www.doctrine-project.org/documentation/manual/1_1/en/searching > > -----Original Message----- > From: [email protected] [mailto:[email protected]] > > On Behalf Of Thibault Jouannic > Sent: 10 May 2009 13:47 > To: symfony users > Subject: [symfony-users] Zend Search scalability > > Hello sf users, > > I've got a performance problem with zend search. > > I followed the jobeet tutorial to integrate it, and at the beginning, > eveything worked like a charm. Today, I've got 60000 documents in db > (doesn't seems huge to me), and only a few fields are indexed (title, > tags). > > Now, if a do a search with a single term, the server takes a few > seconds to respond. If I use more than 4-5 terms, the server run out > of memory. > > Is there a configuration problem with my app, or a scalability problem > with zend search engine ? How could I tweak it to run faster ? And if > I can't, wich alternative would you recommend ? > > Thank You. > Thibault. --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "symfony users" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/symfony-users?hl=en -~----------~----~----~----~------~----~------~--~---
