Ok so part of the problem was my crontask didn't execute to reindex. WHen I ran it manually it stopped at 65000 records, and the error I got was that it ran out of memory. WHich is sad becaue I have my memory limit in php set to 1024M Damn propel memory usage sucks. I hacked the sfLucene indexer to let me start where I left off, but in the long term that is plain bad.
Speed is back up for the 130K records that have been index and exact matching seem sto be working now. James On Jun 27, 2008, at 7:41 AM, Haris Zukanovic' wrote: > Any errors in your logs ? > > James wrote: >> >> I think I figured out part of the problem with. The index is >> defitely >> dying, but at 65000 indexes. Not sure how to get lucene to start >> rebuilding at 65001. >> >> James >> >> >> >> On Jun 26, 2008, at 11:26 PM, James wrote: >> >> >>> Hi Everyone, >>> >>> We've had sfLucene working in our site for a while. We had basic >>> search and indexing working and since have made some modification to >>> allow indexing of tags and refinded search from a tag cloud. We >>> have a couple problems that we are trying to resolve, and I am >>> hoping you can point us in the right direction. >>> >>> 1) We have 1.4 million charity records in a table. When I run >>> symfony lucene-rebuild-index via cronjob it gets to about 633000 >>> records and stops indexing, and I am not sure how to debug this? >>> Any thoughts? >>> >>> 2) Exact phrase searches. When we search for things like "Babson >>> College" and "Horizon's for Homeless Children" first off the search >>> is really show, second neither of these show up at the top of the >>> search even thought they are typed word for word. >>> >>> Any thoughts would be much appreciated. >>> >>> Thanks, >>> James >>> >> >> >> > > -- > Haris Zukanovic > CEO > Software development and research > International Business Development, SOFTING ltd. > > > office +387 36 318 339 > GSM +387 61 839 069 > > http://www.eu-softing.com > > > > > > CONFIDENTIALITY NOTICE > This e-mail and any attached files, sent by a company e - mail > system, contains company confidential and/or privileged information > and is intended only for the person or entity to which it is > addressed and only for the purposes therein set forth. If you are > not the intended recipient (or have received this e-mail in error) > please notify the sender immediately and destroy this e-mail. Any > unauthorized copying, disclosure, distribution or other use of, or > taking of any action in reliance upon, the material in this e-mail > by persons or entities other than the intended recipient is strictly > forbidden. > > > --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "symfony users" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/symfony-users?hl=en -~----------~----~----~----~------~----~------~--~---
