Elad Meidar wrote: > My thinking_Sphinx installation indexes a table that is updated VERY > OFTEN and ~10000 new records are created per hour, never deleted, > never changed. > > If i get this right, Thinking sphinx is invoking an 'indexer' process > (http://pastie.org/489390.txt) every time a delta record is created > (http://github.com/freelancing-god/thinking-sphinx/blob/ > cd9cf7bd1dea7b097b8e7236ca5617f68dc0ab49/lib/thinking_sphinx/deltas/ > default_delta.rb#L20). > > now my question is, is it possible that this process is locking the > file status_update_delta.tmp.spl when it's running? (and if it runs > for every delta, i assume it's almost always running)
Yes, I'm fairly sure the indexer does create a lock file to prevent multiple instance treading on each other. If this happens it's not a huge issue, the records the second indexer was attempting to add may or may not end up in the delta index - if they didn't the next successful indexer run will add them. With 10000 new records per hour the default delta method is probably not appropriate for you. As your delta index grows with each new record your rails actions will take longer and longer to complete. I recommend you read about the advanced delta techniques at http://freelancing-god.github.com/ts/en/deltas.html -- James Healy <jimmy-at-deefa-dot-com> Tue, 26 May 2009 11:05:18 +1000 --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Thinking Sphinx" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/thinking-sphinx?hl=en -~----------~----~----~----~------~----~------~--~---
