In the other two built-in methods (and Dan Pickett's Workling  
approach, I'd expect), the indexer isn't called from multiple threads/ 
processes, so it will only ever be running one at a time.

-- 
Pat

On 26/05/2009, at 7:54 AM, Elad Meidar wrote:

>
> When using a different delta method, will there be no file locking?
>
> On May 25, 9:11 pm, James Healy <[email protected]> wrote:
>> Elad Meidar wrote:
>>> My thinking_Sphinx installation indexes a table that is updated VERY
>>> OFTEN and ~10000 new records are created per hour, never deleted,
>>> never changed.
>>
>>> If i get this right, Thinking sphinx is invoking an 'indexer'  
>>> process
>>> (http://pastie.org/489390.txt) every time a delta record is created
>>> (http://github.com/freelancing-god/thinking-sphinx/blob/
>>> cd9cf7bd1dea7b097b8e7236ca5617f68dc0ab49/lib/thinking_sphinx/deltas/
>>> default_delta.rb#L20).
>>
>>> now my question is, is it possible that this process is locking the
>>> file status_update_delta.tmp.spl when it's running? (and if it runs
>>> for every delta, i assume it's almost always running)
>>
>> Yes, I'm fairly sure the indexer does create a lock file to prevent
>> multiple instance treading on each other. If this happens it's not a
>> huge issue, the records the second indexer was attempting to add  
>> may or
>> may not end up in the delta index - if they didn't the next  
>> successful
>> indexer run will add them.
>>
>> With 10000 new records per hour the default delta method is  
>> probably not
>> appropriate for you. As your delta index grows with each new record  
>> your
>> rails actions will take longer and longer to complete.
>>
>> I recommend you read about the advanced delta techniques 
>> athttp://freelancing-god.github.com/ts/en/deltas.html
>>
>> -- James Healy <jimmy-at-deefa-dot-com>  Tue, 26 May 2009 11:05:18  
>> +1000
> >


--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups 
"Thinking Sphinx" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to 
[email protected]
For more options, visit this group at 
http://groups.google.com/group/thinking-sphinx?hl=en
-~----------~----~----~----~------~----~------~--~---

Reply via email to