When using a different delta method, will there be no file locking?
On May 25, 9:11 pm, James Healy <[email protected]> wrote:
> Elad Meidar wrote:
> > My thinking_Sphinx installation indexes a table that is updated VERY
> > OFTEN and ~10000 new records are created per hour, never deleted,
> > never changed.
>
> > If i get this right, Thinking sphinx is invoking an 'indexer' process
> > (http://pastie.org/489390.txt) every time a delta record is created
> > (http://github.com/freelancing-god/thinking-sphinx/blob/
> > cd9cf7bd1dea7b097b8e7236ca5617f68dc0ab49/lib/thinking_sphinx/deltas/
> > default_delta.rb#L20).
>
> > now my question is, is it possible that this process is locking the
> > file status_update_delta.tmp.spl when it's running? (and if it runs
> > for every delta, i assume it's almost always running)
>
> Yes, I'm fairly sure the indexer does create a lock file to prevent
> multiple instance treading on each other. If this happens it's not a
> huge issue, the records the second indexer was attempting to add may or
> may not end up in the delta index - if they didn't the next successful
> indexer run will add them.
>
> With 10000 new records per hour the default delta method is probably not
> appropriate for you. As your delta index grows with each new record your
> rails actions will take longer and longer to complete.
>
> I recommend you read about the advanced delta techniques
> athttp://freelancing-god.github.com/ts/en/deltas.html
>
> -- James Healy <jimmy-at-deefa-dot-com> Tue, 26 May 2009 11:05:18 +1000
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Thinking Sphinx" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/thinking-sphinx?hl=en
-~----------~----~----~----~------~----~------~--~---
