I'd be interested in hearing more about the symptoms of these "unreliable sphinx merges?" I have just started testing using the datetime delta, and at the end of the delta update, my indexes are consistently broken (i.e., before the delta update I can do searches, after the delta completes, all queries come up empty. They don't give any error).
Don't know if it matters, but the .spa file for my index is not updated after the merge, whereas all the other index files are updated. Getting this working -- along with a datetime delta that could consider child dependencies when deciding what to reindex -- would solve most of the important challenges we're facing with TS as we scale. For the record, the code I'm using to try to get the delta working is straight vanilla: set_property :delta => :datetime, :threshold => 1.day and rake thinking_sphinx:index:delta This is running in development mode with Mongrel, no special options setup in the sphinx.yml. Running Sphinx 0.9.8-release (r1371). It looks like the index is working, in that it takes a long time to process and it finds results proportional to the number of changed records. The "only problem" is that the indexes are broken and unusable afterwards... :) Bill On Feb 16, 12:49 am, Pat Allan <[email protected]> wrote: > Hi Morten > > I think there's definitely room for anotherdeltamethod - delayed but > with a manual rake call at regular intervals, likedatetime(and > hopefully the thinking_sphinx:index:deltatask can be re-used). At > this point it doesn't seem like merging is always reliable, so go for > it. > > Cheers > > -- > Pat > > On 14/02/2009, at 3:42 AM, Morten wrote: > > > > > Hey. I've been trying out variousdeltaindexing mechanisms on a > > moderately busy site. These are my findings: > > > :delta=> true, calls out to indexer immediately, not good when busy > > :delta=> :datetime, relies on sphinx merge which is unstable > > :delta=> :delayed, creates ~2 jobs each time a change is made, lots > > of overhead > > > I think :delta=> :datetimeis the "correct" solution for me, but I > > cannot rely on sphinx to do things right here. So I'm looking for a > > 4thdeltamechanism that doesn't make 1 save equal to 1 or more > > indexer calls and searchd SIGHUP's. > > > I'm considering implementing a :delta=> :bulk option which would be a > > cross between :delta=> true and :delta=> :delayed > > > What do people do in general on busy sites? Am I misinterpreting the > > currentdeltapossibilities or is there a reliable way to do bulk > >deltaupdating currently? > > > Thanks. --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Thinking Sphinx" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/thinking-sphinx?hl=en -~----------~----~----~----~------~----~------~--~---
