There's nothing built into Thinking Sphinx to do this in batches, but it's something you could perhaps investigate. The code in ts-delayed-delta isn't super complex, so maybe it's worth modifying it to behave in a way that suits your app?
Not sure why things are slow, but given it's sending updates to Sphinx, it could be IO related? Or memory related, as Sphinx stores attribute values in RAM… or load related generally, not sure how great Sphinx is at managing high levels of attribute updates in small timeframes. Or maybe it's something else on the machine that's slowing things down? -- Pat On 28/08/2012, at 5:49 AM, Ngan wrote: > The TS Delta jobs get backed up sometimes, mostly the FlagAsDeletedJob. > > Just curious of there's anything I should be looking out for or any way to do > these jobs in batches? > > Thanks! > > > -- > You received this message because you are subscribed to the Google Groups > "Thinking Sphinx" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/thinking-sphinx/-/ZHGhdJMR7V0J. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/thinking-sphinx?hl=en. -- You received this message because you are subscribed to the Google Groups "Thinking Sphinx" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/thinking-sphinx?hl=en.
