I have a very large main index and am using the SidekiqDelta adapter for delta indexing. A full re-index currently takes hours to complete.
My current workflow consists of adding large amounts of data (often millions of rows of the indexed model) in optimized data import tasks that mass insert rows into the MySQL database directly, essentially side-stepping ActiveRecord. This way of adding new records does not trigger the delta indexing and I also wouldn't want to add the new records to the delta index one by one. I usually end up running a full re-index after data import, but this has become a bottleneck. Is there a command in Thinking Sphinx to add all the newly inserted records to the delta index all at once? Or should I use the indexer command directly? What would be the best way of handling this kind of situation (maybe even different kinds of indexes)? Thanks, Andrea -- You received this message because you are subscribed to the Google Groups "Thinking Sphinx" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/thinking-sphinx. For more options, visit https://groups.google.com/d/optout.
