Ok, so after poking around in the source code for a bit, I found an easy
way to trigger the delta indexing after the mass insert. Given that the
delta attribute of all the newly inserted records is true, you can simply
run:
ThinkingSphinx::Deltas::IndexJob.new('delta_index_name').perform
Are there any side effects or caveats with this approach that I should be
aware of?
On Tuesday, January 6, 2015 2:14:52 PM UTC-8, Andrea S. wrote:
>
> I have a very large main index and am using the SidekiqDelta adapter for
> delta indexing. A full re-index currently takes hours to complete.
>
> My current workflow consists of adding large amounts of data (often
> millions of rows of the indexed model) in optimized data import tasks that
> mass insert rows into the MySQL database directly, essentially
> side-stepping ActiveRecord. This way of adding new records does not trigger
> the delta indexing and I also wouldn't want to add the new records to the
> delta index one by one. I usually end up running a full re-index after data
> import, but this has become a bottleneck.
>
> Is there a command in Thinking Sphinx to add all the newly inserted
> records to the delta index all at once? Or should I use the indexer command
> directly? What would be the best way of handling this kind of situation
> (maybe even different kinds of indexes)?
>
> Thanks,
>
> Andrea
>
--
You received this message because you are subscribed to the Google Groups
"Thinking Sphinx" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/thinking-sphinx.
For more options, visit https://groups.google.com/d/optout.
