Hi Rajesh
I'd recommend updating Thinking Sphinx to the latest (and as of a week
or so ago, you can check versions by running 'rake ts:version').
More importantly, you should upgrade Sphinx to 0.9.8.1 - as I've read
reports that merging (which, to answer your first question, is done
automatically by the delta indexing task) is far more reliable in that
release.
As for your other questions:
2. The merge shifts all the delta data into the core index.
3. You shouldn't need to stop Sphinx when re-indexing -- only when you
change your index structure (ie: anything within your define_index
blocks or sphinx.yml file).
Cheers
--
Pat
On 08/06/2009, at 2:39 AM, Nilesh wrote:
>
> Hi Pat,
>
> Thanks for the reply. We are using the following:
> Thinking Sphinx 1.1.14
> Version cheked here: vendor/plugins/thinking-sphinx/thinking-
> sphinx.gemspec
> Gem::Specification.new do |s|
> s.name = %q{thinking-sphinx}
> s.version = "1.1.14"
> ...
>
> Sphinx 0.9.8
> Rails 2.1.2
> ruby 1.8.7
>
> I have the following queries from your previous reply:
> 1. With latest branch merge is not available - is it done
> automatically based on threshold specified ?
> 2. During threshold span is the item available in both "Main" as well
> as "Delta" untill you do the full re-index ?
> 3. Also, to re-index regularly I will have to put thinking sphinx
> down, which I cannot do frequently. And re-index takes long time as
> compared. What is good solution for me now?
>
>
> Thanks,
> Rajesh
>
>
> On Jun 7, 10:15 pm, Pat Allan <[email protected]> wrote:
>> Hi Rajesh
>>
>> What versions of Thinking Sphinx, Rails and - most importantly for
>> datetime deltas - Sphinx are you using? 0.9.8? 0.9.8.1? 0.9.9rc1?
>> 0.9.9rc2?
>>
>> Your setup seems correct - but you will still need to do a full re-
>> index regularly. Any approach to delta indexing does not remove that
>> need. As for merging, the datetime delta code takes care of that, so
>> it's not something you need to worry about. The .tmp files may be
>> related to your issue though.
>>
>> Cheers
>>
>> --
>> Pat
>>
>> On 05/06/2009, at 1:38 AM, Rajesh farkare wrote:
>>
>>> Hi Pat,
>>
>>> I am using thinking sphinx in one of my applications which is search
>>> based. It has lot of input every 15 minutes and needs to be indexed.
>>
>>> In my do_index I have:
>>
>>> set_property :delta => :datetime, :delta_column
>>> => :updated_at, :threshold => 22.minutes
>>
>>> I run the cron for delta 'rake thinking_sphinx:index:delta
>>> RAILS_ENV=production' every 20 minutes.
>>
>>> But the new data is not getting indexed in expected time.I see the
>>> new data in search results after a interval of 4-5 hours.
>>> Also, I have to explicitly reindex completely at times.
>>
>>> Not getting where exactly the problem is, am I missing anything? Do
>>> I need to do merge? I dont see 'merge' task in my rake list.
>>
>>> Also, I found some .tmp files created in the sphinx folder.I suspect
>>> if these are related to the problem in some way.
>>> Where can I find the significance of all these file types?
>>
>>> When I do
>>
>>> ls -l db/sphinx/production:
>>
>>> I see the following.
>>
>>> total 259136
>>> -rw-r--r-- 1 root root 7008576 Jun 4 09:20 item_core.spa
>>> -rw-r--r-- 1 root root 7102080 Jun 5 00:40 item_core.spa.tmp
>>> -rw-r--r-- 1 root root 96134630 Jun 4 09:20 item_core.spd
>>> -rw-r--r-- 1 root root 0 Jun 5 00:40 item_core.spd.tmp
>>> -rw-r--r-- 1 root root 347 Jun 4 09:20 item_core.sph
>>> -rw-r--r-- 1 root root 2687497 Jun 4 09:20 item_core.spi
>>> -rw-r--r-- 1 root root 0 Jun 5 00:40 item_core.spi.tmp
>>> -rw-r--r-- 1 root root 0 Jun 3 07:40 item_core.spk
>>> -rw------- 1 root root 0 Jun 5 00:40 item_core.spl
>>> -rw-r--r-- 1 root root 2628216 Jun 4 09:20 item_core.spm
>>> -rw-r--r-- 1 root root 2097152 Jun 5 00:40 item_core.spm.tmp
>>> -rw-r--r-- 1 root root 143840229 Jun 4 09:20 item_core.spp
>>> -rw-r--r-- 1 root root 0 Jun 5 00:40 item_core.spp.tmp
>>> -rw-r--r-- 1 root root 94240 Jun 5 00:40 item_delta.spa
>>> -rw-r--r-- 1 root root 1302450 Jun 5 00:40 item_delta.spd
>>> -rw-r--r-- 1 root root 347 Jun 5 00:40 item_delta.sph
>>> -rw-r--r-- 1 root root 171537 Jun 5 00:40 item_delta.spi
>>> -rw-r--r-- 1 root root 0 Jun 3 07:40 item_delta.spk
>>> -rw------- 1 root root 0 Jun 5 00:40 item_delta.spl
>>> -rw-r--r-- 1 root root 35340 Jun 5 00:40 item_delta.spm
>>> -rw-r--r-- 1 root root 1923426 Jun 5 00:40 item_delta.spp
>>
>>> --
>>> thanks & regards
>>
>>> Rajesh Farkare
>>> Pune
>>
>>> +91-9890301768
>
> >
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Thinking Sphinx" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/thinking-sphinx?hl=en
-~----------~----~----~----~------~----~------~--~---
