Hi Pat,
Thanks so much for the response! The number of records actually does not
appear to fully match, as a count on active entries returns 20,515,798.
Also, after having my normal cron job that re-indexes run this morning, I
noticed that the number of records collected is the exact same as before
(19,940,635). Is there a limit to the number of records Sphinx can handle,
or any other common scenarios that could be preventing new entries from
getting included in the indexing?
As for the delta indexes, we actually removed these a while ago from the
index definition as they were causing some headaches. Our configuration
file still includes the delta block, but this has never seemed to be an
issue in indexing. I could remove the delta info from the config file
(something I've actually been meaning to do), but I didn't want to
introduce more variables into what might have changed while trying to
trouble shoot this issue.
Here is the search call, even though the record counts don't match, just in
case it is helpful at all in continuing to try and figure this out:
filters = {
:journal_id => journal_ids,
:status_id => Status.active.id
}
# Check to see if we are ordering in a specific way
params[:order] ||= '@relevance DESC'
case params[:order]
when 'cad'
order = 'created_at DESC'
when 'ca'
order = 'created_at ASC'
else
order = '@relevance DESC'
end
entries = Entry.search params[:criteria], :with => filters, :sort_mode
=> :extended, :order => order
Thanks again,
Simon
On Wednesday, 30 November 2016 07:29:36 UTC-5, Pat Allan wrote:
>
> Hi Simon,
>
> I guess the first place I’d start is by verifying the number of records
> you’re expecting Sphinx to index. The log you shared says 19,940,635 - does
> that match Entry.count(:conditions => {:status_id => Status.active.id})?
>
> Also: the indexing output suggests there’s a delta index, but that’s not
> in the index definition - removed for brevity?
>
> And if the counts match, then can you share the search call you’re running
> to confirm newer records are not appearing?
>
> Cheers,
>
> —
> Pat
>
> On 30 Nov. 2016, at 12:40 am, Simon <[email protected] <javascript:>>
> wrote:
>
> Hi,
>
> I'm having an issue that just started recently. Indexing appears to
> complete successfully, but new entries are not appearing in search results
> (older entries appear).
>
> This seems to have started after I tried a rake ts:rebuild instead of what
> I normally used (rake ts.reindex). I have since switched back to a reindex,
> but still nothing new seems to be getting picked up. Unfortunately I am
> running an older version of Ruby (1.8.7), Rails (2.3.18) and Sphinx (Sphinx
> 1.10-beta (r2420)).
>
> My model definition is as follows:
>
> define_index do
> indexes title
> indexes body
> has journal_id
> has created_at, opened_at, status_id
>
> where "status_id = #{Status.active.id}"
> end
>
> The output of calling rake ts:reindex is:
>
> Sphinx 1.10-beta (r2420)
>
> Copyright (c) 2001-2010, Andrew Aksyonoff
>
> Copyright (c) 2008-2010, Sphinx Technologies Inc (http://sphinxsearch.com)
>
>
> using config file
> '/home/ubuntu/rails/penzu/config/pandora_readonly.sphinx.conf'...
>
> indexing index 'entry_core'...
>
> collected 19940635 docs, 34535.3 MB
>
> WARNING: sort_hits: merge_block_size=224 kb too low, increasing mem_limit
> may improve performance
>
> sorted 6182.9 Mhits, 100.0% done
>
> total 19940635 docs, 34535317325 bytes
>
> total 16953.201 sec, 2037097 bytes/sec, 1176.21 docs/sec
>
> indexing index 'entry_delta'...
>
> collected 0 docs, 0.0 MB
>
> total 0 docs, 0 bytes
>
> total 0.155 sec, 0 bytes/sec, 0.00 docs/sec
>
> skipping non-plain index 'entry'...
>
> total 92992 reads, 1534.381 sec, 228.9 kb/call avg, 16.5 msec/call avg
>
> total 40583 writes, 192.954 sec, 1042.6 kb/call avg, 4.7 msec/call avg
>
> rotating indices: succesfully sent SIGHUP to searchd (pid=3802).
>
> So it all appears successful, but no new results appear. So for instance,
> if i add a new entry, and then call reindex, that entry is not found in
> search results. But an entry with the same search term from a month ago
> does appear in the results.
>
> I have tried a complete rake ts:index, I have tried deleting all of the
> generated index files (entry_core.spp, entry_core.spi, etc.) but nothing
> seems to make a difference. Does anybody have any ideas what might be
> happening here, or any other suggestions for what I can try?
>
> Thanks,
> Simon
>
> --
> You received this message because you are subscribed to the Google Groups
> "Thinking Sphinx" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected] <javascript:>.
> To post to this group, send email to [email protected]
> <javascript:>.
> Visit this group at https://groups.google.com/group/thinking-sphinx.
> For more options, visit https://groups.google.com/d/optout.
>
>
>
--
You received this message because you are subscribed to the Google Groups
"Thinking Sphinx" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/thinking-sphinx.
For more options, visit https://groups.google.com/d/optout.
