Pat, Thanks for the quick reply and the explanation of the status codes. Can you point me to some documentation on TS or Sphinx that describes the status codes?
There's no re-indexing going on except once a day via a cron task that won't run again for a few hours. After my last post I went back and spelunked the production search_debug log I created and noticed the following error message where :status => 1: error=>"index wall_post_core,wall_post_delta: no such filter attribute 'specialty_ids'" Looking into the code I saw that we were using a global set of attributes that didn't apply to every model we were searching. Will this cause sphinx to choke, or does it just announce the error and return results if it can? I looked at the log on my development machine and saw a :status => 3 for the same type of error on a different model. I'm confused as to why this type of problem is an error in one place and a warning in the other. Both production and development are using Sphinx 0.9.9 and TS 1.3.16. I'll post this on the sphinx group as well. Cheers, Chris On Jul 18, 11:46 pm, Pat Allan <[email protected]> wrote: > Hi Chris > > The status code has four possible values: 0, 1, 2, 3 - ok, error, retry, > warning, in that order. So, it seems that Sphinx is saying everything is > okay, yet not returning any results. > > I've no idea why it's doing this, but if you've created a thread on the > Sphinx forum, it's worth mentioning this there (or creating one if you've not > done so already). > > Is it possible that the 0 results coincides with re-indexing? What are you > doing with cron or similar tools for regular re-indexing? > > -- > Pat > > On 19/07/2010, at 4:08 PM, Chris McCann wrote: > > > Pat, > > > I was able to get some logging code installed on the staging server > > where we're experiencing this problem. In a nutshell, if the same > > search is repeated a second time after it's run and doesn't return any > > results the second run seems to almost always return results. > > > Here is sample output from the .results method when searching the user > > model and getting nothing (there should be 17 matches): > > > 2010-07-19 05:35:42 INFO > >>>> User: > > {:time=>0.0, :status=>0, :words=>{}, > > > :attribute_names=>["sphinx_internal_id", "class_crc", "subclass_crcs", > > "sphinx_deleted", "user_id", "specialty_ids", "geographic_focus_ids", > > "product_type_ids", "target_market_ids", "created_at", "updated_at", > > "activated_at"], > > > :fields=>["email", "first_name", "last_name", "biography", "company", > > "title", "location", "specialty_name", "geographic_name", > > "target_market_name", "product_type_name"], > > > :attributes=>{"geographic_focus_ids"=>1073741825, "activated_at"=>2, > > "created_at"=>2, "specialty_ids"=>1073741825, "updated_at"=>2, > > "sphinx_deleted"=>1, "user_id"=>1, "subclass_crcs"=>1073741825, > > "target_market_ids"=>1073741825, "product_type_ids"=>1073741825, > > "class_crc"=>1, "sphinx_internal_id"=>1}, > > > :matches=>[], :total_found=>0, :total=>0} > > > And here's the same search a moment later, returning 17 results: > > > 2010-07-19 05:38:29 INFO > >>>> User: > > {:time=>0.0, :status=>0, :words=>{}, > > :attribute_names=>["sphinx_internal_id", "class_crc", "subclass_crcs", > > "sphinx_deleted", "user_id", "specialty_ids", "geographic_focus_ids", > > "product_type_ids", "target_market_ids", "created_at", "updated_at", > > "activated_at"], > > > :fields=>["email", "first_name", "last_name", "biography", "company", > > "title", "location", "specialty_name", "geographic_name", > > "target_market_name", "product_type_name"], > > > :attributes=>{"geographic_focus_ids"=>1073741825, "activated_at"=>2, > > "created_at"=>2, "specialty_ids"=>1073741825, "updated_at"=>2, > > "sphinx_deleted"=>1, "user_id"=>1, "subclass_crcs"=>1073741825, > > "target_market_ids"=>1073741825, "product_type_ids"=>1073741825, > > "class_crc"=>1, "sphinx_internal_id"=>1}, > > > :matches=>[{:doc=>203, :weight=>1, :attributes=>{"geographic_focus_ids"=>[2, > > 3], "activated_at"=>1279257375, "created_at"=>1279257336, > > "specialty_ids"=>[1, 40], "updated_at"=>1279353426, > > "sphinx_deleted"=>0, "user_id"=>40, "subclass_crcs"=>[765557111], > > "target_market_ids"=>[1, 2, 3], "product_type_ids"=>[1, 2, 3], > > "class_crc"=>765557111, "sphinx_internal_id"=>40}, :index=>0}, > > {:doc=>198, :weight=>1, :attributes=>{"geographic_focus_ids"=>[2, 9], > > "activated_at"=>1279256766, "created_at"=>1279256738, > > "specialty_ids"=>[1, 2, 12, 14], "updated_at"=>1279256776, > > "sphinx_deleted"=>0, "user_id"=>39, "subclass_crcs"=>[765557111], > > "target_market_ids"=>[1], "product_type_ids"=>[4, 5], > > "class_crc"=>765557111, "sphinx_internal_id"=>39}, :index=>1}, > > {:doc=>193, :weight=>1, :attributes=>{"geographic_focus_ids"=>[2, 9], > > "activated_at"=>1279238381, "created_at"=>1279238360, > > "specialty_ids"=>[1], "updated_at"=>1279238401, "sphinx_deleted"=>0, > > "user_id"=>38, "subclass_crcs"=>[765557111], "target_market_ids"=>[1], > > "product_type_ids"=>[4], "class_crc"=>765557111, > > "sphinx_internal_id"=>38}, :index=>2}, > > {:doc=>183, :weight=>1, :attributes=>{"geographic_focus_ids"=>[2, 9], > > "activated_at"=>1278668949, "created_at"=>1278668941, > > "specialty_ids"=>[1, 2, 12, 14], "updated_at"=>1279238030, > > "sphinx_deleted"=>0, "user_id"=>36, "subclass_crcs"=>[765557111], > > "target_market_ids"=>[1, 2], "product_type_ids"=>[1, 3], > > "class_crc"=>765557111, "sphinx_internal_id"=>36}, :index=>3}, > > {:doc=>173, :weight=>1, :attributes=>{"geographic_focus_ids"=>[2, 4, > > 8, 11, 13], "activated_at"=>1278550287, "created_at"=>1278550261, > > "specialty_ids"=>[1, 2, 3, 4, 12, 13, 15, 17, 18, 25, 28, 36], > > "updated_at"=>1278550373, "sphinx_deleted"=>0, "user_id"=>34, > > "subclass_crcs"=>[765557111], "target_market_ids"=>[1, 2, 3, 4, 5], > > "product_type_ids"=>[1, 4, 5, 6, 9], "class_crc"=>765557111, > > "sphinx_internal_id"=>34}, :index=>4}, > > {:doc=>158, :weight=>1, :attributes=>{"geographic_focus_ids"=>[2], > > "activated_at"=>1276169658, "created_at"=>1276169635, > > "specialty_ids"=>[1], "updated_at"=>1276169663, "sphinx_deleted"=>0, > > "user_id"=>31, "subclass_crcs"=>[765557111], "target_market_ids"=>[1, > > 2, 3, 4, 5], "product_type_ids"=>[1], "class_crc"=>765557111, > > "sphinx_internal_id"=>31}, :index=>5}, > > {:doc=>138, :weight=>1, :attributes=>{"geographic_focus_ids"=>[2], > > "activated_at"=>1275343055, "created_at"=>1275343040, > > "specialty_ids"=>[1], "updated_at"=>1279265282, "sphinx_deleted"=>0, > > "user_id"=>27, "subclass_crcs"=>[765557111], "target_market_ids"=>[1, > > 2, 3, 4, 5], "product_type_ids"=>[3], "class_crc"=>765557111, > > "sphinx_internal_id"=>27}, :index=>6}, > > {:doc=>113, :weight=>1, :attributes=>{"geographic_focus_ids"=>[0], > > "activated_at"=>1275028713, "created_at"=>1275028670, > > "specialty_ids"=>[1], "updated_at"=>1275028793, "sphinx_deleted"=>0, > > "user_id"=>22, "subclass_crcs"=>[765557111], "target_market_ids"=>[0], > > "product_type_ids"=>[0], "class_crc"=>765557111, > > "sphinx_internal_id"=>22}, :index=>7}, > > {:doc=>103, :weight=>1, :attributes=>{"geographic_focus_ids"=>[5], > > "activated_at"=>1274861509, "created_at"=>1274861487, > > "specialty_ids"=>[1, 3], "updated_at"=>1279237832, > > "sphinx_deleted"=>0, "user_id"=>20, "subclass_crcs"=>[765557111], > > "target_market_ids"=>[5], "product_type_ids"=>[4], > > "class_crc"=>765557111, "sphinx_internal_id"=>20}, :index=>8}, > > {:doc=>88, :weight=>1, :attributes=>{"geographic_focus_ids"=>[2, 8], > > "activated_at"=>1272584976, "created_at"=>1272584956, > > "specialty_ids"=>[1, 2, 5], "updated_at"=>1272585002, > > "sphinx_deleted"=>0, "user_id"=>17, "subclass_crcs"=>[765557111], > > "target_market_ids"=>[3, 4, 5], "product_type_ids"=>[1, 2, 11], > > "class_crc"=>765557111, "sphinx_internal_id"=>17}, :index=>9}], > > > :total_found=>17, :total=>17} > > > One thing I noticed is that the :status value is 0 for both the failed > > and successful search. From looking at the other log entries it seems > > like :status => 0 means results were found. Can you enlighten me on > > what :status means? > > > Again, thanks for taking a look at this for me. Let me know if you > > have any other suggestions. > > > On Jul 11, 6:25 am, Pat Allan <[email protected]> wrote: > >> Hi Chris > > >> .results is a hash, and the most relevant key is :matches, which is an > >> array of hashes containing the information about the matching documents. > >> So that's the first thing to check (ie: if that's empty, then it's not a > >> TS bug). There may also be warnings/errors - I'm not sure if that'll > >> appear in .results, but it *should* appear in the logs, so that's another > >> good place to look. > > >> Cheers > > >> -- > >> Pat > > >> On 11/07/2010, at 3:23 PM, Chris McCann wrote: > > >>> Pat, > > >>> I've added the .results output to the logging I'm doing but I'm not > >>> sure what I should be looking for. If you were trying to solve this > >>> problem what would you hope to see in that output that would point out > >>> potential issues? > > >>> Thanks, > > >>> Chris > > >>> On Jul 9, 8:41 am, Pat Allan <[email protected]> wrote: > >>>> Hi Chris > > >>>> Unfortunately, I've never seen this problem before... it's certainly an > >>>> odd one. I know it's probably hard to reproduce, but if you can log what > >>>> the value of Model.search(args).results is, that'd be fantastic - as > >>>> that's the raw Sphinx results (as a bundle of hashes and arrays), and > >>>> should confirm whether the problem is happening in TS or Sphinx - though > >>>> I'm pretty certain it's the latter. > > >>>> It's probably worth searching/asking on the Sphinx forums as > >>>> well:http://sphinxsearch.com/forum/forum.html?id=1 > > >>>> Good luck! > > >>>> -- > >>>> Pat > > >>>> On 09/07/2010, at 4:48 PM, Chris McCann wrote: > > >>>>> We're having an issue in a Rails 2.3.5 app with thinking_sphinx 1.3.16 > >>>>> in terms of inconsistent search results for the same inputs to TS. > >>>>> We're using MySQL 5.1.41. > > >>>>> I've checked the parameters passed into the model's .search() method > >>>>> on every call. With identical inputs the correct results are usually > >>>>> returned, but on occasion some of the expected results will be > >>>>> missing. This is on a development database that only I am hitting, so > >>>>> there's nothing happening to the underlying data between these search > >>>>> calls. > > >>>>> The development log also shows that sphinx is returning different > >>>>> results from the same inputs (my debug statements prefaced with >>>): > > >>>>>>>> search_options => {:page=>1, :per_page=>10, :sort_mode=>:desc, > >>>>>>>> :order=>"created_at", :with=>{:specialty_ids=>[29], > >>>>>>>> :location_ids=>[6, 2, 3, 4, 5]}} > > >>>>> Sphinx Querying: '' > >>>>> Sphinx (0.002381s) Found 4 results > > >>>>>>>> search_options => {:page=>1, :per_page=>10, :sort_mode=>:desc, > >>>>>>>> :order=>"created_at", :with=>{:specialty_ids=>[29], > >>>>>>>> :location_ids=>[6, 2, 3, 4, 5]}} > > >>>>> Sphinx Querying: '' > >>>>> Sphinx (0.002279s) Found 0 results > > >>>>> We are using the :retry_stale => true setting as well. > > >>>>> I'm at a loss for how to spelunk into the thinking_sphinx code to sort > >>>>> out what's going wrong. If anyone has seen this behavior I'd love to > >>>>> hear what you did to fix or investigate it. If not, any suggestions > >>>>> for a way forward to sort > > ... > > read more » -- You received this message because you are subscribed to the Google Groups "Thinking Sphinx" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/thinking-sphinx?hl=en.
