Wow, something's really going wrong there with the sql_query_pre SQL statements... can you copy and paste the ones from the klass_core_1 source?
-- Pat On 15/10/2009, at 7:51 PM, rejeep wrote: > > Sorry for the late reply. > > Here's the log: > Sphinx 0.9.9-rc2 (r1785) > Copyright (c) 2001-2009, Andrew Aksyonoff > > using config file '/home/rejeep/dev/closing/config/ > test.sphinx.conf'... > indexing index 'klass_core'... > ERROR: index 'klass_core': sql_query_pre[0]: Lock wait timeout > exceeded; try restarting transaction (DSN=mysql:// > closing:*...@localhost:3306/closing_test). > total 0 docs, 0 bytes > total 51.825 sec, 0 bytes/sec, 0.00 docs/sec > indexing index 'klass_delta'... > collected 0 docs, 0.0 MB > collected 0 attr values > sorted 0.0 Mvalues, nan% done > total 0 docs, 0 bytes > total 0.005 sec, 0 bytes/sec, 0.00 docs/sec > distributed index 'klass' can not be directly indexed; skipping. > indexing index 'interface_core'... > ERROR: index 'interface_core': sql_query_pre[0]: Lock wait timeout > exceeded; try restarting transaction (DSN=mysql:// > closing:*...@localhost:3306/closing_test). > total 0 docs, 0 bytes > total 50.052 sec, 0 bytes/sec, 0.00 docs/sec > indexing index 'interface_delta'... > collected 0 docs, 0.0 MB > collected 0 attr values > sorted 0.0 Mvalues, nan% done > total 0 docs, 0 bytes > total 0.005 sec, 0 bytes/sec, 0.00 docs/sec > distributed index 'interface' can not be directly indexed; skipping. > indexing index 'enum_core'... > ERROR: index 'enum_core': sql_query_pre[0]: Lock wait timeout > exceeded; try restarting transaction (DSN=mysql:// > closing:*...@localhost:3306/closing_test). > total 0 docs, 0 bytes > total 51.055 sec, 0 bytes/sec, 0.00 docs/sec > indexing index 'enum_delta'... > collected 0 docs, 0.0 MB > collected 0 attr values > sorted 0.0 Mvalues, nan% done > total 0 docs, 0 bytes > total 0.005 sec, 0 bytes/sec, 0.00 docs/sec > distributed index 'enum' can not be directly indexed; skipping. > indexing index 'annotation_core'... > ERROR: index 'annotation_core': sql_query_pre[0]: Lock wait timeout > exceeded; try restarting transaction (DSN=mysql:// > closing:*...@localhost:3306/closing_test). > total 0 docs, 0 bytes > total 51.058 sec, 0 bytes/sec, 0.00 docs/sec > indexing index 'annotation_delta'... > collected 0 docs, 0.0 MB > collected 0 attr values > sorted 0.0 Mvalues, nan% done > total 0 docs, 0 bytes > total 0.005 sec, 0 bytes/sec, 0.00 docs/sec > distributed index 'annotation' can not be directly indexed; skipping. > total 4 reads, 0.000 sec, 32.0 kb/call avg, 0.0 msec/call avg > total 16 writes, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg > rotating indices: succesfully sent SIGHUP to searchd (pid=11305). > Loaded suite /usr/bin/rake > > On Oct 11, 8:44 pm, Pat Allan <[email protected]> wrote: >> Right. Can you show me the output when it's running slowly? >> >> -- >> Pat >> >> On 11/10/2009, at 7:09 PM, rejeep wrote: >> >> >> >>> That is not slow at all. But that's because the database does not >>> contain any records. But if I create a record from a factory in the >>> test and then run the rake task, also from the test, it will take >>> forever. >> >>> On Oct 11, 1:36 pm, Pat Allan <[email protected]> wrote: >>>> Either I'm missing it, or there isn't actually any data being >>>> indexed >>>> (nor does it seem to be running slowly). What's the output (and how >>>> are you running it) when it *is* running slowly? >> >>>> -- >>>> Pat >> >>>> On 10/10/2009, at 1:28 PM, rejeep wrote: >> >>>>> The test database is exactly the same as the development. I don't >>>>> know >>>>> if it matters, but it's a cucumber test, so it's actually the >>>>> cucumber >>>>> environment. But that environment is only linking to test, so it >>>>> should be exactly the same. >> >>>>> $ rake ts:in RAILS_ENV=test >>>>> (in /home/rejeep/dev/closing) >>>>> Generating Configuration to /home/rejeep/dev/closing/config/ >>>>> test.sphinx.conf >>>>> Sphinx 0.9.9-rc2 (r1785) >>>>> Copyright (c) 2001-2009, Andrew Aksyonoff >> >>>>> using config file '/home/rejeep/dev/closing/config/ >>>>> test.sphinx.conf'... >>>>> indexing index 'klass_core'... >>>>> collected 0 docs, 0.0 MB >>>>> collected 0 attr values >>>>> sorted 0.0 Mvalues, nan% done >>>>> total 0 docs, 0 bytes >>>>> total 0.005 sec, 0 bytes/sec, 0.00 docs/sec >>>>> indexing index 'klass_delta'... >>>>> collected 0 docs, 0.0 MB >>>>> collected 0 attr values >>>>> sorted 0.0 Mvalues, nan% done >>>>> total 0 docs, 0 bytes >>>>> total 0.001 sec, 0 bytes/sec, 0.00 docs/sec >>>>> distributed index 'klass' can not be directly indexed; skipping. >>>>> indexing index 'interface_core'... >>>>> collected 0 docs, 0.0 MB >>>>> collected 0 attr values >>>>> sorted 0.0 Mvalues, nan% done >>>>> total 0 docs, 0 bytes >>>>> total 0.002 sec, 0 bytes/sec, 0.00 docs/sec >>>>> indexing index 'interface_delta'... >>>>> collected 0 docs, 0.0 MB >>>>> collected 0 attr values >>>>> sorted 0.0 Mvalues, nan% done >>>>> total 0 docs, 0 bytes >>>>> total 0.001 sec, 0 bytes/sec, 0.00 docs/sec >>>>> distributed index 'interface' can not be directly indexed; >>>>> skipping. >>>>> indexing index 'enum_core'... >>>>> collected 0 docs, 0.0 MB >>>>> collected 0 attr values >>>>> sorted 0.0 Mvalues, nan% done >>>>> total 0 docs, 0 bytes >>>>> total 0.001 sec, 0 bytes/sec, 0.00 docs/sec >>>>> indexing index 'enum_delta'... >>>>> collected 0 docs, 0.0 MB >>>>> collected 0 attr values >>>>> sorted 0.0 Mvalues, nan% done >>>>> total 0 docs, 0 bytes >>>>> total 0.001 sec, 0 bytes/sec, 0.00 docs/sec >>>>> distributed index 'enum' can not be directly indexed; skipping. >>>>> indexing index 'annotation_core'... >>>>> collected 0 docs, 0.0 MB >>>>> collected 0 attr values >>>>> sorted 0.0 Mvalues, nan% done >>>>> total 0 docs, 0 bytes >>>>> total 0.001 sec, 0 bytes/sec, 0.00 docs/sec >>>>> indexing index 'annotation_delta'... >>>>> collected 0 docs, 0.0 MB >>>>> collected 0 attr values >>>>> sorted 0.0 Mvalues, nan% done >>>>> total 0 docs, 0 bytes >>>>> total 0.002 sec, 0 bytes/sec, 0.00 docs/sec >>>>> distributed index 'annotation' can not be directly indexed; >>>>> skipping. >>>>> total 8 reads, 0.000 sec, 32.0 kb/call avg, 0.0 msec/call avg >>>>> total 32 writes, 0.001 sec, 0.0 kb/call avg, 0.0 msec/call avg >>>>> Loaded suite /usr/bin/rake >>>>> Started >> >>>>> Finished in 0.000242 seconds. >> >>>>> 0 tests, 0 assertions, 0 failures, 0 errors >> >>>>> On Oct 10, 10:42 am, Pat Allan <[email protected]> wrote: >>>>>> If there's only one record, then it shouldn't matter what your >>>>>> range >>>>>> step is, because Sphinx finds the smallest and largest ids >>>>>> available - >>>>>> which in this case, are the same number. >> >>>>>> Do you have all the same database indexes on your test db and >>>>>> development db? What's the output of rake ts:in RAILS_ENV=test? >> >>>>>> -- >>>>>> Pat >> >>>>>> On 09/10/2009, at 8:00 PM, rejeep wrote: >> >>>>>>> I didn't mean that I was trying to index a single record. What I >>>>>>> meant >>>>>>> was that I only had one record in the database for that test. So >>>>>>> even >>>>>>> if there would be some high index, I guess it wouldn't take to >>>>>>> long >>>>>>> anyway. >> >>>>>>> If I try with this conf: >>>>>>> development: >>>>>>> sql_range_step: 1000 >>>>>>> production: >>>>>>> sql_range_step: 1000 >>>>>>> test: >>>>>>> sql_range_step: 1000 >> >>>>>>> It's fast in development, but equally slow in test. >> >>>>>>> It doesn't matter if I use 1000 or 10000000 for sql_range_step. >> >>>>>>> On Oct 9, 5:43 pm, Pat Allan <[email protected]> wrote: >>>>>>>> Hi Rejeep >> >>>>>>>> Sphinx doesn't allow you to process a single record - only a >>>>>>>> full >>>>>>>> index. Also, do you have sql_range_step set for the test >>>>>>>> environment, >>>>>>>> as well as the development environment? >> >>>>>>>> -- >>>>>>>> Pat >> >>>>>>>> On 09/10/2009, at 11:53 AM, rejeep wrote: >> >>>>>>>>> Hi! >> >>>>>>>>> I have a site where I want to test the search. From the test I >>>>>>>>> create >>>>>>>>> the records and then create the index. But it's so slow that >>>>>>>>> it >>>>>>>>> times >>>>>>>>> out. Yes, I'm using factories and I am aware of the id >>>>>>>>> problem. >>>>>>>>> But >>>>>>>>> first of all. In the test I only want to index 1 record. And >>>>>>>>> the >>>>>>>>> id of >>>>>>>>> that usually is between 1000 - 5000. So that should not be >>>>>>>>> such a >>>>>>>>> big >>>>>>>>> problem, right? And even thought I set sql_range_step, it is >>>>>>>>> still >>>>>>>>> slow. >> >>>>>>>>> Since it is super fast in development the only thing I could >>>>>>>>> think >>>>>>>>> be >>>>>>>>> the problem was the id's. But since it's not. Does someone has >>>>>>>>> any >>>>>>>>> other suggestion? >> >>>>>>>>> If I skip creating any records before the indexing in the >>>>>>>>> test. >>>>>>>>> Then >>>>>>>>> the indexing is fast. >> >> > > --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Thinking Sphinx" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/thinking-sphinx?hl=en -~----------~----~----~----~------~----~------~--~---
