You may not need to understand how DocBuilder works. You can keep the batchSize high and index in batches . But for delta it is hard. because every batch will have to recalculate the delta rows.
Did you try creating a view in your DB and query that so that the queries do not consume so much time? On Wed, Nov 5, 2008 at 2:55 AM, sunnyfr <[EMAIL PROTECTED]> wrote: > > Hi Shalin, > Thanks for your answer. I tried to understand how work DocBuilder, didn't > get really where can I get the request from query and add at the end limit > ?? > What about this debug ??? Where can I find it ?? > Thanks a lot, > > > Shalin Shekhar Mangar wrote: >> >> Hi, >> >> Most of that happens in DocBuilder#buildDocument method. >> >> Solr 1.3 has a bug which does not let the "start" and "rows" parameter >> work >> in normal mode (they work only in debug mode). The trunk versions have >> that >> bug fixed which can be used to limit indexing. >> >> On Tue, Nov 4, 2008 at 6:49 PM, sunnyfr <[EMAIL PROTECTED]> wrote: >> >>> >>> Hi everybody >>> I'm using solr 1.3 and mysql, and the query is too big to get back rows >>> without OOM >>> I would to modify the code cuz I can't use batchSize -1 on the production >>> database during 10hours without stack other process on it. >>> >>> So I would like to make several request on it with a limit between a and >>> b >>> ... >>> I've the class jdbcdataimport which make the connection with mysql but I >>> just don't where can I find the class which collect the query or the >>> deltaQuery from data-config.xml. >>> >>> Thanks a lot for your help, >>> >>> -- >>> View this message in context: >>> http://www.nabble.com/dataimporthandler-where-is-the-class-chich-collect-query-and-deltaQuery-tp20322092p20322092.html >>> Sent from the Solr - Dev mailing list archive at Nabble.com. >>> >>> >> >> >> -- >> Regards, >> Shalin Shekhar Mangar. >> >> > > -- > View this message in context: > http://www.nabble.com/dataimporthandler-where-is-the-class-chich-collect-query-and-deltaQuery-tp20322092p20331492.html > Sent from the Solr - Dev mailing list archive at Nabble.com. > > -- --Noble Paul
