- - - - - - - - - - - - - - - - - - - - - - - - - - - - Name: Maxime Subject: Re: Slow Indexing
1. Maximum kniw amount of urls indexed is about 1.7 mln. 2. That is normal, in the begining from fresh databases each page indexed ususlay add several dozen new urls with status 0. 3. You may run indexer with -s0 switch, this tells to index only new urls with status 0. Also, if you has built dpsearch with pthreads suport, you may run several indexing threads using -N switch from indexer. Please note, by default each indexing threads makes own connection to the DB, if you need to use one sharable DB connection, you should add -U switch for indexer. - - - - - - - - - - - - - - - - - - - - - - - - - - - - Read the full topic here: http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=02;topic_id=1135562478
