- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Adam
Subject: Re: Stored configuration problem ?
> At 10:40:23 26/07/06, Maxime wrote:
>First of all, if you have specified "DoStore yes" command in your configs, you
>do not need to specify sored parameter in DBAddr command, with "DoStore yes"
>command dpsearch works directly with stored database on disk (that possible if
>all are located on same PC, otherwise you need to remove DoStore commands)
>
>If a document have META.ROBOTS NOARCHIVE then such document will not be stored
>in database and it will impossible to make excerpts on it.
>
>Note: disabling clones detection in search.htm will allow to speed up searches.
Many thanks Maxime; I have checked carefully once more all my configurations
removing redundant DoStore commands and now everything seems to work fine.
This is true that ALL websites don't allow to archive their contents so about 5%
will always remain unavailable.
Now I have only the last problem with your last snapshot dated July 24th
as described in my message in "How To" section.
In fact it worked only once, the first test, with 20 documents (-n 20) and now
when *$
relaunching indexer with -z 0 option, indexer is exiting immediately but
without any specific error
and with no documents indexed ?
===============
# /usr/local/dpsearch/sbin/indexer -z 0 -n 10 -U -W -R -H -v5
[25199]{00} DpsOpenCache:
[25199]{00} i:0 cached_sd:0 sin_port:25115
[25199]{00} [127.0.0.1] PORT: 169,48, decimal:43312
[25199]{00} wrd_buf: 0
[25199]{00} Done.
[25199]{00} indexer from dpsearch-4.42-25072006-mysql started with
'/usr/local/dpsearch/etc/indexer.conf'
[25199]{00} Chinese dictionary with 0 entries
[25199]{00} Korean dictionary with 0 entries
[25199]{00} Thai dictionary with 0 entries
[25199]{00} mutexes used: 256
[4796]{01} Done (0 seconds, 0 documents, 0 bytes, 0.00 Kbytes/sec.)
[25199]{00} Total 1 seconds, 0 documents, 0 bytes, 0.00 Kbytes/sec, 0.00
sec/doc, 0 bytes/doc.
[25199]{00} Writing url data
[25199]{00} Writing url data and limits for mysql://dpsearch:[EMAIL
PROTECTED]/search/?dbmode=cache&cached=localhost:7000&stored=localhost:7004...
[25199]{00} url data and limits Done
[25199]{00} Flushing cached buffers
[25199]{00} Flushing cached buffers for mysql://dpsearch:[EMAIL
PROTECTED]/search/?dbmode=cache&cached=localhost:7000&stored=localhost:7004...
[25199]{00} Cached buffers flush Done
[25199]{00} PopRank caclulation
[25199]{00} 1 URLs processed
[25199]{00} Neo PopRank done: 1 URLs processed, total pas: 0
==================
However if you change to -z 1 indexer is starting to index correctly second
level pages but no homepages.
What could be the problem?
Should I wait for another snapshot or you know another solution ?
I would like really to avoid to have to reindex all contents from the beginning.
Also a small detail appearing in each output;
the part about Asian dictionaries:
[25199]{00} Chinese dictionary with 0 entries
[25199]{00} Korean dictionary with 0 entries
[25199]{00} Thai dictionary with 0 entries
Is it memory and/or execution time consuming ?
And if so how could I remove this option as I dont need Asian language support ?
Thanks in advance
Adam
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=03;topic_id=1153763307;reply=1153896023
