- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Jon
Subject: Re: Advised Settings for 26 Million+ Documents
I just ran 100K documents using dpsearch 4.44 and now get a Segfault when
running run-splitter.
[EMAIL PROTECTED] ~]# /usr/local/bwmsearch/sbin/indexer -S
cached[18240]: {00} [127.0.0.1] Connected. PORT: 134,251
cached[18240]: {200} Mon 12 13:20:39 [18240] Client thread started
Database statistics
Status Expired Total
-----------------------------
0 1677500 1677500 Not indexed yet
200 0 82371 OK
206 0 19 Partial OK
301 0 10 Moved Permanently
302 0 6090 Moved Temporarily
403 0 83 Forbidden
415 0 4581 Unsupported Media Type
2200 0 6812 Clones, OK
2206 0 34 Clones, Patial OK
-----------------------------
Total 1677500 1777500
cached[18240]: {200} Mon 12 13:20:42 [18240] Client action BYE received.
[EMAIL PROTECTED] ~]# /usr/local/bwmsearch/sbin/run-splitter -s -k
Runnig splitter -- verbose: 4, pause: 0
splitter[18274]: {00} Log 004 updated in 0.98 sec., ndel:0, nwrd:126976
/usr/local/bwmsearch/sbin/run-splitter: line 144: 18274 Segmentation fault
$SPLITTER -v $VERBOSE -p $PAUSE $OPTOPT -w $VAR
Done
Cached goes away and I have to start it again...
[EMAIL PROTECTED] ~]# /usr/local/bwmsearch/sbin/indexer -WTH
cached[18240]: {00} [127.0.0.1] Connected. PORT: 135,31
indexer[18293]: {00} indexer from dpsearch-4.44-pqsql, config test OK with
'/usr/local/bwmsearch/etc/indexer.conf'
indexer[18293]: {00} Writing url data and limits for pgsql://search:[EMAIL
PROTECTED]/bwmsearch/?dbmode=cache&cached=localhost:7000...
cached[18240]: {202} Mon 12 13:22:23 [18240] Client thread started
cached[18240]: {202} Writing url data and limits for pgsql://search:[EMAIL
PROTECTED]/bwmsearch/?dbmode=cache...
indexer[18293]: {00} url data and limits Done
indexer[18293]: {00} Flushing cached buffers for pgsql://search:[EMAIL
PROTECTED]/bwmsearch/?dbmode=cache&cached=localhost:7000...
Cached has gone away again...
Something is crashing cached. Any ideas?
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=02;topic_id=1170804868
