- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Francesco Caccavella
Subject: How to improve indexing speed
I manage a network of site which contains about 60.000 documents. Since now I
used Aspseek to index my documents and show the search functions to my user.
I'd like to switch do Datapark baecause of better options, better releases and
better pagerank calculation. But ...
But yesterday I begin to index my network and, after 9 hours, the indexer not
complete the index
indexer[6931]: {05} Done (32601 seconds, 8618 documents, 59733492 bytes, 1.79
Kbytes/sec.)
indexer[6923]: {01} Done (32599 seconds, 8512 documents, 58799938 bytes, 1.76
Kbytes/sec.)
indexer[6929]: {04} Done (32599 seconds, 8358 documents, 59475848 bytes, 1.78
Kbytes/sec.)
indexer[6927]: {03} Done (32599 seconds, 8433 documents, 59587215 bytes, 1.79
Kbytes/sec.)
indexer[6925]: {02} Done (32599 seconds, 8293 documents, 58930462 bytes, 1.77
Kbytes/sec.)
indexer[6916]: {00} Total 32601 seconds, 42214 documents, 296526955 bytes,
8.88 Kbytes/sec, 1.29 doc/sec, 7024 bytes/doc.
Aspseek is able to index the whole site in about 3 hours.
My question is: Datapark is so slow (compared to Aspseek) or I failed to
configure some options? Which are the options in the config files that are able
to speed up the indexing?
Regards, Francesco.
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=03;post=