Searcher's bits of Wed, 21 Aug 2002 translated to: >My new problem is that I cannot index the several thousand URL's that >I have in our list. The process keeps terminating with a line 37
What do you mean by "list"? Is it a web page (either static or created by the web server) with thousands of links? If so, you might want to increase max_doc_size (http://www.htdig.org/attrs.html#max_doc_size). If you are using the default value, ht://Dig might be truncating the page. I am not sure if this would actually cause an error, but it might be worth checking. If your start_url is set to a text file with a list of URL's, then the number of URL's shouldn't be an issue unless you are running into some sort of hardware limitations. I have one setup that processes such a file with a list of roughly 80,000 URLs. >error in rundig, telling me that there is an error in the following >line, $BINDIR/htdig -a $opts $stats $alt. If you continue to have problems with the indexing, it might be helpful to provide the exact error message. Jim ------------------------------------------------------- This sf.net email is sponsored by: OSDN - Tired of that same old cell phone? Get a new here for FREE! https://www.inphonic.com/r.asp?r=sourceforge1&refcode1=vs3390 _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
