Hello, I've an index file (index.html) containing lots of URLs (more than 2000) that I use as start_url.
Now If I examine the log file (running htdig in verbose mode: -vvv) it appears to be that htdig stops indexing at "URL number 1625" Part of the log: ... ... ... +A tag: pos = 2, position = ="http://www.websit.com/URL1624";> href: http://www.websit.com/URL1625 (Name URL ) resolving 'http://www.websit.com/URL1625' pushing http://www.websit.com/URL1625 + size = 265262 ... ... ... Now it should continue with 1626, however it does not. It's start examening the first URL on stack: URL1 Is there a parameter that sets the max number of URL's per page? If so what's it called? By the way: The "server_max_docs" parameter is not set in htdig.conf, so I assume it's the default: -1 (no limit) ------------------------------------------------------- This sf.net email is sponsored by: Dice - The leading online job board for high-tech professionals. Search and apply for tech jobs today! http://seeker.dice.com/seeker.epl?rel_code=31 _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
