On Mon, Jun 09, 2003 at 06:04:35PM -0400, Kevin Breit wrote: > On Mon, 2003-06-09 at 17:13, Malcolm Austen wrote: > > ----- Original Message ----- > > From: "Kevin Breit" <[EMAIL PROTECTED]> > > Sent: Monday, June 09, 2003 8:51 PM > > > > : commented out the exclude_urls opinion in the conf file. When I rundig > > > > : Why are these urls being rejected? > > > > Because that's what you've asked it to do Kevin! You need to RTFM - > > commenting out the option gives you the default settings, not an empty > > exclude list. > > It sees to make no difference. If I have: exclude_urls: and nothing but > that, it still says that it's rejecting all the URLs.
Leave it as nothing (but dont' comment out the line) and then delete the database and start crawling from scratch. If you could also use -vvv that might give a few more clues. emma -- Emma Jane Hogbin [[ 416 417 2868 ][ www.xtrinsic.com ]] ------------------------------------------------------- This SF.net email is sponsored by: Etnus, makers of TotalView, The best thread debugger on the planet. Designed with thread debugging features you've never dreamed of, try TotalView 6 free at www.etnus.com. _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
