> Douglas, > > I found this article: > http://www.mail-archive.com/[EMAIL PROTECTED]/msg07789.html > which actually applies to 3.2.0b5, which seems to be the version you are > using. I downloaded 3.2.0b5 and compared: > /mypath/to/htdig/source/code/Server.cc (in 3.2.0b4) with > /mypath/to/htdig/source/code/Server.cc (in 3.2.0b5) > with the patch suggested by Gilles in the msg07789 message. > > I don't know C++, but I know C. I compared the three until I thought I > understood the source code, and basically bodged the three together, > recompiled 3.2.0b4, and it worked. > > You may be able to use the latest snapshot of 3.2.0b5, without the > compare-and-bodge. :-)
> >>>Robots.txt line: User-agent: * > >>> > >>>Found 'user-agent' line: * > >>> > >>>Pattern: > >>> pushed > >>> Rejected: forbidden by server robots.txt! > >>> > >>> > >>>The site which includes the pages I wish to index has a robots.txt file wi t > >> > > h > > > >>>the line > >>> > >>>User-agent: * > >>> > >>>This should permit indexing by htdig. So what's going wrong? TIA. Thanks. I got the code patch from the e-mail message you cited and added it to Server.cc and that worked. It's surprising that this wasn't in the code I downloaded because I downloaded it after Nov. 13, 2003 which is the date on the e-mail. Thanks again for your help. Douglas ======== Douglas Kline [EMAIL PROTECTED] ------------------------------------------------------- This SF.Net email is sponsored by: IBM Linux Tutorials Free Linux tutorial presented by Daniel Robbins, President and CEO of GenToo technologies. Learn everything from fundamentals to system administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click _______________________________________________ ht://Dig general mailing list: <[EMAIL PROTECTED]> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-general
