On Nov 11, 2003, at 9:45 AM, Johnson, S wrote:

I think I got it. Although, it could be 1 of 2 things...

Looking at the rundig -vvv I noticed that it didn't find robots.txt in each of the sites. I copied in a robots.txt to each page.

I also moved the first url to the end of the list.

If those were the only two changes, then the latter is the one that fixed the problem. A robots.txt file is not required, and its absence would not have prevented you from indexing the server. Glad to hear you got things working!


Jim



-------------------------------------------------------
This SF.Net email sponsored by: ApacheCon 2003,
16-19 November in Las Vegas. Learn firsthand the latest
developments in Apache, PHP, Perl, XML, Java, MySQL,
WebDAV, and more! http://www.apachecon.com/
_______________________________________________
ht://Dig general mailing list: <[EMAIL PROTECTED]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general

Reply via email to