On Mon, 31 Mar 2003, Priya Dayanand wrote: > Robots are disallowed on the server, could that be a problem?
Yes, that would certainly be a problem. I assume this is enforced by the robots.txt file? -- -Geoff Hutchison Williams Students Online http://wso.williams.edu/ ------------------------------------------------------- This SF.net email is sponsored by: ValueWeb: Dedicated Hosting for just $79/mo with 500 GB of bandwidth! No other company gives more support or power for your dedicated server http://click.atdmt.com/AFF/go/sdnxxaff00300020aff/direct/01/ _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
