On Mon, 28 Jan 2002 [EMAIL PROTECTED] wrote: > There are a very few indiscriminate robots that follow all links: > comments, alt tags, javascript, even text, everything. The > PicoSearch service tends do to this. Most others are much more > reasonable.
By this, Avi, I'm assuming you mean the robots follow anything that looks like a URL in addition to actual URL tags like <a href=...>, <link ...>, etc.? -- -Geoff Hutchison Williams Students Online http://wso.williams.edu/ _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
