> It seems weird that htdig doesn't support encasing a block of code, > doesn't > it?
There are a variety of tags for a variety of purposes. IIRC, the documentation for noindex_start/end imply that htdig will ignore absolutely everything in-between. It's as if that part of the document didn't exist. There are also non-DTD <noindex></noindex> tags and <noindex follow></noindex> tags that are respected (though the latter only work in more recent versions of ht://Dig.) For actual <FRAME> documents, you can use the <META name="robots"> tags. http://www.robotstxt.org/wc/exclusion.html#meta And to add to the plethora of options for tasks like this, htdig also respects the <LINK> tag in an HTML document. http://www.w3.org/TR/REC-html40/struct/links.html#edef-LINK -- -Geoff Hutchison Williams Students Online http://wso.williams.edu/ ------------------------------------------------------- This sf.net email is sponsored by:ThinkGeek Welcome to geek heaven. http://thinkgeek.com/sf _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
