In <[EMAIL PROTECTED]>, Jonathan Knoll <[EMAIL PROTECTED]> writes: > OK, then is there a way to create an internal wildcard? > > User-agent: * > Disallow: /*/97 > Disallow: /*/98
No, you will need to use
<meta name="ROBOTS" content="NOINDEX">
in the HTML source for those robots that honor the meta tag. robots.txt does
not provide a mechanism for this.
Klaus Johannes Rusch
--
[EMAIL PROTECTED]
http://www.atmedia.net/KlausRusch/
