>OK, then is there a way to create an internal wildcard? > >User-agent: * >Disallow: /*/97 >Disallow: /*/98 > >Something like this?
Unfortunately... from Web Server Administrator's Guide to the REP: " Note also that regular expression are not supported in either the User-agent or Disallow lines. The '*' in the User-agent field is a special value meaning "any robot". Specifically, you cannot have lines like "Disallow: /tmp/*" or "Disallow: *.gif". " (http://info.webcrawler.com/mak/projects/robots/exclusion-admin.html) So looks like "Disallow: /*/97" (and so on) would be meaningless as well. Regards, Tuomas
