Where can I find some concrete examples of regular expressions to use with
the Allow, Disallow, etc, keywords?

I'm trying to exclude 4 specific sites from being indexed, but I'm not
having much luck.  We link to these sites, but don't want them as part of
our searchable index.  Here are the regex I'm using:


Disallow ^http://cgi2\.somesite1\.com/

Disallow ^http://crm\.somesite2\.com/

Disallow ^http://www\.somesite2\.or\.jp/

Disallow ^http://www\.somesite4\.com/

Disallow ^http://www\.somesite5\.co\.jp/

Could the problem be the order in which I have the keywords set up?

Thanks in advance.


Adolfo "Chago" Santiago

Principle of Minimum Access: "That which is not explicitly permitted is
denied."

Public Key: http://pgpkeys.mit.edu:11371/pks/lookup?op=get&search=0x4E867630
Fingerprint: 0EDB 438E 1222 6DFD B80F  4686 484D 7312 4E86 7630

Reply via email to