Hi Scott
I used a robots list in the past in combination with mod_rewrite on apache
= RewriteMap which lookup a list I got from
http://fantomaster.com/fa_SE-LIST.html and other sources.
This is very useful for cloacking :-)
Anyway there different approach to it.
Here are few ideas
a) You could
Try here:
http://www.robotstxt.org/wc/robots.html
-Original Message-
From: Scott Purcell [mailto:[EMAIL PROTECTED]
Sent: Wednesday, March 22, 2006 8:00 PM
To: Tomcat Users List
Subject: Would like to track googlebots, or spiders from site
Not necessarily a tomcat problem, but I have
