Stephen Turner wrote:
> It's a nice idea, but does anyone know which robots support this? If it's
> only one or two, I'd be worried about lulling people into a false sense of
> security.
> On Fri, 26 Mar 1999, Aengus Lawlor wrote:
> >
> > It's explained in greater detail at:
> > http://info.webcrawler.com/mak/projects/robots/exclusion.html#meta
If you continue with the docs here, they say "Note: Currently only few robots
support this tag! " [puctuation included and highlighted in red.]
How about adding any analog report files to your robots.txt for exclusion,
Aengus. There are more robots that support that that exclusion protocol
(although not all). I know you said you don't know where the files are, but
are they all named similarly?
Otherwise, you could set rights on them so only you and your users who need to
can access them.
Just some thoughts, HTH
--
Jeremy Wadsack
OutQuest Magazine
a Wadsack-Allen publication
--------------------------------------------------------------------
This is the analog-help mailing list. To unsubscribe from this
mailing list, send mail to [EMAIL PROTECTED]
with "unsubscribe analog-help" in the main BODY OF THE MESSAGE.
--------------------------------------------------------------------
