I think most current releases of the popular search engines implement
it. (The "Note that currently only a few robots implement this"
disclaimer has been on the webcrawler page for a couple of years, but
Microsoft Search Server says it recognizes the ROBOTS Meta tag
http://technet.microsoft.com/cdonline/content/complete/internet/server/s
itesrv/technote/sssearch.htm
InfoSeek say they recognize the ROBOTS Meta Tag
http://software.infoseek.com/products/ultraseek/docs/relnotes-summary.htm
I can only find explicit references to the Robots tage for the AltaVista
ImageFinder
http://image.altavista.com/exclude.html
Inktomi (used in HotBot) say they obey the noindex meta tag. No mention
of the nofollow tag.
http://www.inktomi.com/slurp.html
http://info.webcrawler.com/mak/projects/robots/active/html/type.html
has a long list of web crawlers (most of which I've never heard of), but
is out of date for some of those entries that I've checked.
Aengus
______________________________ Reply Separator _________________________________
Subject: Re: [analog-help] ROBOTS Meta tag
Author: [EMAIL PROTECTED] at Internet
Date: 3/27/99 7:42 PM
On Fri, 26 Mar 1999, Aengus Lawlor wrote:
>
> The Robots exclusion tag looks like this:
>
> <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
>
> It's explained in greater detail at:
> http://info.webcrawler.com/mak/projects/robots/exclusion.html#meta
>
It's a nice idea, but does anyone know which robots support this? If it's
only one or two, I'd be worried about lulling people into a false sense of
security.
--
Stephen Turner [EMAIL PROTECTED] http://www.statslab.cam.ac.uk/~sret1/
Statistical Laboratory, 16 Mill Lane, Cambridge CB2 1SB, England
"Ad infinitum, if not ad nauseam." (Interviewee, BBC Radio 4)
--------------------------------------------------------------------
This is the analog-help mailing list. To unsubscribe from this
mailing list, send mail to [EMAIL PROTECTED]
with "unsubscribe analog-help" in the main BODY OF THE MESSAGE.
--------------------------------------------------------------------
Received: from nmho05u.rohmhaas.com ([136.141.252.23]) by ima1.rohmhaas.com with
SMTP
(IMA Internet Exchange 3.11) id 00180381; Sat, 27 Mar 1999 14:52:54 -0500
Received: by nmho05u.rohmhaas.com; id OAA01792; Sat, 27 Mar 1999 14:54:51 -0500
(EST)
Received: from mb3.mailbank.com(209.133.104.8) by nmho05u.rohmhaas.com via smap
(3.2)
id xma001788; Sat, 27 Mar 99 14:54:44 -0500
Received: from gateway1.isite.net (gateway1.isite.net [198.207.204.66])
by mb3.mailbank.com (8.9.1a/8.9.1) with ESMTP id LAA23230
for <[EMAIL PROTECTED]>; Sat, 27 Mar 1999 11:52:40 -0800
Received: from proxy1.noc.isite.net ([172.16.1.11] (may be forged)) by
gateway1.isite.net (8.8.6/8.8) with ESMTP id LAA02045; Sat, 27 Mar 1999 11:42:44
-0800 (PST)
Received: from mail2.noc.isite.net (mail2.noc.isite.net [172.16.1.22]) by
proxy1.noc.isite.net (8.8.6/8.8) with ESMTP id LAA10570; Sat, 27 Mar 1999
11:42:43 -0800 (PST)
Received: (from majordom@localhost) by mail2.noc.isite.net (8.8.6/8.8) id
LAA04386 for analog-help-localoutlist; Sat, 27 Mar 1999 11:42:33 -0800 (PST)
Received: from proxy1.noc.isite.net (proxy1.noc.isite.net [172.16.1.11]) by
mail2.noc.isite.net (8.8.6/8.8) with ESMTP id LAA04382 for
<[EMAIL PROTECTED]>; Sat, 27 Mar 1999 11:42:28 -0800 (PST)
Received: from gateway1.isite.net (gateway1.isite.net [198.207.204.66]) by
proxy1.noc.isite.net (8.8.6/8.8) with ESMTP id LAA10566 for
<[EMAIL PROTECTED]>; Sat, 27 Mar 1999 11:42:27 -0800 (PST)
Received: from lion.statslab.cam.ac.uk (lion.statslab.cam.ac.uk [131.111.20.59])
by gateway1.isite.net (8.8.6/8.8) with SMTP id LAA02041 for
<[EMAIL PROTECTED]>; Sat, 27 Mar 1999 11:42:17 -0800 (PST)
Received: from gamma.statslab.cam.ac.uk [131.111.20.18] (sret1)
by lion.statslab.cam.ac.uk with smtp (Exim 1.82 #2)
id 10QyyA-0000io-00; Sat, 27 Mar 1999 19:42:10 +0000
Date: Sat, 27 Mar 1999 19:42:09 +0000 (GMT)
From: Stephen Turner <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Subject: Re: [analog-help] ROBOTS Meta tag
In-Reply-To: <>
Message-ID: <>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: [EMAIL PROTECTED]
Precedence: bulk
Reply-To: [EMAIL PROTECTED]
