I think I remember those proposals, actually.
I have never hear anyone mention them anywhere else, so I don't think
anyone has implemented a crawler that looks for those new things in
robots.txt

Otis

--- Sean 'Captain Napalm' Conner <[EMAIL PROTECTED]> wrote:
> 
>   Well, I was surprised to recently find that O'Reilly has mentioned
> me in
> their book _HTTP: The Definitive Guide_; seems they mentioned my
> propsed
> draft extentions to the Robot Exclusion Protocol [1] although I'm not
> sure
> what they said about it (my friend actually found the reference in
> O'Reilly,
> I haven't had a chance to check it out myself---page 230 if any one
> has it).  
> 
>   Does anyone know if any robots out there actually implement any of
> the
> proposals?  It'd be interesting to know.
> 
>   -spc (Six years since that was proposed ... )
> 
> _______________________________________________
> Robots mailing list
> [EMAIL PROTECTED]
> http://www.mccmedia.com/mailman/listinfo/robots


__________________________________________________
Do you Yahoo!?
U2 on LAUNCH - Exclusive greatest hits videos
http://launch.yahoo.com/u2
_______________________________________________
Robots mailing list
[EMAIL PROTECTED]
http://www.mccmedia.com/mailman/listinfo/robots

Reply via email to