I think I remember those proposals, actually. I have never hear anyone mention them anywhere else, so I don't think anyone has implemented a crawler that looks for those new things in robots.txt
Otis --- Sean 'Captain Napalm' Conner <[EMAIL PROTECTED]> wrote: > > Well, I was surprised to recently find that O'Reilly has mentioned > me in > their book _HTTP: The Definitive Guide_; seems they mentioned my > propsed > draft extentions to the Robot Exclusion Protocol [1] although I'm not > sure > what they said about it (my friend actually found the reference in > O'Reilly, > I haven't had a chance to check it out myself---page 230 if any one > has it). > > Does anyone know if any robots out there actually implement any of > the > proposals? It'd be interesting to know. > > -spc (Six years since that was proposed ... ) > > _______________________________________________ > Robots mailing list > [EMAIL PROTECTED] > http://www.mccmedia.com/mailman/listinfo/robots __________________________________________________ Do you Yahoo!? U2 on LAUNCH - Exclusive greatest hits videos http://launch.yahoo.com/u2 _______________________________________________ Robots mailing list [EMAIL PROTECTED] http://www.mccmedia.com/mailman/listinfo/robots