-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mar 20, 2006, at 4:27 PM, Peter C. Ndikuwera wrote:
I believe Google obeys the robots.txt rule
It does but I think he did not want to go putting robots.txt in every website. It seems he wanted to firewall googlebot itself. No mean task since the IPs it uses are dynamic.
Kurup -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (Darwin) iD8DBQFEH9exiQIqOIma1OwRAvanAJ4wRiJMjrzQzW6NbtWHZbmV69UDXACfSxVB j8KUS9mytPP7A8PNzPc+LHA= =lIxC -----END PGP SIGNATURE----- _______________________________________________ LUG mailing list [email protected] http://kym.net/mailman/listinfo/lug %LUG is generously hosted by INFOCOM http://www.infocom.co.ug/ The above comments and data are owned by whoever posted them (including attachments if any). The List's Host is not responsible for them in any way. ---------------------------------------
