On Mar 26, 2006, at 7:25 AM, <[EMAIL PROTECTED]> <ogjunk- [EMAIL PROTECTED]> wrote:
Hi,Googlebot and msnbot are supposed to obey robots.txt, but they are ignoring my robots.txt ( http://simpy.com/robots.txt ), that contains:
Looks like a bug to me -Tim _______________________________________________ Robots mailing list Robots@mccmedia.com http://www.mccmedia.com/mailman/listinfo/robots