UserAgent: Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.8) Gecko/20050511 Firefox/1.0.4 IP: 198.54.202.234 URI: http://wesnoth.slack.it/?RobotsTxt - - - - - Index: RobotsTxt =================================================================== RCS file: /home/wesnoth/cvsroot/wikiroot/RobotsTxt,v retrieving revision 1.3 diff -u -r1.3 RobotsTxt --- RobotsTxt 6 Jul 2005 07:22:03 -0000 1.3 +++ RobotsTxt 6 Jul 2005 07:36:42 -0000 @@ -1,7 +1,11 @@ -# this will prevent pages from been indicized <br/> -# modify as needed <br/> +# This file is used by search engines and has to be in a specific format -User-agent: * +# DO NOT MODIFY + +# let bots index these pages -Disallow: / +# Spammers: we use nofollow on all pages -- no Google ranking here! + +User-agent: * +Disallow:
_______________________________________________ Wesnoth-wiki-changes mailing list [email protected] http://lists.nongnu.org/mailman/listinfo/wesnoth-wiki-changes
