https://bugzilla.wikimedia.org/show_bug.cgi?id=15878
Happy-melon <[email protected]> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |[email protected] --- Comment #11 from Happy-melon <[email protected]> 2009-01-13 14:13:01 UTC --- That's not how it works. There are two ways of blocking spider access to pages: when a spider first visits a site, it looks for a file called "robots.txt" in the root of the site, and follows the rules there to exclude certain tranches of pages. When it visits each individual page, it looks for the "robots" meta tag and, if one is present and tells it to go away, it does so, and 'forgets' that it was ever on the page. Modifying [[MediaWiki:Robots.txt]] appends entries to the site /robots.txt file (or is supposed to, anyway); it doesn't affect meta tags on pages. -- Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are the assignee for the bug. You are on the CC list for the bug. _______________________________________________ Wikibugs-l mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
