Merlijn van Deen has uploaded a new change for review.

  https://gerrit.wikimedia.org/r/286315

Change subject: robots.txt: disallow /persondata/
......................................................................

robots.txt: disallow /persondata/

The persondata tool is overloaded due to crawlers, as requests
can easily take a few seconds to return. This blocks access
for crawlers, hopefully making the tool available again to
users.

Bug: T133697
Change-Id: I916158661a23b616ab30dc129cf65d5be71c7933
---
M www/robots.txt
1 file changed, 3 insertions(+), 0 deletions(-)


  git pull ssh://gerrit.wikimedia.org:29418/labs/toollabs 
refs/changes/15/286315/1

diff --git a/www/robots.txt b/www/robots.txt
index 74663c5..c1b1bb8 100644
--- a/www/robots.txt
+++ b/www/robots.txt
@@ -2,6 +2,9 @@
 Disallow: /betacommand-dev/
 Disallow: /fiwiki-tools/
 
+# T133697
+Disallow: /persondata/
+
 # Disallow XoviBot.
 User-agent: XoviBot
 Disallow: /

-- 
To view, visit https://gerrit.wikimedia.org/r/286315
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: I916158661a23b616ab30dc129cf65d5be71c7933
Gerrit-PatchSet: 1
Gerrit-Project: labs/toollabs
Gerrit-Branch: master
Gerrit-Owner: Merlijn van Deen <[email protected]>

_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits

Reply via email to