Merlijn van Deen has submitted this change and it was merged. Change subject: Add crawl delay ......................................................................
Add crawl delay Change-Id: I9ee48c1ed9f836cde86e263fee2385690b9c121e --- M www/robots.txt 1 file changed, 1 insertion(+), 0 deletions(-) Approvals: BryanDavis: Looks good to me, approved Andrew Bogott: Looks good to me, but someone else must approve jenkins-bot: Verified diff --git a/www/robots.txt b/www/robots.txt index c1b1bb8..5c52907 100644 --- a/www/robots.txt +++ b/www/robots.txt @@ -1,4 +1,5 @@ User-agent: * +Crawl-delay: 3 Disallow: /betacommand-dev/ Disallow: /fiwiki-tools/ -- To view, visit https://gerrit.wikimedia.org/r/287249 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I9ee48c1ed9f836cde86e263fee2385690b9c121e Gerrit-PatchSet: 2 Gerrit-Project: labs/toollabs Gerrit-Branch: master Gerrit-Owner: Merlijn van Deen <[email protected]> Gerrit-Reviewer: Andrew Bogott <[email protected]> Gerrit-Reviewer: BryanDavis <[email protected]> Gerrit-Reviewer: Merlijn van Deen <[email protected]> Gerrit-Reviewer: Yuvipanda <[email protected]> Gerrit-Reviewer: coren <[email protected]> Gerrit-Reviewer: jenkins-bot <> _______________________________________________ MediaWiki-commits mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
