Title: [276873] trunk/Tools
- Revision
- 276873
- Author
- [email protected]
- Date
- 2021-05-01 06:27:35 -0700 (Sat, 01 May 2021)
Log Message
Disable search engine crawling on build.webkit.org webpages
https://bugs.webkit.org/show_bug.cgi?id=225252
Reviewed by Jonathan Bedard.
Referencec: https://developers.google.com/search/docs/advanced/robots/create-robots-txt
* CISupport/build-webkit-org/public_html/robots.txt:
Modified Paths
Diff
Modified: trunk/Tools/CISupport/build-webkit-org/public_html/robots.txt (276872 => 276873)
--- trunk/Tools/CISupport/build-webkit-org/public_html/robots.txt 2021-05-01 12:54:29 UTC (rev 276872)
+++ trunk/Tools/CISupport/build-webkit-org/public_html/robots.txt 2021-05-01 13:27:35 UTC (rev 276873)
@@ -1,16 +1,6 @@
User-agent: *
-Disallow: /waterfall
-Disallow: /builders
-Disallow: /changes
-Disallow: /buildslaves
-Disallow: /schedulers
-Disallow: /one_line_per_build
-Disallow: /one_box_per_builder
-Disallow: /xmlrpc
-Disallow: /grid
-Disallow: /tgrid
-Disallow: /console
-Disallow: /results
-Disallow: /dashboard
-Disallow: /LeaksViewer
-Disallow: /TestFailures
+Disallow: /
+
+User-agent: Googlebot
+User-agent: AdsBot-Google
+Disallow: /
Modified: trunk/Tools/ChangeLog (276872 => 276873)
--- trunk/Tools/ChangeLog 2021-05-01 12:54:29 UTC (rev 276872)
+++ trunk/Tools/ChangeLog 2021-05-01 13:27:35 UTC (rev 276873)
@@ -1,3 +1,14 @@
+2021-05-01 Aakash Jain <[email protected]>
+
+ Disable search engine crawling on build.webkit.org webpages
+ https://bugs.webkit.org/show_bug.cgi?id=225252
+
+ Reviewed by Jonathan Bedard.
+
+ Referencec: https://developers.google.com/search/docs/advanced/robots/create-robots-txt
+
+ * CISupport/build-webkit-org/public_html/robots.txt:
+
2021-04-30 Wenson Hsieh <[email protected]>
App highlight UI should be disabled when selecting text in image overlays
_______________________________________________
webkit-changes mailing list
[email protected]
https://lists.webkit.org/mailman/listinfo/webkit-changes
