This is an automated email from the ASF dual-hosted git repository.
lhotari pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git
The following commit(s) were added to refs/heads/main by this push:
new e869cadc50f Update robots.txt to disallow old docs
e869cadc50f is described below
commit e869cadc50f458793485a2e6b77a862ccd315eb5
Author: Lari Hotari <[email protected]>
AuthorDate: Mon May 4 10:44:44 2026 +0300
Update robots.txt to disallow old docs
---
static/robots.txt | 33 +++++++++++++++++++++++++++++++++
1 file changed, 33 insertions(+)
diff --git a/static/robots.txt b/static/robots.txt
index c128cc78152..3c74361ca4a 100644
--- a/static/robots.txt
+++ b/static/robots.txt
@@ -30,5 +30,38 @@ Disallow: /api/pulsar-functions/3.2.x/
Disallow: /api/pulsar-functions/3.3.x/
Disallow: /api/pulsar-functions/4.1.x/
+# Old versioned docs — only 4.0.x, 4.2.x, and next are indexable
+Disallow: /docs/2.2.0/
+Disallow: /docs/2.2.1/
+Disallow: /docs/2.3.0/
+Disallow: /docs/2.3.1/
+Disallow: /docs/2.3.2/
+Disallow: /docs/2.4.0/
+Disallow: /docs/2.4.1/
+Disallow: /docs/2.4.2/
+Disallow: /docs/2.5.0/
+Disallow: /docs/2.5.1/
+Disallow: /docs/2.5.2/
+Disallow: /docs/2.6.0/
+Disallow: /docs/2.6.1/
+Disallow: /docs/2.6.2/
+Disallow: /docs/2.6.3/
+Disallow: /docs/2.6.4/
+Disallow: /docs/2.7.0/
+Disallow: /docs/2.7.1/
+Disallow: /docs/2.7.2/
+Disallow: /docs/2.7.3/
+Disallow: /docs/2.7.4/
+Disallow: /docs/2.7.5/
+Disallow: /docs/2.8.x/
+Disallow: /docs/2.9.x/
+Disallow: /docs/2.10.x/
+Disallow: /docs/2.11.x/
+Disallow: /docs/3.0.x/
+Disallow: /docs/3.1.x/
+Disallow: /docs/3.2.x/
+Disallow: /docs/3.3.x/
+Disallow: /docs/4.1.x/
+
Sitemap: https://pulsar.apache.org/sitemap.xml
Sitemap: https://pulsar.apache.org/api-sitemap.xml
