This is an automated email from the ASF dual-hosted git repository.
tison pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new ddbaf890784 Block crawler from indexing the staged site (#495)
ddbaf890784 is described below
commit ddbaf890784cfda7c51781871be1a70e327bbdb3
Author: tison <[email protected]>
AuthorDate: Wed Mar 29 10:02:14 2023 +0800
Block crawler from indexing the staged site (#495)
---
content/robots.txt | 2 ++
1 file changed, 2 insertions(+)
diff --git a/content/robots.txt b/content/robots.txt
new file mode 100644
index 00000000000..1f53798bb4f
--- /dev/null
+++ b/content/robots.txt
@@ -0,0 +1,2 @@
+User-agent: *
+Disallow: /
