This is an automated email from the ASF dual-hosted git repository. gian pushed a commit to branch robots-post-zero in repository https://gitbox.apache.org/repos/asf/druid-website-src.git
commit c2b76eb92dfe99c3b4399e6bf74f6d6624bf625c Author: Gian Merlino <[email protected]> AuthorDate: Wed Oct 12 05:44:38 2022 +0800 Disallow versioned docs post-24.0. Versions don't necessarily start with zero anymore! We need these directives so search engines prefer indexing the "latest" URLs instead of version-specific URLs. --- robots.txt | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/robots.txt b/robots.txt index 85008f15..c630a839 100644 --- a/robots.txt +++ b/robots.txt @@ -4,4 +4,13 @@ User-agent: * Disallow: /docs/0*/ +Disallow: /docs/1*/ +Disallow: /docs/2*/ +Disallow: /docs/3*/ +Disallow: /docs/4*/ +Disallow: /docs/5*/ +Disallow: /docs/6*/ +Disallow: /docs/7*/ +Disallow: /docs/8*/ +Disallow: /docs/9*/ --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
