NSAmelchev opened a new pull request, #340:
URL: https://github.com/apache/ignite-website/pull/340
Only ~35 of 257 Ignite 2 doc pages are in Google's index: robots.txt blocks
the 301s from
the old /docs/latest/ URLs, the pages have no description and a
version-neutral but
duplicated title, and sitemap.xml lists blocked URLs.
- robots.txt: allow /docs/$, /docs/latest, /docs/ignite2/latest, page images
and the
search UI assets; it is now the single source (static/robots.txt removed,
the deploy
script no longer overwrites it).
- Jekyll layout: "<page> | Apache Ignite Documentation", meta description
from the first
paragraph prefixed with "Apache Ignite 2.x documentation.", absolute
canonical, index
pages canonicalize to their directory URL. Nav links no longer go through
redirects
or contain "//", javadoc links use /releases/ignite2/<version>/.
- .htaccess: slash variants of /docs/ignite2/latest/ no longer redirect into
the
robots-blocked versioned URLs; ".../index" -> directory URL; redirect map
for the 11
pages removed since 2.9; /docs/2.x.y/ -> /docs/ignite2/2.x.y/; two dead
Redirect
lines removed. Verified on a local Apache 2.4 (43 URL checks).
- generate-sitemap.sh: no Ignite 3, noindex or /404 URLs, lastmod from git,
versions
from the "latest" pointer files, works on macOS bash 3.2. sitemap.xml: 400
URLs.
After merge: run the "Publish website documentation" workflow in
apache/ignite on
ignite-2.18 to regenerate the docs, then ./generate-sitemap.sh and commit
sitemap.xml.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]