NSAmelchev opened a new pull request, #340:
URL: https://github.com/apache/ignite-website/pull/340

   Only ~35 of 257 Ignite 2 doc pages are in Google's index: robots.txt blocks 
the 301s from
   the old /docs/latest/ URLs, the pages have no description and a 
version-neutral but
   duplicated title, and sitemap.xml lists blocked URLs.
   
   - robots.txt: allow /docs/$, /docs/latest, /docs/ignite2/latest, page images 
and the
     search UI assets; it is now the single source (static/robots.txt removed, 
the deploy
     script no longer overwrites it).
   - Jekyll layout: "<page> | Apache Ignite Documentation", meta description 
from the first
     paragraph prefixed with "Apache Ignite 2.x documentation.", absolute 
canonical, index
     pages canonicalize to their directory URL. Nav links no longer go through 
redirects
     or contain "//", javadoc links use /releases/ignite2/<version>/.
   - .htaccess: slash variants of /docs/ignite2/latest/ no longer redirect into 
the
     robots-blocked versioned URLs; ".../index" -> directory URL; redirect map 
for the 11
     pages removed since 2.9; /docs/2.x.y/ -> /docs/ignite2/2.x.y/; two dead 
Redirect
     lines removed. Verified on a local Apache 2.4 (43 URL checks).
   - generate-sitemap.sh: no Ignite 3, noindex or /404 URLs, lastmod from git, 
versions
     from the "latest" pointer files, works on macOS bash 3.2. sitemap.xml: 400 
URLs.
   
   After merge: run the "Publish website documentation" workflow in 
apache/ignite on
   ignite-2.18 to regenerate the docs, then ./generate-sitemap.sh and commit 
sitemap.xml.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to