jiayuasu commented on PR #3123:
URL: https://github.com/apache/sedona/pull/3123#issuecomment-5014691201

   Superseded by #3125. robots.txt Disallow blocks crawling, which prevents 
search engines from observing a removal signal on already-indexed archived 
pages, so it does not reliably clear stale results. #3125 instead adds a 
crawlable noindex meta tag to archived versions and leaves them crawlable.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to