Le 12/05/2023 à 22:24, Ian Kelling a écrit :
[...]
robots.txt isn't about just not making things public, it is perfectly
valid to use for SEO and helping google turn up the best results for
your site and avoiding non-canonical duplicate pages. I've seen
www-commits list archive pages come up in searches before and they were
not what I wanted. In that light, this request sounds like a good idea
to me. I will implement it. We can change it back if webmasters agree
otherwise.


Thank you, Ian!

Reply via email to