Karthikeyan Singaravelan <[email protected]> added the comment:
See also the approach to use robots.txt https://github.com/python/pythondotorg/issues/1030 ---------- nosy: +xtreak _______________________________________ Python tracker <[email protected]> <https://bugs.python.org/issue40012> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
