Karthikeyan Singaravelan <tir.kar...@gmail.com> added the comment:
See also the approach to use robots.txt https://github.com/python/pythondotorg/issues/1030 ---------- nosy: +xtreak _______________________________________ Python tracker <rep...@bugs.python.org> <https://bugs.python.org/issue40012> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
