Mher Movsisyan added the comment: Can you share the link of the new robots.txt standard? I may help to implement it.
---------- _______________________________________ Python tracker <[email protected]> <http://bugs.python.org/issue17403> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
