Arnaud LIPERINI-DIAZ <[email protected]> added the comment:
Do you have documentation about robotParser ? The robot.txt of this website works fine : https://vauros.com/ ---------- nosy: +Arnaud LIPERINI-DIAZ _______________________________________ Python tracker <[email protected]> <https://bugs.python.org/issue36207> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
