[issue42447] robotsparser deny all with some rules

Change by Terry J. Reedy : -- resolution: -> not a bug stage: -> resolved status: open -> closed ___ Python tracker ___ ___

[issue42447] robotsparser deny all with some rules

Terry J. Reedy added the comment: This issue tracker is for proposing changes to the github CPython repository, used to make python.org python releases. Your post does not propose a change and does not demonstrate that there is a bug in current Python, which is 3.9. So my current opinion

[issue42447] robotsparser deny all with some rules

Net Offensive added the comment: Sorry if my message is not clear enough. I will ask my developer to come and complete the information if needed. -- ___ Python tracker ___

[issue42447] robotsparser deny all with some rules

New submission from Net Offensive : Bonjour, Notre développeur a un soucis avec l'utilisation de cette librairie. Dans le cadre d'un projet SEO, nous souhaiterions scrapper les pages de notre réseau de site. Nous avons essayé de tester avec l'un de nos site dont les pages se présentent