[issue1437699] allow unicode arguments for robotparser.can_fetch

[Mark Lawrence]

Changes by Mark Lawrence :


--
nosy:  -BreamoreBoy

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue1437699] allow unicode arguments for robotparser.can_fetch

[Terry J. Reedy]

Terry J. Reedy  added the comment:

The .../orig.html link now works and was last updated in August.
It has a link to .../robotstext.html.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue1437699] allow unicode arguments for robotparser.can_fetch

[Terry J. Reedy]

Terry J. Reedy  added the comment:

While Python is 'GPL compatible', whatever that means, it cannot incorporate 
GPLed code in the PSF distribution. Code must be contributed under one on the 
two licenses in the contributor agreement. Philip, can you contribute a patch 
appropriate to 3.x?

In 3.x, robotparser is urllib.robotparser. Under the 'be generous what you 
accept' principle, expansion of accepted names would seem to be good.

DOC PATCH NEEDED The doc says "For more details on the structure of robots.txt 
files, see http://www.robotstxt.org/orig.html ."
That link seems not to exist. The safest link is to the site. The specific 
replacement is http://www.robotstxt.org/robotstxt.html .

--
stage:  -> unit test needed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue1437699] allow unicode arguments for robotparser.can_fetch

[Mark Lawrence]

Mark Lawrence  added the comment:

No comments on this for 4 1/2 years.  Is this still valid and/or is anyone 
still interested?

--
nosy: +BreamoreBoy
versions: +Python 3.2

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue1437699] allow unicode arguments for robotparser.can_fetch

[Skip Montanaro]

Changes by Skip Montanaro <[EMAIL PROTECTED]>:


--
assignee: skip.montanaro -> 
nosy:  -skip.montanaro

_
Tracker <[EMAIL PROTECTED]>

_
___
Python-bugs-list mailing list 
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com