[issue28151] testPythonOrg() of test_robotparser fails on validating python.org HTTPS certificate

[STINNER Victor]

STINNER Victor added the comment:

Thank you Berker! I'm quite sure that the issue is very old, like 1 year
old or more. And this fix is welcomed!

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28151] testPythonOrg() of test_robotparser fails on validating python.org HTTPS certificate

[Berker Peksag]

Berker Peksag added the comment:

test_robotparser is now green. I've opened issue 28195 for 
test_huntrleaks_fd_leak.

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28151] testPythonOrg() of test_robotparser fails on validating python.org HTTPS certificate

[Roundup Robot]

Roundup Robot added the comment:

New changeset 83bca958adc9 by Berker Peksag in branch '3.6':
Issue #28151: Use pythontest.net in test_robotparser
https://hg.python.org/cpython/rev/83bca958adc9

New changeset 4bfd91a45c81 by Berker Peksag in branch 'default':
Issue #28151: Merge from 3.6
https://hg.python.org/cpython/rev/4bfd91a45c81

--
nosy: +python-dev

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28151] testPythonOrg() of test_robotparser fails on validating python.org HTTPS certificate

[Berker Peksag]

Berker Peksag added the comment:

Here's a patch that uses pythontest.net.

--
keywords: +patch
stage: needs patch -> patch review
Added file: http://bugs.python.org/file44695/issue28151.diff

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28151] testPythonOrg() of test_robotparser fails on validating python.org HTTPS certificate

[Berker Peksag]

Berker Peksag added the comment:

Note that I'm planning to rewrite the test to use pythontest.net.

--
nosy: +berker.peksag
stage:  -> needs patch
type:  -> enhancement
versions: +Python 3.6

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28151] testPythonOrg() of test_robotparser fails on validating python.org HTTPS certificate

[STINNER Victor]

New submission from STINNER Victor:

The "x86 Windows7 3.x" buildbot fails to validate python.org HTTPS certificate.

The unit test uses the clear text HTTP URL, but 
http://www.python.org/robots.txt returns "301 Moved Permanently" with the new 
link: https://www.python.org/robots.txt

Firefox sees the cert as valid on my Fedora 24.

Firefox tells me that the cert organization (O) is "Python Software Foundation" 
and it was emitted by (CN) "DigiCert SHA2 Extended Validation Server CA", (O) 
"DigiCert Inc", (OU) "www.digicert.com".

Does this buildbot lack DigitCert root CA?

http://buildbot.python.org/all/builders/x86%20Windows7%203.x/builds/11636/steps/test/logs/stdio

==
ERROR: testPythonOrg (test.test_robotparser.NetworkTestCase)
--
Traceback (most recent call last):
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\urllib\request.py", 
line 1318, in do_open
encode_chunked=req.has_header('Transfer-encoding'))
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\http\client.py", 
line 1239, in request
self._send_request(method, url, body, headers, encode_chunked)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\http\client.py", 
line 1285, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\http\client.py", 
line 1234, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\http\client.py", 
line 1026, in _send_output
self.send(msg)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\http\client.py", 
line 964, in send
self.connect()
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\http\client.py", 
line 1400, in connect
server_hostname=server_hostname)
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\ssl.py", 
line 401, in wrap_socket
_context=self, _session=session)
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\ssl.py", 
line 808, in __init__
self.do_handshake()
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\ssl.py", 
line 1061, in do_handshake
self._sslobj.do_handshake()
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\ssl.py", 
line 683, in do_handshake
self._sslobj.do_handshake()
ssl.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed 
(_ssl.c:747)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\test_robotparser.py",
 line 280, in testPythonOrg
parser.read()
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\urllib\robotparser.py",
 line 58, in read
f = urllib.request.urlopen(self.url)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\urllib\request.py", 
line 223, in urlopen
return opener.open(url, data, timeout)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\urllib\request.py", 
line 532, in open
response = meth(req, response)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\urllib\request.py", 
line 642, in http_response
'http', request, response, code, msg, hdrs)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\urllib\request.py", 
line 564, in error
result = self._call_chain(*args)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\urllib\request.py", 
line 504, in _call_chain
result = func(*args)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\urllib\request.py", 
line 756, in http_error_302
return self.parent.open(new, timeout=req.timeout)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\urllib\request.py", 
line 526, in open
response = self._open(req, data)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\urllib\request.py", 
line 544, in _open
'_open', req)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\urllib\request.py", 
line 504, in _call_chain
result = func(*args)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\urllib\request.py", 
line 1361, in https_open
context=self._context, check_hostname=self._check_hostname)
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\urllib\request.py", 
line 1320, in do_open
raise URLError(err)
urllib.error.URLError: 

--
components: Tests
messages: 276442
nosy: christian.heimes, haypo
priority: normal
severity: normal
status: open
title: testPythonOrg() of test_robotparser fails on validating python.org HTTPS 
certificate
versions: Python 3.7

___
Python tracker 

[issue28151] testPythonOrg() of test_robotparser fails on validating python.org HTTPS certificate

[STINNER Victor]

Changes by STINNER Victor :


--
keywords: +buildbot
nosy: +zach.ware

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28151] testPythonOrg() of test_robotparser fails on validating python.org HTTPS certificate

[STINNER Victor]

STINNER Victor added the comment:

A workaround is to catch the ssl.SSLError and skip the unit test...

Another fix is to avoid completely network connection to the Internet and only 
uses the temporary HTTP server used by other unit tests.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com