[issue36752] test multiprocessing: test_rapid_restart() crash on AIX when using XLC compiler

[STINNER Victor]

STINNER Victor  added the comment:

According to Michael Felt, the bug is specific to XLC compiler, but the POWER6 
AIX buildbot worker switch to GCC.

Michael Felt: Maybe Python documentation or build system should somewhere 
discourage the usage of the XLC on AIX because of this bug. But that's a 
different issue.

Since it seems like nobody is available to debug the XLC specific issue and 
that the buildbot worker worked around the issue, I close the issue.

--
resolution:  -> out of date
stage:  -> resolved
status: open -> closed
title: test multiprocessing: test_rapid_restart() crash on AIX -> test 
multiprocessing: test_rapid_restart() crash on AIX when using XLC compiler

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36752] test multiprocessing: test_rapid_restart() crash on AIX

[Michael Felt]

Michael Felt  added the comment:

Please let me be much more specific.

This specific bot failure is from when I ran the bot using XLC as a compiler. 
Because I could not solve it on my own, and did not get any hints in time (see 
issue35828) Since my work schedule intensified I switched the bot to use gcc - 
and this test failure disappeared.

Considering that the bot no longer uses XLC - it may make better sense to close 
this one. No AIX bots are using XLC aka vac(pp) compiler.

Should I have time, I'll look into it again as issue35828. Note also, that 
manually I still build using XLC and the issue rarely occurs. That is part of 
what makes debugging so difficult.

Michael

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36752] test multiprocessing: test_rapid_restart() crash on AIX

[Michael Felt]

Michael Felt  added the comment:

I believe (or hope) this is related to issue35828.

This is, as far as I can tell, a compiler issue.

It appears "always" in the bot situation (not building as root) when using 
xlc-v11, but not when using gcc-4.7.4.

So, when the test failure "disappears" on the bot - it is because I have 
switched CC=clr_r to CC=gcc

I am quite willing to continue searching (I just removed over three GBytes of 
core dumps I had collected previously).

As to analysis: it appears the "server" side core-dumps, and the the 
client-side is refused a connection (obviously).

--
nosy: +Michael.Felt

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36752] test multiprocessing: test_rapid_restart() crash on AIX

[STINNER Victor]

New submission from STINNER Victor :

POWER6 AIX 3.x:
https://buildbot.python.org/all/#/builders/161/builds/1050

==
ERROR: test_rapid_restart 
(test.test_multiprocessing_forkserver.WithManagerTestManagerRestart)
--
Traceback (most recent call last):
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/test/_test_multiprocessing.py",
 line 2872, in test_rapid_restart
queue = manager.get_queue()
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/managers.py",
 line 737, in temp
token, exp = self._create(typeid, *args, **kwds)
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/managers.py",
 line 620, in _create
conn = self._Client(self._address, authkey=self._authkey)
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/connection.py",
 line 796, in XmlClient
return ConnectionWrapper(Client(*args, **kwds), _xml_dumps, _xml_loads)
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/connection.py",
 line 502, in Client
c = SocketClient(address)
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/connection.py",
 line 629, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 79] Connection refused

==
ERROR: test_remote 
(test.test_multiprocessing_forkserver.WithManagerTestRemoteManager)
--
Traceback (most recent call last):
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/test/_test_multiprocessing.py",
 line 2835, in test_remote
manager2.connect()
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/managers.py",
 line 545, in connect
conn = Client(self._address, authkey=self._authkey)
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/connection.py",
 line 796, in XmlClient
return ConnectionWrapper(Client(*args, **kwds), _xml_dumps, _xml_loads)
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/connection.py",
 line 508, in Client
answer_challenge(c, authkey)
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/connection.py",
 line 751, in answer_challenge
message = connection.recv_bytes(256) # reject large message
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/connection.py",
 line 216, in recv_bytes
buf = self._recv_bytes(maxlength)
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/connection.py",
 line 414, in _recv_bytes
buf = self._recv(4)
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/connection.py",
 line 379, in _recv
chunk = read(handle, remaining)
ConnectionResetError: [Errno 73] Connection reset by peer

==
ERROR: test_rapid_restart 
(test.test_multiprocessing_forkserver.WithProcessesTestManagerRestart)
--
Traceback (most recent call last):
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/test/_test_multiprocessing.py",
 line 2872, in test_rapid_restart
queue = manager.get_queue()
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/managers.py",
 line 737, in temp
token, exp = self._create(typeid, *args, **kwds)
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/managers.py",
 line 620, in _create
conn = self._Client(self._address, authkey=self._authkey)
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/connection.py",
 line 796, in XmlClient
return ConnectionWrapper(Client(*args, **kwds), _xml_dumps, _xml_loads)
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/connection.py",
 line 502, in Client
c = SocketClient(address)
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/multiprocessing/connection.py",
 line 629, in SocketClient
s.connect(address)
ConnectionRefusedError: [Errno 79] Connection refused

==
ERROR: test_rapid_restart 
(test.test_multiprocessing_forkserver.WithThreadsTestManagerRestart)
--
Traceback (most recent call last):
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/test/_test_multiprocessing.py",
 line 2872, in test_rapid_restart
queue = manager.get_queue()
  File 
"/home/buildbot/buildarea/3.x.aixtools-aix-power6/build/Lib/mult