[Pywikipedia-bugs] [Maniphest] [Commented On] T185561: weblinkchecker.py slows down (itself, OS) to freeze after a while reaching 100% of RAM

[zhuyifei1999]

zhuyifei1999 added a comment.

I tested this reproduction code:

PYWIKIBOT2_NO_USER_CONFIG=1 strace python3 -c 'import pwb; from pywikibot.comms.http import fetch; fetch("https://www.icann.org/en/tlds/agreements/cat/cat-agreement-23sep05.htm", headers={"User-Agent":"python-requests/2.18.4", "Accept-Encoding": "gzip, deflate", "Accept":"*/*","Connection": "keep-alive"}, method="HEAD")'

In ubuntu 16.04:

read(3, "\1\0\0\0\0\0\0\0z\301E>\371A(\35\332D%\36+\337/[\345\345?\246\266c!\361"..., 40) = 40
ioctl(3, FIONBIO, [1])                  = 0
poll([{fd=3, events=POLLOUT}], 1, 6050) = 1 ([{fd=3, revents=POLLOUT}])
write(3, "\27\3\3\0\331\356\200]\225:\351\36\311\f\255\332\210\272@x\325\27\333\360\16\335\200\377\312\251\266\244"..., 222) = 222
ioctl(3, FIONBIO, [1])                  = 0
read(3, 0x2fa5003, 5)                   = -1 EAGAIN (Resource temporarily unavailable)
poll([{fd=3, events=POLLIN}], 1, 45000) = 0 (Timeout)
close(3)                                = 0
open("/etc/default/apport", O_RDONLY|O_CLOEXEC) = 3

In ubuntu 17.10:

read(3, "\0\0\0\0\0\0\0\0<\325\271\276k\177\365\302\20\357\37\0\247X@\255On\361t\222\206\300\257"..., 40) = 40
ioctl(3, FIONBIO, [1])                  = 0
poll([{fd=3, events=POLLOUT}], 1, 6050) = 1 ([{fd=3, revents=POLLOUT}])
write(3, "\27\3\3\1\1\2253\352\277\2\235\303\227s#\221\324,7\244d<\225\356ajB\204\314F\271\\"..., 262) = 262
ioctl(3, FIONBIO, [1])                  = 0
read(3, 0x2307293, 5)                   = -1 EAGAIN (Resource temporarily unavailable)
poll([{fd=3, events=POLLIN}], 1, 45000) = 0 (Timeout)
close(3)                                = 0
write(2, "Traceback (most recent call last"..., 35Traceback (most recent call last):

Both polls timed out after 45 seconds. Am I doing something wrong?

TASK DETAIL

https://phabricator.wikimedia.org/T185561

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: zhuyifei1999
Cc: gerritbot, Dalba, Xqt, Zoranzoki21, zhuyifei1999, Aklapper, pywikibot-bugs-list, Dvorapa, Magul, Tbscho, rafidaslam, MayS, Mdupont, JJMC89, Avicennasis, jayvdb, Masti, Alchimista, Rxy

_______________________________________________
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs