| zhuyifei1999 added a comment. |
Since the original mem_top measurement blamed Cookies, I looked into wheere they are referenced with guppy:
>>> h[11] Partition of a set of 704 objects. Total size = 737792 bytes. Index Count % Size % Cumulative % Kind (class / dict of class) 0 704 100 737792 100 737792 100 dict of cookielib.Cookie >>> _.byid Set of 704 <dict of cookielib.Cookie> objects. Total size = 737792 bytes. Index Size % Cumulative % Owner Address 0 1048 0.1 1048 0.1 0x7fba5816e320 1 1048 0.1 2096 0.3 0x7fba581cb5a8 2 1048 0.1 3144 0.4 0x7fba581cb5f0 3 1048 0.1 4192 0.6 0x7fba581cb638 4 1048 0.1 5240 0.7 0x7fba581cb998 5 1048 0.1 6288 0.9 0x7fba5827ff80 6 1048 0.1 7336 1.0 0x7fba5827ffc8 7 1048 0.1 8384 1.1 0x7fba58282368 8 1048 0.1 9432 1.3 0x7fba582828c0 9 1048 0.1 10480 1.4 0x7fba583ac5f0 <694 more rows. Type e.g. '_.more' to view.> >>> _[0] Set of 1 <dict of cookielib.Cookie> object. Total size = 1048 bytes. Index Size % Cumulative % Owner Address 0 1048 100.0 1048 100.0 0x7fba5816e320 >>> _.referrers Partition of a set of 1 object. Total size = 72 bytes. Index Count % Size % Cumulative % Kind (class / dict of class) 0 1 100 72 100 72 100 cookielib.Cookie >>> _.referrers Partition of a set of 1 object. Total size = 280 bytes. Index Count % Size % Cumulative % Kind (class / dict of class) 0 1 100 280 100 280 100 dict (no owner) >>> _.referrers Partition of a set of 1 object. Total size = 280 bytes. Index Count % Size % Cumulative % Kind (class / dict of class) 0 1 100 280 100 280 100 dict (no owner) >>> _.referrers Partition of a set of 1 object. Total size = 49432 bytes. Index Count % Size % Cumulative % Kind (class / dict of class) 0 1 100 49432 100 49432 100 dict (no owner) >>> _.referrers Partition of a set of 1 object. Total size = 1048 bytes. Index Count % Size % Cumulative % Kind (class / dict of class) 0 1 100 1048 100 1048 100 dict of pywikibot.comms.http.PywikibotCookieJar
In T185561#4019105, @Dvorapa wrote:
- I interrupted it by keyboard and got 37 threads openned, quickly reduced to last 7, which were killed by weblinkchecker finally.
That would confirm the original deadlocking problem fixed :)
TASK DETAIL
EMAIL PREFERENCES
To: zhuyifei1999
Cc: gerritbot, Dalba, Xqt, Zoranzoki21, zhuyifei1999, Aklapper, pywikibot-bugs-list, Dvorapa, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, rafidaslam, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, jayvdb, Masti, Alchimista, Rxy
Cc: gerritbot, Dalba, Xqt, Zoranzoki21, zhuyifei1999, Aklapper, pywikibot-bugs-list, Dvorapa, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, rafidaslam, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, jayvdb, Masti, Alchimista, Rxy
_______________________________________________ pywikibot-bugs mailing list pywikibot-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
