| Dvorapa added a comment. |
OK, I run python3 pwb.py weblinkchecker -start:! -ns:0 on Ubuntu 17.10 (with Python 3.6). I created 3 core dumps. The script run with session replaced by requests in http.py#L384 and logged off. The script run more than 3x faster than on Arch, with being logged in and with session. Core dumps were obtained by sudo gdb python3 -p 1781 -> (gdb) generate-core-file.
Core dump 1:
https://drive.google.com/open?id=1yGTu5Tz89IJgT-hvTSmtHKFcWlxPyDIC (1.3 GB)
- captured immediately after script started, 111 MB RAM used by script, 1.2 GB RAM (64 %) used by the whole system, swap contained 4 MB
Core dump 2:
https://drive.google.com/open?id=1_SzjbBOHwl3eVI8MQupvl4d6lyPpoDez (1.8 GB)
- captured when script reached 922 MB RAM, 1.8 GB RAM (88 %) used by the whole system, swap contained 74 MB
Core dump 3:
https://drive.google.com/open?id=1L0swxa-KJ4xlxDnSlQaf56HCv0RZc1vH (3.2 GB)
- captured when 1.9 GB RAM (99 %) used by the whole system and swap was filled from 75 % (3.2 GB), 1.2 GB RAM used by script
After reaching 99 % of RAM and 80 % of swap I terminated the script currently processing articles beginning by letter G.
TASK DETAIL
EMAIL PREFERENCES
To: Dvorapa
Cc: gerritbot, Dalba, Xqt, Zoranzoki21, zhuyifei1999, Aklapper, pywikibot-bugs-list, Dvorapa, Magul, Tbscho, rafidaslam, MayS, Mdupont, JJMC89, Avicennasis, jayvdb, Masti, Alchimista, Rxy
Cc: gerritbot, Dalba, Xqt, Zoranzoki21, zhuyifei1999, Aklapper, pywikibot-bugs-list, Dvorapa, Magul, Tbscho, rafidaslam, MayS, Mdupont, JJMC89, Avicennasis, jayvdb, Masti, Alchimista, Rxy
_______________________________________________ pywikibot-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
