Dvorapa added a comment.

Linux typically...

Thank you!

From my current measurement:

  1. $ python pwb.py weblinkchecker -start:! -ns:0 on freshly booted system
  2. Python memory usage after start 200 MB
  3. Worked quite smoothly for 3 hours only increasing memory usage
  4. Python memory usage stopped on 1.1 GB and last 1 hour it was on the level of 1 GB. The whole system memory usage was cca 90 %, It sometimes came up to 99 % but quickly allocated swap space and lowered back to 90 %. If I would open Firefox browser when on 90 %, it would quickly add 20 % (and freeze the whole OS), therefore I was AFK.
  5. Finally the last 30 minutes the whole system memory usage 90 %, 800 MB swap space used, the OS was fast, but the script was a little bit slower.
  6. I interrupted it by keyboard and got 37 threads openned, quickly reduced to last 7, which were killed by weblinkchecker finally.

TASK DETAIL
https://phabricator.wikimedia.org/T185561

EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: zhuyifei1999, Dvorapa
Cc: gerritbot, Dalba, Xqt, Zoranzoki21, zhuyifei1999, Aklapper, pywikibot-bugs-list, Dvorapa, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, rafidaslam, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, jayvdb, Masti, Alchimista, Rxy
_______________________________________________
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

Reply via email to