[Pywikipedia-bugs] [Maniphest] [Commented On] T185561: weblinkchecker.py slows down (itself, OS) to freeze after a while reaching 100% of CPU usage

Tue, 23 Jan 2018 07:39:44 -0800

zhuyifei1999 added a comment.

Waiting for remaining 49 threads to finish, please wait...

https://github.com/wikimedia/pywikibot/blob/4ac64d7d88ff3049e178754566e0fa9b5d639edf/scripts/weblinkchecker.py#L1019

The max # of link checking threads is default 50, with 49 alive the pool is exhausted. I suspect there are certain threads taking forever to process, and attaching to the threads with strace may be able to help.


TASK DETAIL
https://phabricator.wikimedia.org/T185561

EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: zhuyifei1999
Cc: zhuyifei1999, Aklapper, pywikibot-bugs-list, Dvorapa, Magul, Tbscho, rafidaslam, MayS, Mdupont, JJMC89, Avicennasis, jayvdb, Dalba, Masti, Alchimista, Rxy
_______________________________________________
pywikibot-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

Reply via email to