| zhuyifei1999 added a comment. |
In T185561#4015808, @Dalba wrote:@Dvorapa, Could you try https://gerrit.wikimedia.org/r/#/c/415687/2/scripts/weblinkchecker.py and see if it helps?
(It is not supposed to reduce the number of active threads, I'm hoping to control RAM usage by stopping page fetches while threads are full)
treat_page is sequential. No more than one extra page (not being processed by a thread) should be loaded at once.
TASK DETAIL
EMAIL PREFERENCES
To: zhuyifei1999
Cc: Dalba, Xqt, Zoranzoki21, zhuyifei1999, Aklapper, pywikibot-bugs-list, Dvorapa, Magul, Tbscho, rafidaslam, MayS, Mdupont, JJMC89, Avicennasis, jayvdb, Masti, Alchimista, Rxy
Cc: Dalba, Xqt, Zoranzoki21, zhuyifei1999, Aklapper, pywikibot-bugs-list, Dvorapa, Magul, Tbscho, rafidaslam, MayS, Mdupont, JJMC89, Avicennasis, jayvdb, Masti, Alchimista, Rxy
_______________________________________________ pywikibot-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
