[Pywikipedia-bugs] [Maniphest] [Commented On] T185561: weblinkchecker.py slows down (itself, OS) to freeze after a while reaching 100% of CPU usage

[Dvorapa]

Dvorapa added a comment.

PS: I don't know why there is this INFO:pywiki:, VERBOSE:pywiki: and WARNING:pywiki:. It starts correctly, but after some time of running it starts showing broken output:

$ timeout --signal=SIGINT 30m python pwb.py weblinkchecker -lang:cs -ns:0 -start:Kníže
Retrieving 240 pages from wikipedia:cs.


>>> Kníže <<<


>>> Kníže-biskup <<<
WARNING: Http response status 404
*[[Kníže-biskup]] links to http://www.rmm.cz/dietrichstein/dietrich/maxmilian_2.html - 404.


>>> Kníže-velkopřevor <<<


>>> Kníže (rozcestník) <<<

...

...

>>> Klokočůvek <<<
STDOUT:pywiki:

>>> {lightpurple}Klokočůvek{default} <<<
VERBOSE:pywiki:Working on 'Kloktat dehet'


>>> Kloktat dehet <<<
STDOUT:pywiki:

>>> {lightpurple}Kloktat dehet{default} <<<
WARNING: Http response status 404
WARNING:pywiki:Http response status 404
*[[Klokočůvek]] links to http://aplikace.mvcr.cz/adresa/t/odry/kloko.html - 404.
INFO:pywiki:*[[Klokočůvek]] links to http://aplikace.mvcr.cz/adresa/t/odry/kloko.html - 404.
WARNING: Http response status 404
WARNING:pywiki:Http response status 404
*[[Kloktat dehet]] links to http://www.ibabylon.cz/kloktat-dehet-jachyma-topola-a-ilustrace-juraje-horvatha - 404.
INFO:pywiki:*[[Kloktat dehet]] links to http://www.ibabylon.cz/kloktat-dehet-jachyma-topola-a-ilustrace-juraje-horvatha - 404.
VERBOSE:pywiki:Working on 'Kloktání'


>>> Kloktání <<<
STDOUT:pywiki:

TASK DETAIL

https://phabricator.wikimedia.org/T185561

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Dvorapa
Cc: zhuyifei1999, Aklapper, pywikibot-bugs-list, Dvorapa, Magul, Tbscho, rafidaslam, MayS, Mdupont, JJMC89, Avicennasis, jayvdb, Dalba, Masti, Alchimista, Rxy

_______________________________________________
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs