|zhuyifei1999 added a comment.|
Fix your OOM killer :). Hard shutdown is for when the kernel itself crashes (and in my case I have kexec/kdump to avoid hard shutdowns in most of kernel crashes).
I'll look into patches and test them tommorow. Thanks both Dalba and zhuyifei1999 for analysis and fixes. Is there something I can help with/test?
The script freeze was caused by a semaphore not being released properly, as least in one case. I was unable to reproduce it after the submitted patch is applied.
The OS freeze is most likely a memory leak, causing OOM condition. My memory profiling shows the giant memory usage is, at least in part, due to the entire history dict being processed entirely in memory rather than in disk. I'm investigating using shelve to workaround it (and submit a patch), and see if the memory still increase unbounded.
Cc: gerritbot, Dalba, Xqt, Zoranzoki21, zhuyifei1999, Aklapper, pywikibot-bugs-list, Dvorapa, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Magul, Tbscho, rafidaslam, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Avicennasis, jayvdb, Masti, Alchimista, Rxy
_______________________________________________ pywikibot-bugs mailing list email@example.com https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs