Xqt created this task.
Xqt added projects: Pywikibot, Pywikibot-archivebot.py.
Restricted Application added subscribers: pywikibot-bugs-list, Aklapper.

TASK DESCRIPTION
  **Steps to replicate the issue**:
  
  pwb -simulate archivebot -lang:en -async
  
  **What happens?**:
  The memory usage increases a lot. Probably a MemoryError could occurr when 
running for the whole wiki.
  
  The reason is the internal queue of ThreadPoolExecutor which is an unlimited 
SimpleQueue (or unlimited Queue for < Python 3.7). This queue holds all pending 
tasks references to the archive template retrieved from generator.
  
  **What should have happened instead?**:
  The memory usage should not be exhausing.
  
  **Software version**:
  Pywikibot 8.1.0dev3

TASK DETAIL
  https://phabricator.wikimedia.org/T333741

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt
Cc: Aklapper, pywikibot-bugs-list, Xqt, PotsdamLamb, Jyoo1011, JohnsonLee01, 
SHEKH, Dijkstra, Khutuck, Zkhalido, MJL, Viztor, Wenyi, Tbscho, MayS, 
Framawiki, Mdupont, JJMC89, Dvorapa, Altostratus, Avicennasis, mys_721tx, 
jayvdb, Masti, Alchimista
_______________________________________________
pywikibot-bugs mailing list -- [email protected]
To unsubscribe send an email to [email protected]

Reply via email to