[Pywikipedia-bugs] [Maniphest] [Commented On] T199615: filter_unique leaks memory

Sat, 14 Jul 2018 13:10:07 -0700

Xqt added a comment.

We could

  • use hash function for the filter_unique key
  • use hash function for the filter_unique key by default
  • use a GeneratorFactory Container attribute to hold the seen pages which could be reused when we have more than one duplicate filter
  • use an container which uses disk space instead of memory (but this could be time consuming)

TASK DETAIL
https://phabricator.wikimedia.org/T199615

EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt
Cc: zhuyifei1999, Xqt, Aklapper, matej_suchanek, pywikibot-bugs-list, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy
_______________________________________________
pywikibot-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

Reply via email to