[Pywikipedia-bugs] [Maniphest] [Commented On] T199615: filter_unique leaks memory

[Xqt]

Xqt added a comment.

Long-running tasks may end on MemoryError to filter_unique leaks Memory

Why do you assume that?
Try:

from sys import getsizeof
import pwb, pywikibot as py
from pywikibot.tools import filter_unique as f
s = py.Site()
p = py.Page(s, 'Hydraulik')
container = set()
gen = p.getReferences()
gen = PreloadingGenerator(gen)
generator = f(gen, container)
for item in generator:
	pass
getsizeof(container)

gives 16500

container = set()
gen = p.getReferences()
gen = PreloadingGenerator(gen)
generator = f(gen, Container, key=hash)
for item in generator:
	pass
getsizeof(container)

gives 16500 too

No glue where the Memory leakage might come from.

TASK DETAIL

https://phabricator.wikimedia.org/T199615

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt
Cc: zhuyifei1999, Xqt, Aklapper, matej_suchanek, pywikibot-bugs-list, Magul, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, mys_721tx, jayvdb, Dalba, Masti, Alchimista, Rxy

_______________________________________________
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs