Xqt added a comment.
> Now the script says "intersection" even when I use only one category This is intentionally. The script always retrieves the intersection of the pagegenerators' generators and the category`s articles given with `-from` option. The reason is that pagegenerators' generators may be either - the category's articles itself. The CachedRequest will prohibit duplicate load of pages and there is no disadvantage. - a subset of category's articles. The intersect generator halts if all subset articles are processed. In worst case all category's articles has to be processed if the subset elements are found at the end of the of the category's articles. - a superset of category's articles. The intersect generator halts if all articles are processed. In worst case all superset articles has to be processed if the articles elements are found at the end of the of the superset. - a distinct set of articles. In this case both generators of the intersection have to pre processed. But we do not preload the pages during intersection and the generators are bulk loaded with upto 5000 items. The reason for using this intersection is that it has to be verified whether the pages from pagesgenerators are members of the given category anyway. The only other way would be to use `textlib.getCategoryLinks` to get the category links for each page given by the pagegenerators. But preloading the content is necessary in that case and I am not sure whether this is faster then but it uses a lot of memory. TASK DETAIL https://phabricator.wikimedia.org/T318239 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Xqt Cc: Xqt, Aklapper, pywikibot-bugs-list, Vladis13, Jersione, Hellket777, LisafBia6531, 786, Biggs657, PotsdamLamb, Jyoo1011, JohnsonLee01, Juan90264, SHEKH, Dijkstra, Alter-paule, Beast1978, Un1tY, Khutuck, Zkhalido, Hook696, Kent7301, joker88john, Viztor, CucyNoiD, Wenyi, Gaboe420, Giuliamocci, Cpaulf30, Af420, Bsandipan, Chicocvenancio, Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Dvorapa, Altostratus, Neuronton, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista
_______________________________________________ pywikibot-bugs mailing list -- [email protected] To unsubscribe send an email to [email protected]
