Mpaa added a comment.
I see:
Media in category "License review needed"
The following 200 files are in this category, out of 17,418 total. <-- this
is probably cached
https://petscan.wmflabs.org/ gives 17406
and the script generates 17406
I had to remove the metadata property in the code, to avoid issues like
T253591 <https://phabricator.wikimedia.org/T253591>.
In such cases I was getting repeated pages, probably because PageGenerator
was getting large metadata info between queries:
8768 8749 - (Category('Category:License review needed'),
FilePage('File:Foolad FC vs Esteghlal FC, 24 June 2020 - 36.jpg'))
8769 8750 - (Category('Category:License review needed'),
FilePage('File:Foolad FC vs Esteghlal FC, 24 June 2020 - 35.jpg'))
8770
/w/api.php?gcmtitle=Category:License+review+needed&gcmprop=ids|title|sortkey&gcmtype=page|file&prop=info|imageinfo|categoryinfo&
inprop=protection&iiprop=timestamp|user|comment|url|size|sha1|metadata&iilimit=max&generator=categorymembers&action=query&indexp
ageids=&continue=gcmcontinue||info|categoryinfo|userinfo&gcmlimit=500&meta=userinfo&uiprop=blockinfo|hasmsg&maxlag=5&format=json
&gcmcontinue=file|3039313338393437320a564c4144494d495220505554494e20494e204952414e20283135292e4a5047|91389472&iicontinue=Charles
_O'Malley,_the_Irish_dragoon_(IA_charlesomalleyir00leve_0).pdf|20200627053136
8771 8751 - (Category('Category:License review needed'),
FilePage('File:Vladimir Putin in Iran (15).jpg'))
8772 8752 - (Category('Category:License review needed'),
FilePage('File:Vladimir Putin in Iran (14).jpg'))
9269 9249 - (Category('Category:License review needed'),
FilePage('File:Foolad FC vs Esteghlal FC, 24 June 2020 - 36.jpg'))
9270 9250 - (Category('Category:License review needed'),
FilePage('File:Foolad FC vs Esteghlal FC, 24 June 2020 - 35.jpg'))
9271
/w/api.php?gcmtitle=Category:License+review+needed&gcmprop=ids|title|sortkey&gcmtype=page|file&prop=info|imageinfo|categoryinfo&
inprop=protection&iiprop=timestamp|user|comment|url|size|sha1|metadata&iilimit=max&generator=categorymembers&action=query&indexp
ageids=&continue=gcmcontinue||info|categoryinfo|userinfo&gcmlimit=500&meta=userinfo&uiprop=blockinfo|hasmsg&maxlag=5&format=json
&gcmcontinue=file|3039313338393437320a564c4144494d495220505554494e20494e204952414e20283135292e4a5047|91389472&iicontinue=Diction
naire_universel_de_la_langue_française_(IA_dictionnaireuniv00bois).pdf|20200623103453
9272 9251 - (Category('Category:License review needed'),
FilePage('File:Vladimir Putin in Iran (15).jpg'))
9273 9252 - (Category('Category:License review needed'),
FilePage('File:Vladimir Putin in Iran (14).jpg'))
TASK DETAIL
https://phabricator.wikimedia.org/T258036
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Mpaa
Cc: Mpaa, Aklapper, pywikibot-bugs-list, Eatcha, JohnsonLee01, SHEKH, Dijkstra,
Khutuck, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, Dvorapa,
Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
_______________________________________________
pywikibot-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
