I can confirm the throttling is caused by Wikidata. Not sure why I didn't see it before, as I was using that api query that you gave above. Are there some (known) issues currently or should I log a bug on this?
Strainu În dum., 26 ian. 2020 la 00:01, Amir Sarabadani <[email protected]> a scris: > > It should be accessible in > https://grafana.wikimedia.org/d/000000156/wikidata-dispatch?orgId=1&refresh=1m&fullscreen&panelId=22 > but I'm not sure why other types of max lag is not showing up. > > You can also check maxlag like this: > https://www.wikidata.org/w/api.php?action=query&titles=MediaWiki&format=json&maxlag=-1 > > On Sat, Jan 25, 2020 at 10:53 PM Strainu <[email protected]> wrote: >> >> Actually, now that you mention it, it might be because of wikidata - >> I read stuff from there in all affected scripts. If I get throttled >> there 5s for each element, this might account for the long delays. Let >> me see if I can print some debug data. Any suggestion on what I should >> look for regarding Wikidata lag? >> >> În sâm., 25 ian. 2020 la 23:48, Strainu <[email protected]> a scris: >> > >> > All sites. Currently I also encounter other issues (connection >> > timeouts), but the throttling has been going on for days (at least >> > since 1/20). >> > >> > În sâm., 25 ian. 2020 la 23:46, Amir Sarabadani <[email protected]> a >> > scris: >> > > >> > > Is it Wikidata only it's all sites? Wikidata uses another set of >> > > measures for maxlag, like lag between dispatching to other wiki and lag >> > > to WDQS. >> > > >> > > HTH >> > > >> > > On Sat, Jan 25, 2020 at 10:40 PM Strainu <[email protected]> wrote: >> > >> >> > >> Hi, >> > >> >> > >> In the last few days my bots get throttled for minutes and minutes (up >> > >> to 10, on the worse instances) on basically all sites I use (ro.wp, >> > >> commons, wikidata). I knew about write throttle and I use the default >> > >> setting there, but it seems that now I get throttled on read >> > >> operations as well. I use pwb from git, currently synced at >> > >> 0924e1655ef9e61c86e98884226b18d8250da368. >> > >> >> > >> I checked the server lag and it is 0 most times I see the throttling. >> > >> Any idea why do I get throttled for such long periods of time? >> > >> >> > >> Thanks, >> > >> Strainu >> > >> >> > >> _______________________________________________ >> > >> pywikibot mailing list >> > >> [email protected] >> > >> https://lists.wikimedia.org/mailman/listinfo/pywikibot >> > > >> > > >> > > >> > > -- >> > > Amir (he/him) >> > > >> > > _______________________________________________ >> > > pywikibot mailing list >> > > [email protected] >> > > https://lists.wikimedia.org/mailman/listinfo/pywikibot >> >> _______________________________________________ >> pywikibot mailing list >> [email protected] >> https://lists.wikimedia.org/mailman/listinfo/pywikibot > > > > -- > Amir (he/him) > > _______________________________________________ > pywikibot mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/pywikibot _______________________________________________ pywikibot mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/pywikibot
