I would recommend creating a ticket against search platform team as this is due to WDQS nodes being behind Wikidata's production.
On Sat, Jan 25, 2020 at 11:27 PM Strainu <[email protected]> wrote: > I can confirm the throttling is caused by Wikidata. Not sure why I > didn't see it before, as I was using that api query that you gave > above. Are there some (known) issues currently or should I log a bug > on this? > > Strainu > > În dum., 26 ian. 2020 la 00:01, Amir Sarabadani <[email protected]> a > scris: > > > > It should be accessible in > https://grafana.wikimedia.org/d/000000156/wikidata-dispatch?orgId=1&refresh=1m&fullscreen&panelId=22 > but I'm not sure why other types of max lag is not showing up. > > > > You can also check maxlag like this: > https://www.wikidata.org/w/api.php?action=query&titles=MediaWiki&format=json&maxlag=-1 > > > > On Sat, Jan 25, 2020 at 10:53 PM Strainu <[email protected]> wrote: > >> > >> Actually, now that you mention it, it might be because of wikidata - > >> I read stuff from there in all affected scripts. If I get throttled > >> there 5s for each element, this might account for the long delays. Let > >> me see if I can print some debug data. Any suggestion on what I should > >> look for regarding Wikidata lag? > >> > >> În sâm., 25 ian. 2020 la 23:48, Strainu <[email protected]> a scris: > >> > > >> > All sites. Currently I also encounter other issues (connection > >> > timeouts), but the throttling has been going on for days (at least > >> > since 1/20). > >> > > >> > În sâm., 25 ian. 2020 la 23:46, Amir Sarabadani <[email protected]> > a scris: > >> > > > >> > > Is it Wikidata only it's all sites? Wikidata uses another set of > measures for maxlag, like lag between dispatching to other wiki and lag to > WDQS. > >> > > > >> > > HTH > >> > > > >> > > On Sat, Jan 25, 2020 at 10:40 PM Strainu <[email protected]> > wrote: > >> > >> > >> > >> Hi, > >> > >> > >> > >> In the last few days my bots get throttled for minutes and minutes > (up > >> > >> to 10, on the worse instances) on basically all sites I use (ro.wp, > >> > >> commons, wikidata). I knew about write throttle and I use the > default > >> > >> setting there, but it seems that now I get throttled on read > >> > >> operations as well. I use pwb from git, currently synced at > >> > >> 0924e1655ef9e61c86e98884226b18d8250da368. > >> > >> > >> > >> I checked the server lag and it is 0 most times I see the > throttling. > >> > >> Any idea why do I get throttled for such long periods of time? > >> > >> > >> > >> Thanks, > >> > >> Strainu > >> > >> > >> > >> _______________________________________________ > >> > >> pywikibot mailing list > >> > >> [email protected] > >> > >> https://lists.wikimedia.org/mailman/listinfo/pywikibot > >> > > > >> > > > >> > > > >> > > -- > >> > > Amir (he/him) > >> > > > >> > > _______________________________________________ > >> > > pywikibot mailing list > >> > > [email protected] > >> > > https://lists.wikimedia.org/mailman/listinfo/pywikibot > >> > >> _______________________________________________ > >> pywikibot mailing list > >> [email protected] > >> https://lists.wikimedia.org/mailman/listinfo/pywikibot > > > > > > > > -- > > Amir (he/him) > > > > _______________________________________________ > > pywikibot mailing list > > [email protected] > > https://lists.wikimedia.org/mailman/listinfo/pywikibot > > _______________________________________________ > pywikibot mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/pywikibot > -- Amir (he/him)
_______________________________________________ pywikibot mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/pywikibot
