Jean-Fred, if you want to confirm whether the two are related you can try displaying the site which gets throttled. In my case it was always wikidata.
Strainu Pe vineri, 31 ianuarie 2020, Jean-Frédéric <[email protected]> a scris: > Hi, > > I encountered what I believe is the same issue as others. This happens on > my integraality tool with entirely read-only operations, without any hits > on the Query service. > > I filed <https://phabricator.wikimedia.org/T244030> with my > investigations and the tracing showing how Pywikibot spent over 25 minutes > doing a page.templatesWithParams(). > > Hope that helps, > > -- Jean-Fred > > Le ven. 31 janv. 2020 à 18:32, AntiCompositeNumber < > [email protected]> a écrit : > >> https://phabricator.wikimedia.org/T243701 >> >> On Fri, Jan 31, 2020 at 10:01 AM Albert Villanova del Moral >> <[email protected]> wrote: >> > >> > Hello, >> > >> > Have you finally created a ticket for this issue? It is very annoying: >> sometimes, more than 30 minutes "sleeping". >> > >> > Regards, >> > Albert. >> > >> > Albert VILLANOVA DEL MORAL >> > Phone: +33 6 24 20 42 38 >> > Email: [email protected] >> > >> > >> > Missatge de Amir Sarabadani <[email protected]> del dia ds., 25 de >> gen. 2020 a les 23:55: >> >> >> >> I would recommend creating a ticket against search platform team as >> this is due to WDQS nodes being behind Wikidata's production. >> >> >> >> On Sat, Jan 25, 2020 at 11:27 PM Strainu <[email protected]> wrote: >> >>> >> >>> I can confirm the throttling is caused by Wikidata. Not sure why I >> >>> didn't see it before, as I was using that api query that you gave >> >>> above. Are there some (known) issues currently or should I log a bug >> >>> on this? >> >>> >> >>> Strainu >> >>> >> >>> În dum., 26 ian. 2020 la 00:01, Amir Sarabadani <[email protected]> >> a scris: >> >>> > >> >>> > It should be accessible in https://grafana.wikimedia.org/ >> d/000000156/wikidata-dispatch?orgId=1&refresh=1m&fullscreen&panelId=22 >> but I'm not sure why other types of max lag is not showing up. >> >>> > >> >>> > You can also check maxlag like this: https://www.wikidata.org/w/ >> api.php?action=query&titles=MediaWiki&format=json&maxlag=-1 >> >>> > >> >>> > On Sat, Jan 25, 2020 at 10:53 PM Strainu <[email protected]> >> wrote: >> >>> >> >> >>> >> Actually, now that you mention it, it might be because of wikidata >> - >> >>> >> I read stuff from there in all affected scripts. If I get throttled >> >>> >> there 5s for each element, this might account for the long delays. >> Let >> >>> >> me see if I can print some debug data. Any suggestion on what I >> should >> >>> >> look for regarding Wikidata lag? >> >>> >> >> >>> >> În sâm., 25 ian. 2020 la 23:48, Strainu <[email protected]> a >> scris: >> >>> >> > >> >>> >> > All sites. Currently I also encounter other issues (connection >> >>> >> > timeouts), but the throttling has been going on for days (at >> least >> >>> >> > since 1/20). >> >>> >> > >> >>> >> > În sâm., 25 ian. 2020 la 23:46, Amir Sarabadani < >> [email protected]> a scris: >> >>> >> > > >> >>> >> > > Is it Wikidata only it's all sites? Wikidata uses another set >> of measures for maxlag, like lag between dispatching to other wiki and lag >> to WDQS. >> >>> >> > > >> >>> >> > > HTH >> >>> >> > > >> >>> >> > > On Sat, Jan 25, 2020 at 10:40 PM Strainu <[email protected]> >> wrote: >> >>> >> > >> >> >>> >> > >> Hi, >> >>> >> > >> >> >>> >> > >> In the last few days my bots get throttled for minutes and >> minutes (up >> >>> >> > >> to 10, on the worse instances) on basically all sites I use >> (ro.wp, >> >>> >> > >> commons, wikidata). I knew about write throttle and I use the >> default >> >>> >> > >> setting there, but it seems that now I get throttled on read >> >>> >> > >> operations as well. I use pwb from git, currently synced at >> >>> >> > >> 0924e1655ef9e61c86e98884226b18d8250da368. >> >>> >> > >> >> >>> >> > >> I checked the server lag and it is 0 most times I see the >> throttling. >> >>> >> > >> Any idea why do I get throttled for such long periods of time? >> >>> >> > >> >> >>> >> > >> Thanks, >> >>> >> > >> Strainu >> >>> >> > >> >> >>> >> > >> _______________________________________________ >> >>> >> > >> pywikibot mailing list >> >>> >> > >> [email protected] >> >>> >> > >> https://lists.wikimedia.org/mailman/listinfo/pywikibot >> >>> >> > > >> >>> >> > > >> >>> >> > > >> >>> >> > > -- >> >>> >> > > Amir (he/him) >> >>> >> > > >> >>> >> > > _______________________________________________ >> >>> >> > > pywikibot mailing list >> >>> >> > > [email protected] >> >>> >> > > https://lists.wikimedia.org/mailman/listinfo/pywikibot >> >>> >> >> >>> >> _______________________________________________ >> >>> >> pywikibot mailing list >> >>> >> [email protected] >> >>> >> https://lists.wikimedia.org/mailman/listinfo/pywikibot >> >>> > >> >>> > >> >>> > >> >>> > -- >> >>> > Amir (he/him) >> >>> > >> >>> > _______________________________________________ >> >>> > pywikibot mailing list >> >>> > [email protected] >> >>> > https://lists.wikimedia.org/mailman/listinfo/pywikibot >> >>> >> >>> _______________________________________________ >> >>> pywikibot mailing list >> >>> [email protected] >> >>> https://lists.wikimedia.org/mailman/listinfo/pywikibot >> >> >> >> >> >> >> >> -- >> >> Amir (he/him) >> >> >> >> _______________________________________________ >> >> pywikibot mailing list >> >> [email protected] >> >> https://lists.wikimedia.org/mailman/listinfo/pywikibot >> > >> > _______________________________________________ >> > pywikibot mailing list >> > [email protected] >> > https://lists.wikimedia.org/mailman/listinfo/pywikibot >> >> _______________________________________________ >> pywikibot mailing list >> [email protected] >> https://lists.wikimedia.org/mailman/listinfo/pywikibot >> > > > -- > Jean-Frédéric >
_______________________________________________ pywikibot mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/pywikibot
