Hi, I encountered what I believe is the same issue as others. This happens on my integraality tool with entirely read-only operations, without any hits on the Query service.
I filed <https://phabricator.wikimedia.org/T244030> with my investigations and the tracing showing how Pywikibot spent over 25 minutes doing a page.templatesWithParams(). Hope that helps, -- Jean-Fred Le ven. 31 janv. 2020 à 18:32, AntiCompositeNumber < [email protected]> a écrit : > https://phabricator.wikimedia.org/T243701 > > On Fri, Jan 31, 2020 at 10:01 AM Albert Villanova del Moral > <[email protected]> wrote: > > > > Hello, > > > > Have you finally created a ticket for this issue? It is very annoying: > sometimes, more than 30 minutes "sleeping". > > > > Regards, > > Albert. > > > > Albert VILLANOVA DEL MORAL > > Phone: +33 6 24 20 42 38 > > Email: [email protected] > > > > > > Missatge de Amir Sarabadani <[email protected]> del dia ds., 25 de > gen. 2020 a les 23:55: > >> > >> I would recommend creating a ticket against search platform team as > this is due to WDQS nodes being behind Wikidata's production. > >> > >> On Sat, Jan 25, 2020 at 11:27 PM Strainu <[email protected]> wrote: > >>> > >>> I can confirm the throttling is caused by Wikidata. Not sure why I > >>> didn't see it before, as I was using that api query that you gave > >>> above. Are there some (known) issues currently or should I log a bug > >>> on this? > >>> > >>> Strainu > >>> > >>> În dum., 26 ian. 2020 la 00:01, Amir Sarabadani <[email protected]> > a scris: > >>> > > >>> > It should be accessible in > https://grafana.wikimedia.org/d/000000156/wikidata-dispatch?orgId=1&refresh=1m&fullscreen&panelId=22 > but I'm not sure why other types of max lag is not showing up. > >>> > > >>> > You can also check maxlag like this: > https://www.wikidata.org/w/api.php?action=query&titles=MediaWiki&format=json&maxlag=-1 > >>> > > >>> > On Sat, Jan 25, 2020 at 10:53 PM Strainu <[email protected]> > wrote: > >>> >> > >>> >> Actually, now that you mention it, it might be because of wikidata - > >>> >> I read stuff from there in all affected scripts. If I get throttled > >>> >> there 5s for each element, this might account for the long delays. > Let > >>> >> me see if I can print some debug data. Any suggestion on what I > should > >>> >> look for regarding Wikidata lag? > >>> >> > >>> >> În sâm., 25 ian. 2020 la 23:48, Strainu <[email protected]> a > scris: > >>> >> > > >>> >> > All sites. Currently I also encounter other issues (connection > >>> >> > timeouts), but the throttling has been going on for days (at least > >>> >> > since 1/20). > >>> >> > > >>> >> > În sâm., 25 ian. 2020 la 23:46, Amir Sarabadani < > [email protected]> a scris: > >>> >> > > > >>> >> > > Is it Wikidata only it's all sites? Wikidata uses another set > of measures for maxlag, like lag between dispatching to other wiki and lag > to WDQS. > >>> >> > > > >>> >> > > HTH > >>> >> > > > >>> >> > > On Sat, Jan 25, 2020 at 10:40 PM Strainu <[email protected]> > wrote: > >>> >> > >> > >>> >> > >> Hi, > >>> >> > >> > >>> >> > >> In the last few days my bots get throttled for minutes and > minutes (up > >>> >> > >> to 10, on the worse instances) on basically all sites I use > (ro.wp, > >>> >> > >> commons, wikidata). I knew about write throttle and I use the > default > >>> >> > >> setting there, but it seems that now I get throttled on read > >>> >> > >> operations as well. I use pwb from git, currently synced at > >>> >> > >> 0924e1655ef9e61c86e98884226b18d8250da368. > >>> >> > >> > >>> >> > >> I checked the server lag and it is 0 most times I see the > throttling. > >>> >> > >> Any idea why do I get throttled for such long periods of time? > >>> >> > >> > >>> >> > >> Thanks, > >>> >> > >> Strainu > >>> >> > >> > >>> >> > >> _______________________________________________ > >>> >> > >> pywikibot mailing list > >>> >> > >> [email protected] > >>> >> > >> https://lists.wikimedia.org/mailman/listinfo/pywikibot > >>> >> > > > >>> >> > > > >>> >> > > > >>> >> > > -- > >>> >> > > Amir (he/him) > >>> >> > > > >>> >> > > _______________________________________________ > >>> >> > > pywikibot mailing list > >>> >> > > [email protected] > >>> >> > > https://lists.wikimedia.org/mailman/listinfo/pywikibot > >>> >> > >>> >> _______________________________________________ > >>> >> pywikibot mailing list > >>> >> [email protected] > >>> >> https://lists.wikimedia.org/mailman/listinfo/pywikibot > >>> > > >>> > > >>> > > >>> > -- > >>> > Amir (he/him) > >>> > > >>> > _______________________________________________ > >>> > pywikibot mailing list > >>> > [email protected] > >>> > https://lists.wikimedia.org/mailman/listinfo/pywikibot > >>> > >>> _______________________________________________ > >>> pywikibot mailing list > >>> [email protected] > >>> https://lists.wikimedia.org/mailman/listinfo/pywikibot > >> > >> > >> > >> -- > >> Amir (he/him) > >> > >> _______________________________________________ > >> pywikibot mailing list > >> [email protected] > >> https://lists.wikimedia.org/mailman/listinfo/pywikibot > > > > _______________________________________________ > > pywikibot mailing list > > [email protected] > > https://lists.wikimedia.org/mailman/listinfo/pywikibot > > _______________________________________________ > pywikibot mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/pywikibot > -- Jean-Frédéric
_______________________________________________ pywikibot mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/pywikibot
