Re: [Wikidata-tech] How to respect throttling and retry-after headers on the Wikidata Query Service.

2019-11-17 Thread Maarten Dammers
Hi Andra, Pywikibot should take care of that for you, see https://github.com/wikimedia/pywikibot/blob/master/pywikibot/comms/http.py#L317 Maarten On 02-11-19 11:36, Andra Waagmeester wrote: Hi,     I hope this is the right mailing list to discuss this issue. Some time ago I ran into a

Re: [Wikidata-tech] How to respect throttling and retry-after headers on the Wikidata Query Service.

2019-11-06 Thread Guillaume Lederrey
Hello! Sorry for the late reply. On Sat, Nov 2, 2019 at 12:31 PM Andra Waagmeester wrote: > Thanks for your prompt response. I wasn't filtering for 429, but only for > 503, so that might explain it. > This is my current countermeasure against overloading the system: > > >

Re: [Wikidata-tech] How to respect throttling and retry-after headers on the Wikidata Query Service.

2019-11-02 Thread Andra Waagmeester
Thanks for your prompt response. I wasn't filtering for 429, but only for 503, so that might explain it. This is my current countermeasure against overloading the system: https://github.com/SuLab/WikidataIntegrator/blob/v0.4.3/wikidataintegrator/wdi_core.py#L1179 If you follow all that, you