Re: [Wikidata-tech] How to respect throttling and retry-after headers on the Wikidata Query Service.

2019-11-02 Thread Andra Waagmeester
Thanks for your prompt response. I wasn't filtering for 429, but only for 503, so that might explain it. This is my current countermeasure against overloading the system: https://github.com/SuLab/WikidataIntegrator/blob/v0.4.3/wikidataintegrator/wdi_core.py#L1179 If you follow all that, you

[Wikidata-tech] How to respect throttling and retry-after headers on the Wikidata Query Service.

2019-11-02 Thread Andra Waagmeester
Hi, I hope this is the right mailing list to discuss this issue. Some time ago I ran into a series of temporary bans, I thought I managed to tackle this basically by doing a full stop once it gets any response header code other than 200. However, this seems not to have fixed it, since I