On Sat, 3 Nov 2018, Vincent Privat wrote:
Yes it's slower and slower over time. I guess it can be improved a lot by using MediaWiki API, see https://josm.openstreetmap.de/ticket/16702
That would help the Wiki side maybe, but probably not us. We do ATM one call per link. I only see a speedup when we could get all the i18n links at once somehow. I check the docs, but didn't find a solution.
There is an easy way for speedup. Use WWW::Mechanize instead of wget calls. But that increases the frequency of page calls and is not so good an idea. That's exactly what I use as rule to block IPs and WIKI admins wont be so different :-)
Ciao -- http://www.dstoecker.eu/ (PGP key available)
