[Pywikipedia-bugs] [Maniphest] [Commented On] T194950: Include Wikibase dispatch lag in API "maxlag" enforcing

2018-07-12 Thread Multichill
Multichill added a comment.

In T194950#4420642, @Addshore wrote:
There are still some bots and tools that are not setting appropriate maxlag values for their requests but we can follow up elsewhere with that.


Please list them on https://www.wikidata.org/wiki/Wikidata:Administrators%27_noticeboard and the accounts will be blocked.TASK DETAILhttps://phabricator.wikimedia.org/T194950EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, MultichillCc: Stashbot, Aklapper, gerritbot, pywikibot-bugs-list, ValterVB, Lea_Lacroix_WMDE, Legoktm, Addshore, MisterSynergy, Magnus, Anomie, Sjoerddebruin, Lydia_Pintscher, Multichill, hoo, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, aude, Ricordisamoa, Mbch331___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T194950: Include Wikibase dispatch lag in API "maxlag" enforcing

2018-07-12 Thread Addshore
Addshore added a comment.
Looks like this is all done, and it looks like yesterday for a couple of periods the dispatch lag was high and the maxlag as a result was higher.

F23686506: image.png

It looks like roughly ~6000 requests were stopped due to max lag out of ~20 made yesterday

There are still some bots and tools that are not setting appropriate maxlag values for their requests but we can follow up elsewhere with that.TASK DETAILhttps://phabricator.wikimedia.org/T194950EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, AddshoreCc: Stashbot, Aklapper, gerritbot, pywikibot-bugs-list, ValterVB, Lea_Lacroix_WMDE, Legoktm, Addshore, MisterSynergy, Magnus, Anomie, Sjoerddebruin, Lydia_Pintscher, Multichill, hoo, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, aude, Ricordisamoa, Mbch331___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T194950: Include Wikibase dispatch lag in API "maxlag" enforcing

2018-07-05 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2018-07-05T18:21:19Z]  Synchronized wmf-config/Wikibase-production.php: SWAT: [[gerrit:443939|Set dispatchLagToMaxLagFactor to 60 for wikidata]] T194950 (duration: 00m 51s)TASK DETAILhttps://phabricator.wikimedia.org/T194950EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, StashbotCc: Stashbot, Aklapper, gerritbot, pywikibot-bugs-list, ValterVB, Lea_Lacroix_WMDE, Legoktm, Addshore, MisterSynergy, Magnus, Anomie, Sjoerddebruin, Lydia_Pintscher, Multichill, hoo, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, aude, Ricordisamoa, Mbch331___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T194950: Include Wikibase dispatch lag in API "maxlag" enforcing

2018-07-05 Thread gerritbot
gerritbot added a comment.
Change 443939 merged by jenkins-bot:
[operations/mediawiki-config@master] Set dispatchLagToMaxLagFactor to 60 for wikidata

https://gerrit.wikimedia.org/r/443939TASK DETAILhttps://phabricator.wikimedia.org/T194950EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: Aklapper, gerritbot, pywikibot-bugs-list, ValterVB, Lea_Lacroix_WMDE, Legoktm, Addshore, MisterSynergy, Magnus, Anomie, Sjoerddebruin, Lydia_Pintscher, Multichill, hoo, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, aude, Ricordisamoa, Mbch331___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T194950: Include Wikibase dispatch lag in API "maxlag" enforcing

2018-07-05 Thread gerritbot
gerritbot added a comment.
Change 443939 had a related patch set uploaded (by Ladsgroup; owner: Amir Sarabadani):
[operations/mediawiki-config@master] Set dispatchLagToMaxLagFactor to 60 for wikidata

https://gerrit.wikimedia.org/r/443939TASK DETAILhttps://phabricator.wikimedia.org/T194950EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: Aklapper, gerritbot, pywikibot-bugs-list, ValterVB, Lea_Lacroix_WMDE, Legoktm, Addshore, MisterSynergy, Magnus, Anomie, Sjoerddebruin, Lydia_Pintscher, Multichill, hoo, Andrewjhill, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, aude, Ricordisamoa, Mbch331___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T194950: Include Wikibase dispatch lag in API "maxlag" enforcing

2018-07-03 Thread Magnus
Magnus added a comment.

In T194950#4391332, @Addshore wrote:

In T194950#4322078, @Magnus wrote:
Excellent, that means my existing code should Just Work (tm).


I just checked some of the API logs and it looks like QuickStatementsBot isn't currently passing a maxlag?
 It's currently the biggest api caller for wikidata that isn't passing it.


I should:
https://bitbucket.org/magnusmanske/magnustools/src/c76cc1a06cbd015c12046755a58608cb2aa496d1/public_html/php/oauth.php#lines-416

Unless I'm using it wrong... It does look for the error anyway:
https://bitbucket.org/magnusmanske/magnustools/src/c76cc1a06cbd015c12046755a58608cb2aa496d1/public_html/php/oauth.php#lines-516TASK DETAILhttps://phabricator.wikimedia.org/T194950EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, MagnusCc: Aklapper, gerritbot, pywikibot-bugs-list, ValterVB, Lea_Lacroix_WMDE, Legoktm, Addshore, MisterSynergy, Magnus, daniel, Anomie, Sjoerddebruin, Lydia_Pintscher, Multichill, hoo, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, aude, Ricordisamoa, Mbch331___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T194950: Include Wikibase dispatch lag in API "maxlag" enforcing

2018-07-03 Thread Lea_Lacroix_WMDE
Lea_Lacroix_WMDE added a comment.
Small change: the feature will be activated on Thursday July 5th instead of today.TASK DETAILhttps://phabricator.wikimedia.org/T194950EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, Lea_Lacroix_WMDECc: Aklapper, gerritbot, pywikibot-bugs-list, ValterVB, Lea_Lacroix_WMDE, Legoktm, Addshore, MisterSynergy, Magnus, daniel, Anomie, Sjoerddebruin, Lydia_Pintscher, Multichill, hoo, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, aude, Ricordisamoa, Mbch331___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T194950: Include Wikibase dispatch lag in API "maxlag" enforcing

2018-07-02 Thread Addshore
Addshore added a comment.

In T194950#4322078, @Magnus wrote:
Excellent, that means my existing code should Just Work (tm).


I just checked some of the API logs and it looks like QuickStatementsBot isn't currently passing a maxlag?
It's currently the biggest api caller for wikidata that isn't passing it.TASK DETAILhttps://phabricator.wikimedia.org/T194950EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, AddshoreCc: Aklapper, gerritbot, pywikibot-bugs-list, ValterVB, Lea_Lacroix_WMDE, Legoktm, Addshore, MisterSynergy, Magnus, daniel, Anomie, Sjoerddebruin, Lydia_Pintscher, Multichill, hoo, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, aude, Ricordisamoa, Mbch331___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs


[Pywikipedia-bugs] [Maniphest] [Commented On] T194950: Include Wikibase dispatch lag in API "maxlag" enforcing

2018-07-02 Thread Anomie
Anomie added a comment.

In T194950#4322078, @Magnus wrote:
maxlag does not appear to be documented for the query action...


That's because it's a parameter to the "main" module, not the query action.TASK DETAILhttps://phabricator.wikimedia.org/T194950EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, AnomieCc: Aklapper, gerritbot, pywikibot-bugs-list, ValterVB, Lea_Lacroix_WMDE, Legoktm, Addshore, MisterSynergy, Magnus, daniel, Anomie, Sjoerddebruin, Lydia_Pintscher, Multichill, hoo, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, lisong, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, aude, Ricordisamoa, Mbch331___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs