[Wikidata-bugs] [Maniphest] T293886: Remove Wikidata query service lag from Wikidata maxlag

2021-10-21 Thread dcausse 
dcausse closed this task as "Declined".
dcausse added a comment.


  In T293886#7446988 , 
@Lydia_Pintscher wrote:
  
  > I agree with Lucas. I think we want to have a safeguard in place in case 
things go wild again and people are starting to push the limits even of the new 
updater.
  
  Declining then, thanks!

TASK DETAIL
  https://phabricator.wikimedia.org/T293886

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: Lydia_Pintscher, Addshore, Lucas_Werkmeister_WMDE, dcausse, Aklapper, 
Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, 
Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T293886: Remove Wikidata query service lag from Wikidata maxlag

2021-10-21 Thread Lydia_Pintscher 
Lydia_Pintscher added a comment.


  I agree with Lucas. I think we want to have a safeguard in place in case 
things go wild again and people are starting to push the limits even of the new 
updater.

TASK DETAIL
  https://phabricator.wikimedia.org/T293886

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lydia_Pintscher
Cc: Lydia_Pintscher, Addshore, Lucas_Werkmeister_WMDE, dcausse, Aklapper, 
Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, 
Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T293886: Remove Wikidata query service lag from Wikidata maxlag

2021-10-20 Thread dcausse 
dcausse updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T293886

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: Addshore, Lucas_Werkmeister_WMDE, dcausse, Aklapper, Invadibot, MPhamWMF, 
maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T293886: Remove Wikidata query service lag from Wikidata maxlag

2021-10-20 Thread dcausse 
dcausse added a comment.


  I don't have much opinion on this so I'll try to ponder to pros & cons:
  
  Arguments in favor of removing it:
  
  - can be cumbersome to operate (maint script running via a cron on 
mwmaint1002)
  - could cause frustration because only well-behaved bots are actually 
throttled
  - if we never had such lag issues on WDQS this feature would not have seen 
light
  
  Arguments in favor of keeping it:
  
  - Exactly was Lucas said, WDQS might become again the bottleneck and we don't 
want it to be increasingly outdated.
  
  Overall if we decide to keep this system in place I would suggest to make 
sure it's in line with the objectives (lag < 10m) and adjust its scaling factor 
accordingly (e.g. if most bots use maxLag=5 make sure that it only breaks is 
wdqs lag is > 10m).

TASK DETAIL
  https://phabricator.wikimedia.org/T293886

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: Addshore, Lucas_Werkmeister_WMDE, dcausse, Aklapper, Invadibot, MPhamWMF, 
maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T293886: Remove Wikidata query service lag from Wikidata maxlag

2021-10-20 Thread Lucas_Werkmeister_WMDE 
Lucas_Werkmeister_WMDE added a comment.


  I don’t think I agree that this is no longer needed. It’s great if the new 
updater has higher throughput, but presumably it’s not infinite, and if the 
edit rate is high enough that the new updater can’t keep up, then we probably 
want to start throttling edits, rather than have an increasingly outdated query 
service?

TASK DETAIL
  https://phabricator.wikimedia.org/T293886

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Addshore, Lucas_Werkmeister_WMDE, dcausse, Aklapper, Invadibot, MPhamWMF, 
maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T293886: Remove Wikidata query service lag from Wikidata maxlag

2021-10-20 Thread dcausse 
dcausse created this task.
dcausse added projects: Wikidata-Query-Service, Wikidata.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  As a maintainer of the wikidata software I want to stop propagating the WDQS 
lag to Wikidata maxlag if it is no longer needed.
  
  T221774  was added to ensure that 
WDQS would not fall too far behind backlog of Wikidata edits. Since then from 
time to time bots respecting the maxLag strategy are being throttled causing 
sometimes frustration from bot owner (ref T243701 
).
  
  Now that the WDQS Streaming Updater is in production I think we can revisit 
the approaches taken to circumvent the poor performances of the WDQS Updater.
  
  AC:
  
  - discuss & agree that T221774  is 
no longer needed
  - undo T221774 

TASK DETAIL
  https://phabricator.wikimedia.org/T293886

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: Addshore, Lucas_Werkmeister_WMDE, dcausse, Aklapper, Invadibot, MPhamWMF, 
maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org