[Wikidata-bugs] [Maniphest] [Created] T179006: Wikidata change propagation: set reduce dispatcher randomness and shorten dispatch interval

Wed, 25 Oct 2017 08:14:32 -0700

daniel created this task.
daniel added projects: Wikidata, MediaWiki-Configuration.
Herald added a subscriber: Aklapper.

TASK DESCRIPTION

Every now and then, we see a big spike in dispatch lag, usually for one or two specific wikis. To mitigate this problem and allow the backlog to be dealt with quickly, we should tweak the parameters of the dispatchChanges script to be more suitable for a high volume repo with many clients. particularly:

  • reduce --randomness, perhaps to 3. With the default value of 10, the lagged wiki has a 1/10 chance to be picked for a given dispatcher run.
  • reduce --dispatch-interval to 5. The default of 60 means that the lagged wiki will receive at most one batch of changes per 60 seconds.

TASK DETAIL
https://phabricator.wikimedia.org/T179006

EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: hoo, daniel
Cc: Aklapper, daniel, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair, Legoktm
_______________________________________________
Wikidata-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to