[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
hoo added subtasks: T179008: Wikidata change propagation: introduce --batch-grace parameter to replace --dispatch-interval, T179006: Wikidata change propagation: set reduce dispatcher randomness and shorten dispatch interval. TASK DETAILhttps://phabricator.wikimedia.org/T108944EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Addshore, Liuxinyu970226, PokestarFan, Sjoerddebruin, hoo, Lydia_Pintscher, Jonas, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
hoo added a subtask: T179060: Dispatchers occasionally seem to "freeze" for certain wikis. TASK DETAILhttps://phabricator.wikimedia.org/T108944EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: PokestarFan, Sjoerddebruin, hoo, Lydia_Pintscher, Jonas, Aklapper, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
hoo removed a subtask: T173119: Implement more nuanced patrolling relevant changes in Wikidata based on usage. TASK DETAILhttps://phabricator.wikimedia.org/T108944EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: PokestarFan, Sjoerddebruin, hoo, Lydia_Pintscher, Jonas, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
Halfak added a subtask: T173119: Implement more nuanced patrolling relevant changes in Wikidata based on usage. TASK DETAILhttps://phabricator.wikimedia.org/T108944EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HalfakCc: PokestarFan, Sjoerddebruin, hoo, Lydia_Pintscher, Jonas, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
hoo added a subtask: T173008: Create a maintenance script for pruning stale entity subscriptions and run periodically. TASK DETAILhttps://phabricator.wikimedia.org/T108944EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: PokestarFan, Sjoerddebruin, hoo, Lydia_Pintscher, Jonas, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
hoo added a subtask: T171784: Merge LockManagerSqlChangeDispatchCoordinator into SqlChangeDispatchCoordinator, remove legacy locking. TASK DETAILhttps://phabricator.wikimedia.org/T108944EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: PokestarFan, Sjoerddebruin, hoo, Lydia_Pintscher, Jonas, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
matej_suchanek added a subtask: T113606: [Task] dispatchChanges should dispatch to local wiki if client functionality is enabled on the repo. TASK DETAILhttps://phabricator.wikimedia.org/T108944EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: hoo, Lydia_Pintscher, Jonas, Aklapper, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
hoo added a blocking task: T126874: Don't save non-sitelink diffs in wb_changes. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: hoo Cc: hoo, Lydia_Pintscher, Jonas, Aklapper, Izno, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
JanZerebecki added a blocking task: T111353: [Task] understand MW jobQueue system and write RFC on how dispatching will use it. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: JanZerebecki Cc: hoo, Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
aude added a blocking task: T110343: [Task] Rewrite EntityChange, drop dependency on ORMRow and ORMTable. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: aude Cc: hoo, Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
daniel removed blocking tasks: T111353: understand MW jobQueue system and write RFC on how dispatching will use it, T70381: [Task] [Dispatch via delayed job] Implement the trigger job, T70382: [Task] [Dispatch via delayed job] schedule trigger jobs on each change. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: daniel Cc: hoo, Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
Lydia_Pintscher added a blocking task: T109821: Avoid unserializing metadata, especially diffs, when processing changes. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lydia_Pintscher Cc: hoo, Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
Lydia_Pintscher added a blocking task: T111008: Deserialize only the site link diff when dispatching changes. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lydia_Pintscher Cc: hoo, Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
aude added a blocking task: T111056: [Task] Replace ChangesTable orm abstraction with ChangeStore and ChangeLookup. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: aude Cc: hoo, Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
aude added a blocking task: T110528: [Task] Use JOIN to find changes relevant for a given wiki. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: aude Cc: hoo, Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
Lydia_Pintscher added a blocking task: T109088: [Task] Profiling and investigate how to improve performance of change dispatcher. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lydia_Pintscher Cc: hoo, Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
Jonas added a blocking task: T65411: wikis not removed from wb_changes_dispatch table when removed from localClientDatabases setting. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Jonas Cc: Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
Lydia_Pintscher added a blocking task: T75647: make sure dispatch lag gets logged/graphed somewhere. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lydia_Pintscher Cc: Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
Jonas added blocking tasks: T50140: DispatchStats refactoring and API, T105592: change dispatcher should limit the amount of filtered changes in one go, T48643: Dispatching via delayed jobs (instead of cron script), T70382: [Dispatch via delayed job] schedule trigger jobs on each change, T70381: [Dispatch via delayed job] Implement the trigger job. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Jonas Cc: Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
Lydia_Pintscher added a blocking task: T107722: Make client change handling scale by batching updates. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lydia_Pintscher Cc: hoo, Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
Reedy removed a project: Epic. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Reedy Cc: Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
Jonas added projects: Epic, Wikidata. Jonas set Security to None. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Jonas Cc: Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T108944: [Epic] Improve change dispatching
Reedy added a project: Epic. TASK DETAIL https://phabricator.wikimedia.org/T108944 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Reedy Cc: Lydia_Pintscher, Jonas, Aklapper, Wikidata-bugs, aude, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs