[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Lucas_Werkmeister_WMDE added a comment. In T270249#6830469 , @Lucas_Werkmeister_WMDE wrote: > In any case – at some point, we need to delete those 1.1 milion `wbt_item_term` rows belonging to 9593 deleted item IDs; assuming a batch size

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Lucas_Werkmeister_WMDE moved this task from Doing to Done on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞) board. Lucas_Werkmeister_WMDE closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T270249 WORKBOARD https://phabricator.wikimedia.org/project/board/353

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2021-03-15T12:31:07Z] maintenance scripts for T270249 completed successfully, no more terms for deleted items found on stat1007 TASK DETAIL https://phabricator.wikimedia.org/T27

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2021-03-15T12:23:31Z] lucaswerkmeister-wmde@mwmaint1002:~$ time mwscript extensions/Wikibase/repo/maintenance/RemoveDeletedItemsFromTermStore.php wikidatawiki --itemIds "$(sed -n ,9593p T270249

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2021-03-15T12:13:52Z] lucaswerkmeister-wmde@mwmaint1002:~$ time mwscript extensions/Wikibase/repo/maintenance/RemoveDeletedItemsFromTermStore.php wikidatawiki --itemIds "$(sed -n 555,5554p T270249

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2021-03-15T12:11:21Z] lucaswerkmeister-wmde@mwmaint1002:~$ time mwscript extensions/Wikibase/repo/maintenance/RemoveDeletedItemsFromTermStore.php wikidatawiki --itemIds "$(sed -n 55,554p T270249

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2021-03-15T12:10:04Z] lucaswerkmeister-wmde@mwmaint1002:~$ time mwscript extensions/Wikibase/repo/maintenance/RemoveDeletedItemsFromTermStore.php wikidatawiki --itemIds "$(sed -n 5,54p T270249

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Lucas_Werkmeister_WMDE added a comment. Maintenance script seems to work fine –removing four items brought us down from 9593 items to 9589 items. I’ll call that a successful test and do the rest on Monday. TASK DETAIL https://phabricator.wikimedia.org/T270249 EMAIL PREFERENCES https://p

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2021-03-11T12:13:44Z] lucaswerkmeister-wmde@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/RemoveDeletedItemsFromTermStore.php wikidatawiki --itemIds 581768,739279,774383,852302 # T270249

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Lucas_Werkmeister_WMDE claimed this task. Lucas_Werkmeister_WMDE moved this task from To Do (prioritised from top to bottom) to Doing on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞) board. Lucas_Werkmeister_WMDE added a comment. I’ve added two entries for this on the deployments calen

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Addshore removed Lucas_Werkmeister_WMDE as the assignee of this task. TASK DETAIL https://phabricator.wikimedia.org/T270249 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: Lucas_Werkmeister_WMDE, Aklapper, Addshore, MisterSynergy, noarave

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Addshore moved this task from Stalled/Waiting to To Do (prioritised from top to bottom) on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞) board. Addshore added a comment. Moving back to TODO as the other task is done TASK DETAIL https://phabricator.wikimedia.org/T270249 WORKBOARD

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Lucas_Werkmeister_WMDE moved this task from Peer Review to Stalled/Waiting on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞) board. Lucas_Werkmeister_WMDE added a comment. I created a new task, T274890: Make RemoveDeletedItemsFromTermStore.php maintenance script remove wbt_item_terms r

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Lucas_Werkmeister_WMDE added a comment. So with a new maintenance script, the procedure could look like this: 1. on stats machine: 1. get distinct `wbit_item_id` (9593) 2. get distinct `wbit_term_in_lang_id` (15758) 2. on maintenance host: 1. run to-be-created new maintenance

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Lucas_Werkmeister_WMDE added a comment. Given that there are 9593 distinct item IDs (T263730#6490963 has 9594 distinct results, but that’s because it includes the `log_title` and `log_timestamp` – apparently, one item was deleted twice) and

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Lucas_Werkmeister_WMDE added a comment. Wait, I just realized the maintenance script isn’t enough. We need to do two things: - delete `wbt_item_terms` rows corresponding to deleted items - run maintenance script to remove now-unused terms If we just run the maintenance script on it

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Lucas_Werkmeister_WMDE claimed this task. Lucas_Werkmeister_WMDE moved this task from To Do (prioritised from top to bottom) to Doing on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞) board. TASK DETAIL https://phabricator.wikimedia.org/T270249 WORKBOARD https://phabricator.wikimedia.

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

Lucas_Werkmeister_WMDE added a comment. The maintenance script is `repo/maintenance/RemoveDeletedItemsFromTermStore.php` and will be available in production starting with wmf/1.36.0-wmf.28 (next week). TASK DETAIL https://phabricator.wikimedia.org/T270249 EMAIL PREFERENCES https://phabr

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

noarave updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T270249 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: noarave Cc: Lucas_Werkmeister_WMDE, Aklapper, Addshore, MisterSynergy, noarave, Akuckartz, Iflorez, alaa_wmde,

[Wikidata-bugs] [Maniphest] T270249: Run maintenance script to remove deleted items from term store on production

noarave created this task. noarave added projects: Wikidata, MediaWiki-extensions-WikibaseRepository, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞). TASK DESCRIPTION Maintenance script to be written in T270247 . TASK DETAIL https://phabricator.