| Ladsgroup added a project: Wikidata-Sprint-2018-02-28. Ladsgroup updated the task description. (Show Details) |
CHANGES TO TASK DESCRIPTION
`wb_terms` with 1.4B rows (with average of 140 bytes per row) is one of the biggest tables on wikidata.org that needs cleanun in several areas: up in several areas:
- Drop `term_entity_id` (and maybe `term_entity_type`) in favor of `term_full_entity_id`. We just switched to reading from term_full_entity_id everywhere.
- Drop- Normalize `term_entity_id` (and maybe `term_entity_type`) in favor of `term_full_entity_id`type` (item=0, property=1, etc.) if we are not dropping it. It's better to be a settings file
- Normalize `term_entity_type` (item=0label=0, property=1, etc.) if we are not dropping itetc.). It's better to be a settings file
- Normalize `term_type` (label=0lang` (en=0, een-gb =1, etc.)
in either another table or a settings file
How we are going to normalize (where to store the mapping) and migration plan needs to be determined.
- Drop `term_entity_id` (and maybe `term_entity_type`) in favor of `term_full_entity_id`. We just switched to reading from term_full_entity_id everywhere.
- Drop- Normalize `term_entity_id` (and maybe `term_entity_type`) in favor of `term_full_entity_id`type` (item=0, property=1, etc.) if we are not dropping it. It's better to be a settings file
- Normalize `term_entity_type` (item=0label=0, property=1, etc.) if we are not dropping itetc.). It's better to be a settings file
- Normalize `term_type` (label=0lang` (en=0, een-gb =1, etc.)
in either another table or a settings file
How we are going to normalize (where to store the mapping) and migration plan needs to be determined.
TASK DETAIL
EMAIL PREFERENCES
To: Ladsgroup
Cc: Lucas_Werkmeister_WMDE, Aklapper, WMDE-leszek, RazShuty, daniel, Lydia_Pintscher, Ladsgroup, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331
Cc: Lucas_Werkmeister_WMDE, Aklapper, WMDE-leszek, RazShuty, daniel, Lydia_Pintscher, Ladsgroup, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
