[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[gerritbot]

gerritbot added a comment.


  Change 596015 **merged** by jenkins-bot:
  [mediawiki/extensions/Wikibase@master] Add some deprecated annotations to 
some old terms classes
  
  https://gerrit.wikimedia.org/r/596015

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Mahir256, Pasleim, Jony, Lea_Lacroix_WMDE, Bugreporter, Ladsgroup, 
JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, Marostegui, 
Jdforrester-WMF, Addshore, Aklapper, Blissjay007, Oblanco79, Alter-paule, 
Beast1978, Un1tY, Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, 
darthmon_wmde, Kent7301, Meekrab2012, joker88john, CucyNoiD, Nandana, 
NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, 
Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, Pablo-WMDE, 
GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, 
LawExplorer, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[gerritbot]

gerritbot added a comment.


  Change 596015 had a related patch set uploaded (by Addshore; owner: Addshore):
  [mediawiki/extensions/Wikibase@master] Add some deprecated annotations to 
some old terms classes
  
  https://gerrit.wikimedia.org/r/596015

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Mahir256, Pasleim, Jony, Lea_Lacroix_WMDE, Bugreporter, Ladsgroup, 
JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, Marostegui, 
Jdforrester-WMF, Addshore, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, 
Pablo-WMDE, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Stashbot]

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-04-07T01:05:04Z] 
 Synchronized 
php-1.35.0-wmf.26/extensions/Wikibase/repo/includes/Store/Sql/DatabaseSchemaUpdater.php:
 T208425  T249565 
 Follow-up a956c655 
:
 Only avoid dropping wb_items_per_site so prod can be merged (duration: 00m 58s)

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Mahir256, Pasleim, Jony, Lea_Lacroix_WMDE, Bugreporter, Ladsgroup, 
JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, Marostegui, 
Jdforrester-WMF, Addshore, Aklapper, Oblanco79, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Kent7301, 
Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[gerritbot]

gerritbot added a comment.


  Change 586480 **merged** by jenkins-bot:
  [mediawiki/extensions/Wikibase@wmf/1.35.0-wmf.26] Follow-up a956c655 
:
 Only avoid dropping wb_items_per_site so prod can be merged
  
  https://gerrit.wikimedia.org/r/586480

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Mahir256, Pasleim, Jony, Lea_Lacroix_WMDE, Bugreporter, Ladsgroup, 
JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, Marostegui, 
Jdforrester-WMF, Addshore, Aklapper, Oblanco79, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Kent7301, 
Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[gerritbot]

gerritbot added a comment.


  Change 586467 **merged** by jenkins-bot:
  [mediawiki/extensions/Wikibase@master] Do not try to drop wb_items_per_site 
when there's no wb_terms table
  
  https://gerrit.wikimedia.org/r/586467

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Mahir256, Pasleim, Jony, Lea_Lacroix_WMDE, Bugreporter, Ladsgroup, 
JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, Marostegui, 
Jdforrester-WMF, Addshore, Aklapper, Oblanco79, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Kent7301, 
Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Stashbot]

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-04-07T00:01:28Z] 
 Synchronized 
php-1.35.0-wmf.26/extensions/Wikibase/repo/includes/Store/Sql/DatabaseSchemaUpdater.php:
 Do not try to drop things when theres no wb_terms table T208425 
 T249565 
 cache bust (duration: 01m 01s)

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Mahir256, Pasleim, Jony, Lea_Lacroix_WMDE, Bugreporter, Ladsgroup, 
JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, Marostegui, 
Jdforrester-WMF, Addshore, Aklapper, Oblanco79, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Kent7301, 
Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[gerritbot]

gerritbot added a comment.


  Change 586469 **merged** by Addshore:
  [mediawiki/extensions/Wikibase@wmf/1.35.0-wmf.26] Do not try to drop things 
when there's no wb_terms table
  
  https://gerrit.wikimedia.org/r/586469

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Mahir256, Pasleim, Jony, Lea_Lacroix_WMDE, Bugreporter, Ladsgroup, 
JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, Marostegui, 
Jdforrester-WMF, Addshore, Aklapper, Oblanco79, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Kent7301, 
Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[gerritbot]

gerritbot added a comment.


  Change 586469 had a related patch set uploaded (by Ladsgroup; owner: 
Ladsgroup):
  [mediawiki/extensions/Wikibase@wmf/1.35.0-wmf.26] Do not try to drop things 
when there's no wb_terms table
  
  https://gerrit.wikimedia.org/r/586469

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Mahir256, Pasleim, Jony, Lea_Lacroix_WMDE, Bugreporter, Ladsgroup, 
JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, Marostegui, 
Jdforrester-WMF, Addshore, Aklapper, Oblanco79, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Kent7301, 
Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[gerritbot]

gerritbot added a comment.


  Change 586467 had a related patch set uploaded (by Ladsgroup; owner: 
Ladsgroup):
  [mediawiki/extensions/Wikibase@master] Do not try to drop things when there's 
no wb_terms table
  
  https://gerrit.wikimedia.org/r/586467

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Mahir256, Pasleim, Jony, Lea_Lacroix_WMDE, Bugreporter, Ladsgroup, 
JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, Marostegui, 
Jdforrester-WMF, Addshore, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Mahir256]

Mahir256 added a comment.


  In T208425#5992965 , 
@Bugreporter wrote:
  
  > To find the number of labels in a specific languages, you can use 
ElasticSearch: https://www.wikidata.org/w/index.php?search=haslabel%3Abn though 
this will not work in aliases.
  
  This does not yield a number that I would expect; for a language like Khowar 
(khw), which is not updated frequently (or at all?) on Wikidata, I obtained a 
number close to 270k when searching "haslabel:khw" today, which compared to the 
numbers in this table 
 for 
that language doesn't make much sense.
  
  Beyond this, however, there was an element of convenience in being able to 
obtain such a number for a small set of languages in one go (maybe not all 
languages at once, but perhaps in segments?), and I was hoping to replicate 
this element by rewriting this query to use the new databases.

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Mahir256
Cc: Mahir256, Pasleim, Jony, Lea_Lacroix_WMDE, Bugreporter, Ladsgroup, 
JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, Marostegui, 
Jdforrester-WMF, Addshore, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Bugreporter]

Bugreporter added a comment.


  To find the number of labels in a specific languages, you can use 
ElasticSearch: https://www.wikidata.org/w/index.php?search=haslabel%3Abn though 
this will not work in aliases.

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Bugreporter
Cc: Mahir256, Pasleim, Jony, Lea_Lacroix_WMDE, Bugreporter, Ladsgroup, 
JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, Marostegui, 
Jdforrester-WMF, Addshore, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Marostegui]

Marostegui added a comment.


  Following up the conversation on IRC with @Ladsgroup I have renamed 
`wb_terms` to `T208425_wb_terms` on the following hosts and wikis (all in 
codfw):
  
root@cumin1001:/home/marostegui# for i in db2106 db2109 db2081; do echo $i; 
mysql.py -h$i information_schema -e "select table_schema,table_name from tables 
where table_name like '%wb_terms';";done
db2106
+-+--+
| table_schema| table_name   |
+-+--+
| commonswiki | T208425_wb_terms |
| testcommonswiki | T208425_wb_terms |
+-+--+
db2109
+--+--+
| table_schema | table_name   |
+--+--+
| testwikidatawiki | T208425_wb_terms |
+--+--+
db2081
+--+--+
| table_schema | table_name   |
+--+--+
| wikidatawiki | T208425_wb_terms |
+--+--+
  
  None of those hosts have slaves. 
  If there are any writes, replication will break and we'll notice.
  
  If that happens, we just need to revert and restart replication with:
  
set session sql_log_bin=0; rename table  T208425_wb_terms to wb_terms; 
start slave;"
  
  Let's give it 24h or so. Once we are fully sure nothing is writing, maybe we 
can move forward and rename the table on s3 (testwikidatawiki) eqiad host and 
monitor for errors.

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Marostegui
Cc: Bugreporter, Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, 
alaa_wmde, Marostegui, Jdforrester-WMF, Addshore, Aklapper, Iflorez, 
darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
Minhnv-2809, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331, Jay8g, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Stashbot]

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-03-18T14:17:58Z]  
Rename wb_terms on codfw hosts: s8 (wikidatawiki - db2081), s3 
(testwikidatawiki - db2109), s4 (commonswiki, testcommonswiki - db2106)  
T208425 

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Bugreporter, Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, 
alaa_wmde, Marostegui, Jdforrester-WMF, Addshore, Aklapper, darthmon_wmde, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Ladsgroup]

Ladsgroup added a comment.


  In T208425#5979419 , 
@Bugreporter wrote:
  
  > In T208425#5978810 , 
@Stashbot wrote:
  >
  >> Mentioned in SAL (#wikimedia-operations) [2020-03-18T10:58:04Z] 
 Synchronized wmf-config/InitialiseSettings.php: 
[[gerrit:579925|Stop writing to old term store (wb_terms table) in wikidata 
(T208425 )]], take II (duration: 01m 
06s)
  >
  > @Ladsgroup: This is a breaking change. Please announce it at Project chat.
  
  This has been 
[https://lists.wikimedia.org/pipermail/wikidata/2019-May/013052.html announced 
a year ago]. We will announce again soon.

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Bugreporter, Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, 
alaa_wmde, Marostegui, Jdforrester-WMF, Addshore, Aklapper, darthmon_wmde, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Bugreporter]

Bugreporter added a comment.


  In T208425#5978810 , 
@Stashbot wrote:
  
  > Mentioned in SAL (#wikimedia-operations) [2020-03-18T10:58:04Z] 
 Synchronized wmf-config/InitialiseSettings.php: 
[[gerrit:579925|Stop writing to old term store (wb_terms table) in wikidata 
(T208425 )]], take II (duration: 01m 
06s)
  
  @Ladsgroup: This is a breaking change. Please announce it at Project chat.

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Bugreporter
Cc: Bugreporter, Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, 
alaa_wmde, Marostegui, Jdforrester-WMF, Addshore, Aklapper, darthmon_wmde, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Stashbot]

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-03-18T10:58:04Z] 
 Synchronized wmf-config/InitialiseSettings.php: 
[[gerrit:579925|Stop writing to old term store (wb_terms table) in wikidata 
(T208425 )]], take II (duration: 01m 
06s)

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, 
Marostegui, Jdforrester-WMF, Addshore, Aklapper, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Meekrab2012, 
joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Stashbot]

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-03-18T10:55:47Z] 
 Synchronized wmf-config/InitialiseSettings.php: 
[[gerrit:579925|Stop writing to old term store (wb_terms table) in wikidata 
(T208425 )]] (duration: 01m 08s)

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, 
Marostegui, Jdforrester-WMF, Addshore, Aklapper, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Meekrab2012, 
joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[gerritbot]

gerritbot added a comment.


  Change 580881 **merged** by jenkins-bot:
  [operations/mediawiki-config@master] Stop writing to old term store (wb_terms 
table) in wikidata
  
  https://gerrit.wikimedia.org/r/580881

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, 
Marostegui, Jdforrester-WMF, Addshore, Aklapper, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Meekrab2012, 
joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[gerritbot]

gerritbot added a comment.


  Change 580881 had a related patch set uploaded (by Ladsgroup; owner: 
Ladsgroup):
  [operations/mediawiki-config@master] Stop writing to old term store (wb_terms 
table) in wikidata
  
  https://gerrit.wikimedia.org/r/580881

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, 
Marostegui, Jdforrester-WMF, Addshore, Aklapper, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Meekrab2012, 
joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Stashbot]

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-03-18T10:48:31Z] 
 Synchronized wmf-config/InitialiseSettings.php: 
[[gerrit:579925|Stop writing to old term store in testwikidatawiki (T208425 
)]], take II (duration: 01m 07s)

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, 
Marostegui, Jdforrester-WMF, Addshore, Aklapper, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Meekrab2012, 
joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Stashbot]

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-03-18T10:45:44Z] 
 Synchronized wmf-config/InitialiseSettings.php: 
[[gerrit:579925|Stop writing to old term store in testwikidatawiki (T208425 
)]] (duration: 01m 07s)

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, 
Marostegui, Jdforrester-WMF, Addshore, Aklapper, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Meekrab2012, 
joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[gerritbot]

gerritbot added a comment.


  Change 580876 **merged** by jenkins-bot:
  [operations/mediawiki-config@master] Stop writing to old term store in 
testwikidatawiki
  
  https://gerrit.wikimedia.org/r/580876

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, 
Marostegui, Jdforrester-WMF, Addshore, Aklapper, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Meekrab2012, 
joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[gerritbot]

gerritbot added a comment.


  Change 580876 had a related patch set uploaded (by Ladsgroup; owner: 
Ladsgroup):
  [operations/mediawiki-config@master] Stop writing to old term store in 
testwikidatawiki
  
  https://gerrit.wikimedia.org/r/580876

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, 
Marostegui, Jdforrester-WMF, Addshore, Aklapper, darthmon_wmde, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Marostegui]

Marostegui added a comment.


  In T208425#5978156 , 
@Stashbot wrote:
  
  > Mentioned in SAL (#wikimedia-releng) [2020-03-18T03:16:34Z]  
dropping wb_terms table from wikidatawiki in beta cluster (T219123 
 T219175 
 T208425 
)
  
  <3

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Marostegui
Cc: Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, 
Marostegui, Jdforrester-WMF, Addshore, Aklapper, darthmon_wmde, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Stashbot]

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-releng) [2020-03-18T03:16:34Z]  dropping 
wb_terms table from wikidatawiki in beta cluster (T219123 
 T219175 
 T208425 
)

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, 
Marostegui, Jdforrester-WMF, Addshore, Aklapper, darthmon_wmde, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Addshore]

Addshore added a comment.


  We will also do this in SQL as we progress through reading from more of the 
new schemas.
  See T219123#5844088  where 
this has already been done.

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Ladsgroup, JAllemandou, ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, 
Marostegui, Jdforrester-WMF, Addshore, Aklapper, darthmon_wmde, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[jcrespo]

jcrespo added a comment.


  Thanks a lot for the work on this- may I suggest a step before the next step 
(after rebuilding) of "checking all data, old and new, is consistent". This is 
a lot of data, and even on well thought processes missing rows were discovered 
after I requested a comparison on other well-though migration, which happened 
due to mistakes/existing inconsistencies/aborts. May I request such a step, 
which could be as fast as a simple join query (<5m to run) between old an new 
to check no rows are missing or extra, and have equivalent data?

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jcrespo
Cc: ArielGlenn, jcrespo, Joe, Gehel, alaa_wmde, Marostegui, Jdforrester-WMF, 
Addshore, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T208425: [EPIC] Kill the wb_terms table

[Addshore]

Addshore added a comment.


  In T208425#5054567 , 
@jcrespo wrote:
  
  > I see you are going to ask DBAs at T219145 
, that is great.
  >
  > As a heads up, because I saw there is a chance of starting using other data 
stores (which by itself is not an issue), instead of or in addition to MySQL to 
give a heads up to service operations SREs and probably search too- in the past 
there has been misunderstandings with sending important/data that has to be 
persisted to datastores that ops cannot guarantee persistance/are not properly 
replicated between dcs (e.g. redis). Please do not go beyond the research phase 
without taking SREs with your proposal to avoid future misunderstandings about 
storage requirements. CC @Joe @Gehel
  
  
  Yup, I have already spent some time talking to the search team, and need to 
write up a spec of exactly what we want, why, how we will use it etc.
  Persistence and freshness are things that would not be needed for the elastic 
search work mentioned in the task description, and the fallback would always be 
to sql, but looking up many entity  "terms" for many languages elastic is much 
faster than doing that directly in SQL, even if we then have to lookup any ones 
missing or out of date from elastic back in SQL.
  I should be writing this up this week

TASK DETAIL
  https://phabricator.wikimedia.org/T208425

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: jcrespo, Joe, Gehel, alaa_wmde, Marostegui, Jdforrester-WMF, Addshore, 
Aklapper, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs