[Wikidata-bugs] [Maniphest] [Commented On] T234948: New Wikibase deadlocks on Wikidata wiki since 2019-10-08T00:00:02: Wikibase\Lib\Store\Sql\Terms\{closure} Deadlock found when trying to get lock; tr

Marostegui added a comment. In T234948#5569455 <https://phabricator.wikimedia.org/T234948#5569455>, @alaa_wmde wrote: > Until then, @jcrespo @Marostegui please feel free to kill that script and/or stop running it at all (if possible) when necessary or convenient, and tha

[Wikidata-bugs] [Maniphest] [Updated] T235265: Slow query on SpecialMostLinked creating lag on wikidata slaves

Marostegui added a comment. Yeah, it does run on the vslow replica, the problem is that it causes small delays which triggers T224422#5563013 <https://phabricator.wikimedia.org/T224422#5563013> so it is all connected :) TASK DETAIL https://phabricator.wikimedia.org/T235265

[Wikidata-bugs] [Maniphest] [Created] T235265: Slow query on SpecialMostLinked creating lag on wikidata slaves

Marostegui created this task. Marostegui added projects: MediaWiki-Special-pages, Core Platform Team, Wikidata. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION NOTE: Please feel free to change tags, I am not sure who/which Team tag in here. We have seen

[Wikidata-bugs] [Maniphest] [Commented On] T234948: New Wikibase deadlocks on Wikidata wiki since 2019-10-08T00:00:02: Wikibase\Lib\Store\Sql\Terms\{closure} Deadlock found when trying to get lock; tr

Marostegui added a comment. I had to finally kill the script again as it was causing issues: https://logstash.wikimedia.org/goto/ecd4d01191b76b075ae00f2477a02d38 TASK DETAIL https://phabricator.wikimedia.org/T234948 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Commented On] T234948: New Wikibase deadlocks on Wikidata wiki since 2019-10-08T00:00:02: Wikibase\Lib\Store\Sql\Terms\{closure} Deadlock found when trying to get lock; tr

Marostegui added a comment. The script has started again and there's a query that has been running for 4h already, this might end up like yesterday (T234948#5562987 <https://phabricator.wikimedia.org/T234948#5562987>) https://grafana.wikimedia.org/d/00273/mysql?orgId=1

[Wikidata-bugs] [Maniphest] [Commented On] T234948: New Wikibase deadlocks on Wikidata wiki since 2019-10-08T00:00:02: Wikibase\Lib\Store\Sql\Terms\{closure} Deadlock found when trying to get lock; tr

Marostegui added a comment. For the record: https://grafana.wikimedia.org/d/00273/mysql?orgId=1=eqiad%20prometheus%2Fops=db1087=9104=1570660711651=1570716407042=3 TASK DETAIL https://phabricator.wikimedia.org/T234948 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Commented On] T234948: New Wikibase deadlocks on Wikidata wiki since 2019-10-08T00:00:02: Wikibase\Lib\Store\Sql\Terms\{closure} Deadlock found when trying to get lock; tr

Marostegui added a comment. In T234948#5562953 <https://phabricator.wikimedia.org/T234948#5562953>, @jcrespo wrote: > We found a possible cause even if partial: maintenance queries for Special page update like `SpecialMostLinked::reallyDoQuery` causing lag and general slowdown

[Wikidata-bugs] [Maniphest] [Updated] T189026: IndexPager::buildQueryInfo (contributions page unfiltered) query needs tuning

Marostegui added a project: mariadb-optimizer-bug. TASK DETAIL https://phabricator.wikimedia.org/T189026 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Anomie, Marostegui Cc: gerritbot, Marostegui, Anomie, Aklapper, jcrespo, darthmon_wmde, DannyS712

[Wikidata-bugs] [Maniphest] [Edited] T230788: Community Relations support needed for several read-only windows (s2, s3, s4 and s8)

Marostegui updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Trizek-WMF, Marostegui Cc: DannyS712, Agusbou2015, Znotch190711, Elitre, Trizek-WMF, Whatamidoing-WMF

[Wikidata-bugs] [Maniphest] [Commented On] T230788: Community Relations support needed for several read-only windows (s2, s3, s4 and s8)

Marostegui added a comment. s4 was done: Read-only start: 05:00:51 Read-only stop: 05:01:42 Total read-only time: 51 seconds TASK DETAIL https://phabricator.wikimedia.org/T230788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Trizek

[Wikidata-bugs] [Maniphest] [Commented On] T230788: Community Relations support needed for several read-only windows (s2, s3, s4 and s8)

Marostegui added a comment. Thanks for your support! TASK DETAIL https://phabricator.wikimedia.org/T230788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Trizek-WMF, Marostegui Cc: DannyS712, Agusbou2015, Znotch190711, Elitre, Trizek-WMF

[Wikidata-bugs] [Maniphest] [Edited] T230788: Community Relations support needed for several read-only windows (s2, s3, s4 and s8)

Marostegui updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Trizek-WMF, Marostegui Cc: DannyS712, Agusbou2015, Znotch190711, Elitre, Trizek-WMF, Whatamidoing-WMF

[Wikidata-bugs] [Maniphest] [Updated] T230788: Community Relations support needed for several read-only windows (s2, s3, s4 and s8)

Marostegui added a comment. s3 was done successfully. read only start: 05:10:14 UTC AM read only stop: 05:13:08 UTC AM total read only time: 2 minutes 54 seconds. We had a slightly longer read only time compared to the all the previous ones due to some issues with the way we

[Wikidata-bugs] [Maniphest] [Edited] T230788: Community Relations support needed for several read-only windows (s2, s3, s4 and s8)

Marostegui updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Trizek-WMF, Marostegui Cc: Znotch190711, Elitre, Trizek-WMF, Whatamidoing-WMF, RhinosF1, WMDE-leszek

[Wikidata-bugs] [Maniphest] [Commented On] T230788: Community Relations support needed for several read-only windows (s2, s3, s4 and s8)

Marostegui added a comment. s2 switchover is done read-only start: 05:00:44 read-only stop: 05:01:34 Total read-only time: 50 seconds. TASK DETAIL https://phabricator.wikimedia.org/T230788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Commented On] T230788: Community Relations support needed for several read-only windows (s2, s3, s4 and s8)

Marostegui added a comment. Just for the record, I realised that the banner for today on itwiki is wrong: A breve verrà svolta della manutenzione tecnica. 17 settembre - 05:00 AM UTC - 05:30 AM UTC Durante tale intervallo potresti non riuscire a salvare alcuna modifica. (dalle 15

[Wikidata-bugs] [Maniphest] [Commented On] T225056: Run Item Terms Rebuild script

Marostegui added a comment. Done: root@mwmaint1002:/var/log/wikidata# cat /var/log/wikidata/wikidata-rebuildItemTerms.log Rebuilding Q501 till Q200 root@mwmaint1002:/var/log/wikidata# ls -lh /var/log/wikidata/wikidata-rebuildItemTerms.log -rw-r--r-- 1 www-data www-data

[Wikidata-bugs] [Maniphest] [Commented On] T225056: Run Item Terms Rebuild script

Marostegui added a comment. Let me know when you want me to `touch` it again. TASK DETAIL https://phabricator.wikimedia.org/T225056 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Ladsgroup, Marostegui Cc: Marostegui, Ladsgroup, Aklapper

[Wikidata-bugs] [Maniphest] [Edited] T230788: Community Relations support needed for several read-only windows (s2, s3, s4 and s8)

Marostegui updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Trizek-WMF, Marostegui Cc: Znotch190711, Elitre, Trizek-WMF, Whatamidoing-WMF, RhinosF1, WMDE-leszek

[Wikidata-bugs] [Maniphest] [Commented On] T225056: Run Item Terms Rebuild script

Marostegui added a comment. Merged and as requested at : root@mwmaint1002:~# cat /var/log/wikidata/wikidata-rebuildItemTerms.log Rebuilding Q501 till Q200 root@mwmaint1002:~# ls -lh /var/log/wikidata/wikidata-rebuildItemTerms.log -rw-r--r-- 1 www-data www-data 30 Sep 10

[Wikidata-bugs] [Maniphest] [Commented On] T230788: Community Relations support needed for several read-only windows (s2, s3, s4 and s8)

Marostegui added a comment. s8 (wikidata) has been done today: read-only start: Tue Sep 10 05:00:47 UTC 2019 read-only stop: Tue Sep 10 05:02:14 UTC 2019 Total read-only time: 1 minute 27 seconds. TASK DETAIL https://phabricator.wikimedia.org/T230788 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T230788: Community Relations support needed for several read-only windows (s2, s3, s4 and s8)

Marostegui added a subscriber: Znotch190711. Marostegui added a comment. @Znotch190711 why do you consider this as UBN? TASK DETAIL https://phabricator.wikimedia.org/T230788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Trizek-WMF, Marostegui

[Wikidata-bugs] [Maniphest] [Commented On] T230788: Community Relations support needed for several read-only windows (s2, s3, s4 and s8)

Marostegui added a comment. In T230788#5451733 <https://phabricator.wikimedia.org/T230788#5451733>, @Elitre wrote: > Thanks for confirming! In this case, it'd be helpful to follow the structure suggested at https://office.wikimedia.org/wiki/Community_Relations#Public_requests_

[Wikidata-bugs] [Maniphest] [Edited] T230788: Community Relations support needed for several read-only windows (s2, s3, s4 and s8)

Marostegui updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Trizek-WMF, Marostegui Cc: Elitre, Trizek-WMF, Whatamidoing-WMF, RhinosF1, WMDE-leszek, Lea_Lacroix_WMDE

[Wikidata-bugs] [Maniphest] [Commented On] T230788: Several read-only windows needed for: s2, s3, s4 and s8

Marostegui added a comment. In T230788#5451661 <https://phabricator.wikimedia.org/T230788#5451661>, @Elitre wrote: > @Marostegui is this task only to coordinate our team support? Yes :-) The technical bits are on different tickets TASK DETAIL https://phabricator.wiki

[Wikidata-bugs] [Maniphest] [Commented On] T230788: Several read-only windows needed for: s2, s3, s4 and s8

Marostegui added a comment. That is a broader discussion. Essentially, the architecture we have at the moment (both, systems and MW related) is thought to have only one active master at the time. So only one host receives writes at the time. Having more than one host allowing

[Wikidata-bugs] [Maniphest] [Commented On] T230788: Several read-only windows needed for: s2, s3, s4 and s8

Marostegui added a comment. Sure @Johan, let me know if this is good enough or you need more or less detail. There is an on-site maintenance at our primary datacenter, where the primary database masters are located. The maintenance will be specifically on those racks, and it involves

[Wikidata-bugs] [Maniphest] [Edited] T230788: Several read-only windows needed for: s2, s3, s4 and s8

Marostegui updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Marostegui Cc: Johan, jcrespo, wiki_willy, Aklapper, Marostegui, darthmon_wmde, Viztor, DannyS712, Nandana

[Wikidata-bugs] [Maniphest] [Edited] T230788: Several read-only windows needed for: s2, s3, s4 and s8

Marostegui updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Marostegui Cc: Johan, jcrespo, wiki_willy, Aklapper, Marostegui, darthmon_wmde, Viztor, DannyS712, Nandana

[Wikidata-bugs] [Maniphest] [Updated] T230788: Several read-only windows needed for: s2, s3, s4 and s8

Marostegui added parent tasks: T230762: Switchover s8 (wikidata) primary database master db1104 -> db1109 - 10th Sept @05:00 UTC, T230783: Switchover s3 primary database master db1075 -> db1078 - 24th Sept @05:00 UTC, T230784: Switchover s4 (commonswiki) primary database master db1081 -&g

[Wikidata-bugs] [Maniphest] [Created] T230788: Several read-only windows needed for: s2, s3, s4 and s8

Marostegui created this task. Marostegui added projects: Wikidata, Commons, User-notice, Community-Relations. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Due to on-site maintenance (T226778 <https://phabricator.wikimedia.org/T226778>) going on some of the

[Wikidata-bugs] [Maniphest] [Commented On] T225053: Switch `tmpPropertyTermsMigrationStage` to MIGRATION_WRITE_NEW

Marostegui added a comment. F29937909: mysql.png <https://phabricator.wikimedia.org/F29937909> While having the `read_key` handler being used isn't a bad thing, I think there is a pattern there that needs some investigation as the spikes are huge and very consistent - there's som

[Wikidata-bugs] [Maniphest] [Closed] T227063: Database primary master failover on s8 (wikidatawiki)

Marostegui closed this task as "Resolved". Marostegui added a comment. The failover was done successfully. read-only start: 05:00:50 read-only stop: 05:02:21 Total read-only time: 01:31 minutes Thanks for helping with the communication with the community! TASK DETA

[Wikidata-bugs] [Maniphest] [Triaged] T227063: Database primary master failover on s8 (wikidatawiki)

Marostegui triaged this task as "Normal" priority. Marostegui added a comment. Thank you! TASK DETAIL https://phabricator.wikimedia.org/T227063 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Marostegui Cc: Elitre, Lea_La

[Wikidata-bugs] [Maniphest] [Created] T227063: Database primary master failover on s8 (wikidatawiki)

Marostegui created this task. Marostegui added projects: User-notice, Wikidata, CommRel-Specialists-Support (Jul-Sep-2019). TASK DESCRIPTION We need to replace the current primary database master for wikidatawiki. This host is old and out of warranty, so needs to be decommissioned

[Wikidata-bugs] [Maniphest] [Commented On] T214362: RFC: Store WikibaseQualityConstraint check data in persistent storage

Marostegui added a comment. Just a quick question: "this would fit a generalized parser cache mechanism" meaning it would fit into the existing parsercache mechanism (and infrastructure) or is that still to be defined? Thanks! TASK DETAIL https://phabricator.wikimedia.org/T214

[Wikidata-bugs] [Maniphest] [Unblock] T221543: Travis test fails for wikidata:wikidata site

Marostegui closed subtask T220999: Slow query ApiQueryLogEvents::execute after actor rollout as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T221543 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Xqt, Marostegui Cc: Anomie, Aklapper

[Wikidata-bugs] [Maniphest] [Commented On] T221380: Wikidata: Special:Contributions times out for many high-activity users

Marostegui added a comment. It is believed that T221380#5131440 <https://phabricator.wikimedia.org/T221380#5131440> will fix the issue. https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/505814/ is under review. TASK DETAIL https://phabricator.wikimedia.org/T221380 EMAIL PREFE

[Wikidata-bugs] [Maniphest] [Updated] T221380: Wikidata: Special:Contributions times out for many high-activity users

Marostegui added a comment. I have been talking to @Anomie about this issue, and it is believed that it doesn't seem to be the same thing as T221458 <https://phabricator.wikimedia.org/T221458> or T220999 <https://phabricator.wikimedia.org/T220999>, but it is related to the `ac

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T221380: Wikidata: Special:Contributions times out for many high-activity users

Marostegui added subscribers: Anomie, Marostegui. Marostegui added a comment. This is the explain for wikidatawiki

[Wikidata-bugs] [Maniphest] [Commented On] T219142: Send the schema to DBAs and follow up with their review

Marostegui added a comment. I saw that the patch was merged, can this be closed then? TASK DETAIL https://phabricator.wikimedia.org/T219142 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: alaa_wmde, Marostegui Cc: Marostegui, Addshore, Aklapper

[Wikidata-bugs] [Maniphest] [Commented On] T219145: Pass migration plan to DBAs for review

Marostegui added a comment. In T219145#5088371 <https://phabricator.wikimedia.org/T219145#5088371>, @alaa_wmde wrote: > In T219145#5087634 <https://phabricator.wikimedia.org/T219145#5087634>, @Marostegui wrote: > > > In T219145#5084305 <https://phabri

[Wikidata-bugs] [Maniphest] [Commented On] T219145: Pass migration plan to DBAs for review

Marostegui added a comment. In T219145#5084305 <https://phabricator.wikimedia.org/T219145#5084305>, @alaa_wmde wrote: > @Marostegui thanks for your update! > > Postponing until the new master is up and running is very unlikely to be the adjustment we would go for.

[Wikidata-bugs] [Maniphest] [Unblock] T124196: Fatal "cannot perform this operation with arrays" from CirrusSearch/ElasticaWrite (using JobQueueDB)

Marostegui closed subtask T219887: Change job table to use mediumblob for job_params field as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T124196 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson, Marostegui Cc: dcausse, debt

[Wikidata-bugs] [Maniphest] [Updated] T219145: Pass migration plan to DBAs for review

Marostegui added a comment. So in terms of s8: I think step 1 (only 18MB) should be fine to be done anytime (still give us a heads up before starting for it). However, the second part, that requires 170GB can be a bit more dangerous. Right now the master only has 800GB free and I

[Wikidata-bugs] [Maniphest] [Commented On] T219145: Pass migration plan to DBAs for review

Marostegui added a comment. Yeah, I just read a notification from Jaime on a different ticket about it. Looks like he wasn't aware either of that actually being created, that is a bit odd but should be discussed on that other ticket not here I guess :-/ If it is disabled and with minimal

[Wikidata-bugs] [Maniphest] [Commented On] T219145: Pass migration plan to DBAs for review

Marostegui added a comment. wb_terms is in commonswiki (s4)? What? When did that happen? TASK DETAIL https://phabricator.wikimedia.org/T219145 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: alaa_wmde, Marostegui Cc: jcrespo, Marostegui

[Wikidata-bugs] [Maniphest] [Commented On] T219145: Pass migration plan to DBAs for review

Marostegui added a comment. @alaa_wmde quick question before I read everything, those extra requirements will only affect s8 (wikidatawiki), right? TASK DETAIL https://phabricator.wikimedia.org/T219145 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Unblock] T219176: Investigate normalization of wb_terms table 2019

Marostegui closed subtask T219613: grant Tarrow access to test-s4 servers as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T219176 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, Marostegui Cc: Addshore, Aklapper, alaa_wmde

[Wikidata-bugs] [Maniphest] [Commented On] T219142: Send the schema to DBAs and follow up with their review

Marostegui added a comment. We can probably follow up on the patchset rather than on phab,as there are comments there already TASK DETAIL https://phabricator.wikimedia.org/T219142 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore

[Wikidata-bugs] [Maniphest] [Edited] T219142: Send the schema to DBAs and follow up with their review

Marostegui updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T219142 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, Marostegui Cc: Marostegui, Addshore, Aklapper, alaa_wmde, Nandana, AndyTan, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Edited] T219142: Send the schema to DBAs and follow up with their review

Marostegui updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T219142 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, Marostegui Cc: Marostegui, Addshore, Aklapper, alaa_wmde, Nandana, AndyTan, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Triaged] T219142: Send the schema to DBAs and follow up with their review

Marostegui triaged this task as "Normal" priority. Marostegui moved this task from Triage to Blocked external/Not db team on the DBA board. TASK DETAIL https://phabricator.wikimedia.org/T219142 WORKBOARD https://phabricator.wikimedia.org/project/board/1060/ EMAIL PREFERENC

[Wikidata-bugs] [Maniphest] [Commented On] T219142: Send the schema to DBAs and follow up with their review

Marostegui added a comment. I am asking because reviewing the tables without really knowing the context is hard :-) Also, are these tables going to be public? Can they be just replicated to labs straightaway? If so, you might also need to create a ticket for #cloud-services-team <ht

[Wikidata-bugs] [Maniphest] [Commented On] T219142: Send the schema to DBAs and follow up with their review

Marostegui added a comment. Is there a wikipage where we can see what each table is supposed to do and store? TASK DETAIL https://phabricator.wikimedia.org/T219142 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Marostegui Cc: Marostegui

[Wikidata-bugs] [Maniphest] [Commented On] T187960: Rack/cable/configure asw2-a-eqiad switch stack

Marostegui added a comment. For the record, read only times on s2: Read only ON: 15:21:10 Read only OFF: 15:27:56 TASK DETAIL https://phabricator.wikimedia.org/T187960 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Cmjohnson, Marostegui Cc

[Wikidata-bugs] [Maniphest] [Edited] T187960: Rack/cable/configure asw2-a-eqiad switch stack

Marostegui updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T187960 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Cmjohnson, Marostegui Cc: Tgr, Dbrant, JoeWalsh, Bstorm, thcipriani, akosiaris, Joe, fgiunchedi, hashar

[Wikidata-bugs] [Maniphest] [Commented On] T187960: Rack/cable/configure asw2-a-eqiad switch stack

Marostegui added a comment. Will do! Thanks! TASK DETAIL https://phabricator.wikimedia.org/T187960 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Cmjohnson, Marostegui Cc: Addshore, MMiller_WMF, Catrope, elukey, Marostegui, Stashbot, Paladox

[Wikidata-bugs] [Maniphest] [Commented On] T187960: Rack/cable/configure asw2-a-eqiad switch stack

Marostegui added a comment. In T187960#4998807 <https://phabricator.wikimedia.org/T187960#4998807>, @Addshore wrote: > From where I am sat setting $wgReadOnly for the few seconds would be the best thing for cognate, and would avoid having to run the maintenance scripts.

[Wikidata-bugs] [Maniphest] [Updated] T215616: Improve interlingual links across wikis through Wikidata IDs

Marostegui removed a project: DBA. Marostegui added a comment. Going to remove the #DBA <https://phabricator.wikimedia.org/tag/dba/> tag from here as there are not really any actionables (yet) for the DBAs and we already provided some input here (T215616#4946564

[Wikidata-bugs] [Maniphest] [Commented On] T215902: Investigate normalization of data stored in wb_terms table

Marostegui added a comment. In T215902#4950653, @Lucas_Werkmeister_WMDE wrote: term_type, small table holding the types of strings to be indexed in the db, right now this would be labels, descriptions and aliases, but this would scale to allowing more similar terms into the index (if desired

[Wikidata-bugs] [Maniphest] [Commented On] T215902: Investigate normalization of data stored in wb_terms table

Marostegui added a comment. In T215902#4950293, @Addshore wrote: My first investigation into table normalization went for full normalization: Thanks for working on this! :-) F28207723: image.png The queries to get there from the wb_terms table can be found @ P8075 and have been running

[Wikidata-bugs] [Maniphest] [Updated] T215616: Improve interlingual links across wikis through Wikidata IDs

Marostegui added a project: MediaWiki-Database. TASK DETAILhttps://phabricator.wikimedia.org/T215616EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Nuria, JAllemandou, diego, Nandana, Akovalyov, Banyek, AndyTan, Rayssa-, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Commented On] T208330: MediaInfo extension should not use the wb_terms table

Marostegui added a comment. Thanks so much!TASK DETAILhttps://phabricator.wikimedia.org/T208330EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, MarosteguiCc: Stashbot, gerritbot, WMDE-leszek, Ramsey-WMF, Marostegui, Jdforrester-WMF, Cparle, Addshore

[Wikidata-bugs] [Maniphest] [Closed] T197616: Create a production test wiki in group0 to parallel Wikimedia Commons

Marostegui closed this task as "Resolved".Marostegui added a comment. I just sync'ed up with @Jdforrester-WMF - we are re-closing this - we will have a proper task to delete the wiki once we are ready for it Thanks!TASK DETAILhttps://phabricator.wikimedia.org/T197616EMAIL PREFER

[Wikidata-bugs] [Maniphest] [Unblock] T194750: Deploy Structured Data on Commons baseline

Marostegui closed subtask T197616: Create a production test wiki in group0 to parallel Wikimedia Commons as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T194750EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: RP88, Cparle

[Wikidata-bugs] [Maniphest] [Block] T194750: Deploy Structured Data on Commons baseline

Marostegui reopened subtask T197616: Create a production test wiki in group0 to parallel Wikimedia Commons as "Open". TASK DETAILhttps://phabricator.wikimedia.org/T194750EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: RP88, Cparle

[Wikidata-bugs] [Maniphest] [Reopened] T197616: Create a production test wiki in group0 to parallel Wikimedia Commons

Marostegui reopened this task as "Open". TASK DETAILhttps://phabricator.wikimedia.org/T197616EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jdforrester-WMF, MarosteguiCc: jcrespo, MZMcBride, Marostegui, Stashbot, jijiki, gerritbot, Smalyshev, M

[Wikidata-bugs] [Maniphest] [Commented On] T197616: Create a production test wiki in group0 to parallel Wikimedia Commons

Marostegui added a comment. The database is still present at the s4 servers, and I would like to clean it up. It cannot be done directly on the master, as it would break the multisource slaves (dbstore1002 and labs hosts). I can delete it on a host by host, that is fine, but I would like

[Wikidata-bugs] [Maniphest] [Commented On] T197616: Create a production test wiki in group0 to parallel Wikimedia Commons

Marostegui added a comment. Waiting for one hour only is not realistic, specially if asked at 19:00 UTC. The 4th I was on holidays (I am still on holidays) but I replied to it as I didn't want to block this so long. So we replied in less than 24h, but I didn't notice it was already done.TASK

[Wikidata-bugs] [Maniphest] [Commented On] T197616: Create a production test wiki in group0 to parallel Wikimedia Commons

Marostegui added a comment. I wonder why was this created in s4 if we were asked if we preferred s3 and I replied a day after that question that s3 would be the best place from our point of view?TASK DETAILhttps://phabricator.wikimedia.org/T197616EMAIL PREFERENCEShttps://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] [Commented On] T212690: DBQueryTimeoutError on Wikidata's Special:Nuke

Marostegui added a comment. So this is the query: SELECT rc_namespace,rc_title,rc_timestamp FROM `recentchanges`WHERE ((rc_new = 1) OR (rc_log_type = 'upload' AND rc_log_action = 'upload')) AND ((rc_user = '24')) AND rc_namespace = '0' GROUP BY rc_namespace, rc_title, rc_timestamp ORDER

[Wikidata-bugs] [Maniphest] [Commented On] T197616: Create a production test wiki in group0 to parallel Wikimedia Commons

Marostegui added a comment. In T197616#4853038, @Reedy wrote: In T197616#4853024, @greg wrote: Status? https://test-commons.wikimedia.org/ is live (DNS and apache are up) James looks to have made the mw-config patch. Just addWiki.php to run at this point He was trying to nerd snipe me

[Wikidata-bugs] [Maniphest] [Commented On] T212690: DBQueryTimeoutError on Wikidata's Special:Nuke

Marostegui added a comment. Does it happen all the time or was it a punctual error?TASK DETAILhttps://phabricator.wikimedia.org/T212690EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Marostegui, Aklapper, abian, Legado_Shulgin, Nandana, thifranc

[Wikidata-bugs] [Maniphest] [Updated] T212690: DBQueryTimeoutError on Wikidata's Special:Nuke

Marostegui added a project: MediaWiki-Database. TASK DETAILhttps://phabricator.wikimedia.org/T212690EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Aklapper, abian, Legado_Shulgin, Nandana, thifranc, Banyek, AndyTan, Davinaclare77, Qtn1293

[Wikidata-bugs] [Maniphest] [Commented On] T189026: IndexPager::buildQueryInfo (contributions page unfiltered) query needs tuning

Marostegui added a comment. I believe this is not happening anymore, I haven't found this on logs. Can this be closed?TASK DETAILhttps://phabricator.wikimedia.org/T189026EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: gerritbot, Marostegui

[Wikidata-bugs] [Maniphest] [Updated] T185355: Normalize change tag schema

Marostegui added a subtask: T211896: Query trying to use the wrong index on change_tag. TASK DETAILhttps://phabricator.wikimedia.org/T185355EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, MarosteguiCc: mpopov, tstarling, Compassionate727

[Wikidata-bugs] [Maniphest] [Unblock] T211338: Make a copy of the current wb_terms table on the MCR testing DB servers

Marostegui created subtask T211593: Grant addshore access to test-s4 servers. TASK DETAILhttps://phabricator.wikimedia.org/T211338EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Aklapper, Addshore, daniel, Marostegui, Nandana, Banyek, AndyTan

[Wikidata-bugs] [Maniphest] [Closed] T211338: Make a copy of the current wb_terms table on the MCR testing DB servers

Marostegui closed this task as "Resolved".Marostegui added a comment. @Addshore wb_terms has been imported into db (and replicated to db1112). Please check that you have access and if not talk to me privately on IRC:TASK DETAILhttps://phabricator.wikimedia.org/T211338EMAIL PREFER

[Wikidata-bugs] [Maniphest] [Claimed] T211338: Make a copy of the current wb_terms table on the MCR testing DB servers

Marostegui claimed this task.Marostegui added a comment. As we discussed, this is a one time thing we happen to be able to do now, but this cannot be guaranteed in the future. I will restore wb_terms from the backups, it will take quite some time. The access credentials haven't changed. Test them

[Wikidata-bugs] [Maniphest] [Declined] T194273: Clean up indexes of wb_terms table

Marostegui closed this task as "Declined".Marostegui added a comment. Let's decline this then (feel free to reopen if you think it should be kept open)TASK DETAILhttps://phabricator.wikimedia.org/T194273EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailp

[Wikidata-bugs] [Maniphest] [Unblock] T188992: Make wb_terms table fancy

Marostegui closed subtask T194273: Clean up indexes of wb_terms table as "Declined". TASK DETAILhttps://phabricator.wikimedia.org/T188992EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: jcrespo, Jonas, Lucas_Werkmeister_WMDE, Aklapper,

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

Marostegui added a comment. If there is no space issues on that host, there is no harm in leaving it a bit longer I would say.TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, MarosteguiCc: ArielGlenn

[Wikidata-bugs] [Maniphest] [Commented On] T194273: Clean up indexes of wb_terms table

Marostegui added a comment. We cannot alter wb_terms anymore. The table is almost 1TB on the master, and the master "only" has 1.1TB free on the master which makes it very high risky and almost impossible to run.TASK DETAILhttps://phabricator.wikimedia.org/T194273EMAIL PREFER

[Wikidata-bugs] [Maniphest] [Closed] T208695: Duplicate key on several s8 replicas breaking replication

Marostegui closed this task as "Resolved".Marostegui added a comment. I am going to consider this resolved.TASK DETAILhttps://phabricator.wikimedia.org/T208695EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Marostegui, jijiki, Anomie

[Wikidata-bugs] [Maniphest] [Closed] T203709: Schema change for adding indexes of ct_tag_id

Marostegui closed this task as "Resolved".Marostegui added a comment. This is all doneTASK DETAILhttps://phabricator.wikimedia.org/T203709EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: jcrespo, Addshore, Stashbot, Marostegui, Tgr, A

[Wikidata-bugs] [Maniphest] [Edited] T203709: Schema change for adding indexes of ct_tag_id

Marostegui updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] codfw...TASK DETAILhttps://phabricator.wikimedia.org/T203709EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: jcrespo, Addshore, Stashbot, Marostegui, Tgr

[Wikidata-bugs] [Maniphest] [Edited] T203709: Schema change for adding indexes of ct_tag_id

Marostegui updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] codfw...TASK DETAILhttps://phabricator.wikimedia.org/T203709EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: jcrespo, Addshore, Stashbot, Marostegui, Tgr

[Wikidata-bugs] [Maniphest] [Edited] T203709: Schema change for adding indexes of ct_tag_id

Marostegui updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] codfw...TASK DETAILhttps://phabricator.wikimedia.org/T203709EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: jcrespo, Addshore, Stashbot, Marostegui, Tgr

[Wikidata-bugs] [Maniphest] [Edited] T203709: Schema change for adding indexes of ct_tag_id

Marostegui updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] codfw...TASK DETAILhttps://phabricator.wikimedia.org/T203709EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: jcrespo, Addshore, Stashbot, Marostegui, Tgr

[Wikidata-bugs] [Maniphest] [Edited] T203709: Schema change for adding indexes of ct_tag_id

Marostegui updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] codfw...TASK DETAILhttps://phabricator.wikimedia.org/T203709EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: jcrespo, Addshore, Stashbot, Marostegui, Tgr

[Wikidata-bugs] [Maniphest] [Edited] T203709: Schema change for adding indexes of ct_tag_id

Marostegui updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] codfw...TASK DETAILhttps://phabricator.wikimedia.org/T203709EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: jcrespo, Addshore, Stashbot, Marostegui, Tgr

[Wikidata-bugs] [Maniphest] [Edited] T203709: Schema change for adding indexes of ct_tag_id

Marostegui updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] eqiad progress T203709#4738599...TASK DETAILhttps://phabricator.wikimedia.org/T203709EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: jcrespo, Addshore

[Wikidata-bugs] [Maniphest] [Commented On] T208330: MediaInfo extension should not use the wb_terms table

Marostegui added a comment. In T208330#4742192, @Addshore wrote: In T208330#4738627, @Marostegui wrote: I would prefer if we don't enable more stuff in production that uses wb_term table, that table is already in a _very_ bad state and we should stop using it as soon as we can. So getting more

[Wikidata-bugs] [Maniphest] [Commented On] T203709: Schema change for adding indexes of ct_tag_id

Marostegui added a comment. In T203709#4697081, @Ladsgroup wrote: It's not done in s8 eqiad causing this T207313: Some administrative and log actions on Wikidata take longer than 60 seconds and time out on Wikidata: @Ladsgroup All done in s8 eqiad core hosts (T203709#4738599). You shouldn't

[Wikidata-bugs] [Maniphest] [Commented On] T203709: Schema change for adding indexes of ct_tag_id

Marostegui added a comment. In T203709#4739468, @jcrespo wrote: Could you check the list of schema changes and maintenance to be ran during switchover to test if they where also undone? Yep, I was doing it that now :-)TASK DETAILhttps://phabricator.wikimedia.org/T203709EMAIL PREFERENCEShttps

[Wikidata-bugs] [Maniphest] [Updated] T203709: Schema change for adding indexes of ct_tag_id

Marostegui added a comment. I know realised why the change was "gone" from all the eqiad s8 hosts except db1071, db1087,db1124 and labs. The reason is that the rest of the hosts were recloned from codfw (where the change wasn't deployed) as part of T206743: S8 replication issues leadi

[Wikidata-bugs] [Maniphest] [Commented On] T208330: MediaInfo extension should not use the wb_terms table

Marostegui added a comment. I would prefer if we don't enable more stuff in production that uses wb_term table, that table is already in a _very_ bad state and we should stop using it as soon as we can. So getting more stuff to use this table is probably not what we want to do

[Wikidata-bugs] [Maniphest] [Edited] T203709: Schema change for adding indexes of ct_tag_id

Marostegui updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] eqiad progress T203709#4738599 wikitech...TASK DETAILhttps://phabricator.wikimedia.org/T203709EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Addshore

[Wikidata-bugs] [Maniphest] [Commented On] T203709: Schema change for adding indexes of ct_tag_id

Marostegui added a comment. This is very weird, I am _pretty_ sure I did s8 eqiad whilst codfw was active. The fact that this exists on the master, the sanitarium master, sanitarium, and labs confuses me, not sure it this might have been reverted while we were working on the s8 incident (data loss

<    1   2   3   4   5   6   7   8   >