[Wikidata-bugs] [Maniphest] [Reopened] T205958: Wikibase\Repo\Search\Elastic\Tests\EntitySearchElasticFulltextTest::testSearchElastic fails on PHP 7.1

2018-10-11 Thread Legoktm
Legoktm reopened this task as "Open".Legoktm added a comment. Uhh, we seem to have regressed? It's failing again: https://integration.wikimedia.org/ci/job/wmf-quibble-vendor-mysql-php71-docker/12/consoleTextTASK DETAILhttps://phabricator.wikimedia.org/T205958EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206636: Provide a way to have test servers on real hardware, isolated from production

2018-10-11 Thread Smalyshev
Smalyshev added a comment. Our production instance consume ~3-4K IOPS just for updates. To clarify here, this would just allow us to barely run the updater. The server under production load - i.e. something we might need for performance evaluation and testing - are significantly higher, peaks

[Wikidata-bugs] [Maniphest] [Commented On] T206359: Kafka poller lag reporting is weird

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 465514 merged by jenkins-bot: [wikidata/query/rdf@master] Report timestamps only on single topic https://gerrit.wikimedia.org/r/465514TASK DETAILhttps://phabricator.wikimedia.org/T206359EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T199228: Define an SLO for Wikidata Query Service public endpoint and communicate it

2018-10-11 Thread Smalyshev
Smalyshev added a comment. If update lag is not a big issue for our users, then we should make it clear. More precise statement would be a temporary update lag is not the highest priority issue. I.e. getting a hour-old data for a short time is not going to matter for most users, while e.g. not

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T198946: Add Schema property 'sameAs' pointing to Wikidata entries

2018-10-11 Thread Niedzielski
Niedzielski added a subscriber: pmiazga.Niedzielski added a comment. Patch revised. @ovasileva, moving to blocked pending feedback from Wikibase folks. @Jdlrobson, @pmiazga, reviews appreciated in the meantime!TASK DETAILhttps://phabricator.wikimedia.org/T198946EMAIL

[Wikidata-bugs] [Maniphest] [Created] T206827: [Bug] TypeError thrown when loading page: Cannot read property '_getCachedMessage' of undefined

2018-10-11 Thread Niedzielski
Niedzielski created this task.Niedzielski added projects: Wikidata, wikiba.se, Regression.Restricted Application added a subscriber: Aklapper.Restricted Application changed the subtype of this task from "Deadline" to "Task". TASK DESCRIPTIONSteps to Reproduce Visit

[Wikidata-bugs] [Maniphest] [Created] T206826: [Bug] TypeError thrown when loading page: wb.datamodel.Fingerprint is not a constructor

2018-10-11 Thread Niedzielski
Niedzielski created this task.Niedzielski added projects: Wikidata, wikiba.se, Regression.Restricted Application added a subscriber: Aklapper.Restricted Application changed the subtype of this task from "Deadline" to "Task". TASK DESCRIPTIONSteps to Reproduce Visit

[Wikidata-bugs] [Maniphest] [Commented On] T202848: Change property suggester to use hook instead of monkey patching

2018-10-11 Thread hoo
hoo added a comment. What's the state of https://gerrit.wikimedia.org/r/c/mediawiki/extensions/PropertySuggester/+/458187? @Jonas can it be merged?TASK DETAILhttps://phabricator.wikimedia.org/T202848EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jonas,

[Wikidata-bugs] [Maniphest] [Edited] T202848: Change property suggester to use hook instead of monkey patching

2018-10-11 Thread hoo
hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x ] [[ https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Wikibase/+/459505/ | Teach EntitySelector._combineResults() to evaluate rank ]]...TASK DETAILhttps://phabricator.wikimedia.org/T202848EMAIL

[Wikidata-bugs] [Maniphest] [Edited] T202848: Change property suggester to use hook instead of monkey patching

2018-10-11 Thread hoo
hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x ] [[ https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Wikibase/+/459505/ | Teach EntitySelector._combineResults() to evaluate rank ]]...TASK DETAILhttps://phabricator.wikimedia.org/T202848EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T203459: Alphabetically ordering glosses

2018-10-11 Thread hoo
hoo moved this task from Peer Review to Test (Verification) on the Wikidata-Campsite-Iteration-∞ board.hoo removed a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T203459WORKBOARDhttps://phabricator.wikimedia.org/project/board/3539/EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T198946: Add Schema property 'sameAs' pointing to Wikidata entries

2018-10-11 Thread Niedzielski
Niedzielski added a comment. @cscott, thank you very much for these references.TASK DETAILhttps://phabricator.wikimedia.org/T198946EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NiedzielskiCc: Jdrewniak, Mholloway, gerritbot, Denny, ovasileva, Tbayer,

[Wikidata-bugs] [Maniphest] [Updated] T120847: Use BCP 47 conform language codes for the HTML attribute lang

2018-10-11 Thread Jdforrester-WMF
Jdforrester-WMF removed a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T120847EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: cscott, Jdforrester-WMFCc: Jdforrester-WMF, gerritbot, cscott, Lydia_Pintscher, Aklapper, Fomafix,

[Wikidata-bugs] [Maniphest] [Closed] T106367: Generate BCP 47 conform language codes for the HTML attribute `lang`

2018-10-11 Thread Jdforrester-WMF
Jdforrester-WMF edited projects, added MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)); removed Patch-For-Review.Jdforrester-WMF closed this task as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T106367EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T106367: Generate BCP 47 conform language codes for the HTML attribute `lang`

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 460038 merged by jenkins-bot: [mediawiki/core@master] Ensure LanguageCode::bcp47() returns a valid BCP 47 language code https://gerrit.wikimedia.org/r/460038TASK DETAILhttps://phabricator.wikimedia.org/T106367EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T120847: Use BCP 47 conform language codes for the HTML attribute lang

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 460038 merged by jenkins-bot: [mediawiki/core@master] Ensure LanguageCode::bcp47() returns a valid BCP 47 language code https://gerrit.wikimedia.org/r/460038TASK DETAILhttps://phabricator.wikimedia.org/T120847EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206423: The usual Lag pattern for wdqs2003 seems to be taking another turn

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466722 merged by Gehel: [operations/puppet@production] wdqs: use recent change poller on public cluster instead of kafka https://gerrit.wikimedia.org/r/466722TASK DETAILhttps://phabricator.wikimedia.org/T206423EMAIL

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T199228: Define an SLO for Wikidata Query Service public endpoint and communicate it

2018-10-11 Thread Gehel
Gehel added a subscriber: Mathew.onipe.Gehel added a comment. In T199228#4655321, @Smalyshev wrote: I think update lag is not the biggest issue. Endpoint availability and response times is more important for most of the users, at least short-term. If there's a lag spike that goes away, most users

[Wikidata-bugs] [Maniphest] [Updated] T206423: The usual Lag pattern for wdqs2003 seems to be taking another turn

2018-10-11 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T206423EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Stashbot, Smalyshev, Mathew.onipe, Gehel, Aklapper, CucyNoiD, Nandana, NebulousIris,

[Wikidata-bugs] [Maniphest] [Commented On] T206423: The usual Lag pattern for wdqs2003 seems to be taking another turn

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466722 had a related patch set uploaded (by Gehel; owner: Gehel): [operations/puppet@production] wdqs: use recent change poller on public cluster instead of kafka https://gerrit.wikimedia.org/r/466722TASK DETAILhttps://phabricator.wikimedia.org/T206423EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206636: Provide a way to have test servers on real hardware, isolated from production

2018-10-11 Thread Gehel
Gehel added a comment. The main contention point for WDQS (or investigating alternatives) seems to be IOPS. We tried setting up a wdqs test instance on WMCS, but IO contention meant that we were not able to keep up with the update flow. Our production instance consume ~3-4K IOPS just for updates.

[Wikidata-bugs] [Maniphest] [Commented On] T122711: Appending ".json" to an entity url should work (Feature Request)

2018-10-11 Thread cscott
cscott added a comment. ...and adding .jsonld at the end should also work, right?TASK DETAILhttps://phabricator.wikimedia.org/T122711EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: cscottCc: cscott, Lucas_Werkmeister_WMDE, thiemowmde, Multichill, hoo,

[Wikidata-bugs] [Maniphest] [Updated] T44063: [Epic] Provide a plain linked data interface for accessing entities

2018-10-11 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T44063EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: cscott, gerritbotCc: Realworldobject, Eroux108, Multichill, thiemowmde, Tpt, Lucas_Werkmeister_WMDE, Prtksxna,

[Wikidata-bugs] [Maniphest] [Commented On] T44063: [Epic] Provide a plain linked data interface for accessing entities

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 384050 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian): [mediawiki/extensions/Wikibase@master] Enable JSON-LD entity export https://gerrit.wikimedia.org/r/384050TASK DETAILhttps://phabricator.wikimedia.org/T44063EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206636: Provide a way to have test servers on real hardware, isolated from production

2018-10-11 Thread Andrew
Andrew added a comment. Hello @Gehel! We're unlikely to support bare metal on Labs in the near future, largely because our pilot program for this years ago determined that we were able to meet almost every actual use case using VMs. Can you tell me a bit more about what you need that a VM can't

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466710 merged by jenkins-bot: [operations/mediawiki-config@master] db-eqiad,db-codfw.php: Repool db1101:3318, db2085:3318, db2083 https://gerrit.wikimedia.org/r/466710TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466710 had a related patch set uploaded (by Marostegui; owner: Marostegui): [operations/mediawiki-config@master] db-eqiad,db-codfw.php: Repool db1101:3318, db2085:3318, db2083 https://gerrit.wikimedia.org/r/466710TASK

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466700 merged by Gehel: [operations/puppet@production] wdqs: run autodeploy on the hour, 4 times per day https://gerrit.wikimedia.org/r/466700TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466700 had a related patch set uploaded (by Gehel; owner: Gehel): [operations/puppet@production] wdqs: run autodeploy on the hour, 4 times per day https://gerrit.wikimedia.org/r/466700TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Triaged] T206256: Un-redirected items should be instant-indexed

2018-10-11 Thread EBjune
EBjune triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T206256EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBjuneCc: Aklapper, Sjoerddebruin, Smalyshev, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune,

[Wikidata-bugs] [Maniphest] [Commented On] T206619: Reorganizing Lexeme code

2018-10-11 Thread JeroenDeDauw
JeroenDeDauw added a comment. Initial moving is done, ending with https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikibaseLexeme/+/466691 The linked commit is the only one that does something other than directory/NS move. After this I want to look at things in a bit more detail, likely

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466610 merged by Gehel: [operations/puppet@production] wdqs: add logging message to autodeploy cron task https://gerrit.wikimedia.org/r/466610TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466608 merged by Gehel: [operations/puppet@production] wdqs: fixed autodeploy cron logging permission issue https://gerrit.wikimedia.org/r/466608TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206359: Kafka poller lag reporting is weird

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 465514 had a related patch set uploaded (by Smalyshev; owner: Smalyshev): [wikidata/query/rdf@master] Report timestamps only on single topic https://gerrit.wikimedia.org/r/465514TASK DETAILhttps://phabricator.wikimedia.org/T206359EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T206359: Kafka poller lag reporting is weird

2018-10-11 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T206359EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Gehel, Smalyshev, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo,

[Wikidata-bugs] [Maniphest] [Triaged] T206359: Kafka poller lag reporting is weird

2018-10-11 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T206359EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Gehel, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic,

[Wikidata-bugs] [Maniphest] [Updated] T198946: Add Schema property 'sameAs' pointing to Wikidata entries

2018-10-11 Thread cscott
cscott added a comment. I also worked on proper JSON+LD statements in T44063: [Epic] Provide a plain linked data interface for accessing entities and T164655: Store and serve annotations in W3C standard format. FWIW, with https://gerrit.wikimedia.org/r/384050 you get the following JSONLD for

[Wikidata-bugs] [Maniphest] [Commented On] T206619: Reorganizing Lexeme code

2018-10-11 Thread JeroenDeDauw
JeroenDeDauw added a comment. Started with moving : https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikibaseLexeme/+/466614 All changes are on branch "move". Starting with the second change there is a CS failure on Jenkins since some lines are now longer than 110 chars. I'm making sure the

[Wikidata-bugs] [Maniphest] [Lowered Priority] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread jcrespo
jcrespo lowered the priority of this task from "Unbreak Now!" to "High".jcrespo added a comment. High because data came back.TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, jcrespoCc: gerritbot,

[Wikidata-bugs] [Maniphest] [Updated] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread jcrespo
jcrespo added a project: User-notice.jcrespo added a comment. For #user-notice, if it seems reasonable, see T206743#4658525 for the state of things- data was temporarily lost (for around 1 day) but then it was recovered once detected. There may be smaller issues (preferences lost, what links here,

[Wikidata-bugs] [Maniphest] [Created] T206767: wikidata-docker Quickstatements SSL error

2018-10-11 Thread expressionlibre
expressionlibre created this task.expressionlibre added a project: Wikidata.Restricted Application added a subscriber: Aklapper. TASK DESCRIPTIONHi, I just "docker-compose up" the wikidata-docker https://github.com/wmde/wikibase-docker/ The Quickstatement URL doesn't work : localhost:9191

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-11T15:12:50Z] Stop MySQL on db2085:3318 to reclone db1101:3318 - T206743TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466658 merged by jenkins-bot: [operations/mediawiki-config@master] db-eqiad.php: Depool db1101:3318 https://gerrit.wikimedia.org/r/466658TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466658 had a related patch set uploaded (by Marostegui; owner: Marostegui): [operations/mediawiki-config@master] db-eqiad.php: Depool db1101:3318 https://gerrit.wikimedia.org/r/466658TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T203459: Alphabetically ordering glosses

2018-10-11 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)). TASK DETAILhttps://phabricator.wikimedia.org/T203459EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, ReleaseTaggerBotCc: gerritbot, KaMan, Lydia_Pintscher,

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466652 merged by jenkins-bot: [operations/mediawiki-config@master] db-eqiad.php: Repool db1099:3318 https://gerrit.wikimedia.org/r/466652TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466652 had a related patch set uploaded (by Marostegui; owner: Marostegui): [operations/mediawiki-config@master] db-eqiad.php: Repool db1099:3318 https://gerrit.wikimedia.org/r/466652TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread jcrespo
jcrespo added a comment. We believe the most important issues (missing revisions, pages and users, and making accessible the content) has been fixed. We will lower the UBN after doing some additional sanity checks. Having said that, for the following days, some missing things like user

[Wikidata-bugs] [Maniphest] [Commented On] T205556: Missing labels on items (statements show item IDs instead of labels even though labels are defined)

2018-10-11 Thread Addshore
Addshore added a comment. So the main thing that we are seeing here (badly cached pages in the parser cache) seems like it could have been some temporary issue (although I have no idea what the issue was). All of the pages I linked to in T205556#4654519 are now fine after re parses, and hitting

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-11T14:30:44Z] Synchronized wmf-config/db-eqiad.php: T206743: mariadb: Depool db1087 (duration: 00m 49s)TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-11T14:28:17Z] depooling db1087 (T206743)TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, StashbotCc: gerritbot,

[Wikidata-bugs] [Maniphest] [Commented On] T203459: Alphabetically ordering glosses

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 464004 merged by jenkins-bot: [mediawiki/extensions/WikibaseLexeme@master] Order glosses in senses https://gerrit.wikimedia.org/r/464004TASK DETAILhttps://phabricator.wikimedia.org/T203459EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread jcrespo
jcrespo added a comment. applied a fix to: db1109 db1071 db1104 db1101:3318 db1092 dbstore1002TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, jcrespoCc: gerritbot, WMDE-leszek, jcrespo, mark,

[Wikidata-bugs] [Maniphest] [Updated] T120847: Use BCP 47 conform language codes for the HTML attribute lang

2018-10-11 Thread ReleaseTaggerBot
ReleaseTaggerBot edited projects, added MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)); removed MW-1.32-notes (WMF-deploy-2018-07-17 (1.32.0-wmf.13)). TASK DETAILhttps://phabricator.wikimedia.org/T120847EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466610 had a related patch set uploaded (by Mathew.onipe; owner: Mathew.onipe): [operations/puppet@production] wdqs: add logging message to autodeploy cron task https://gerrit.wikimedia.org/r/466610TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466608 had a related patch set uploaded (by Mathew.onipe; owner: Mathew.onipe): [operations/puppet@production] wdqs: fixed autodeploy cron logging permission issue https://gerrit.wikimedia.org/r/466608TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T198946: Add Schema property 'sameAs' pointing to Wikidata entries

2018-10-11 Thread Niedzielski
Niedzielski added a comment. @Jdrewniak, thanks for looking into this. FWIW, @Tbayer also alluded to these mapping concerns in his comment. What do you think we should do for the many entities that do not have an equivalent class? For example, kitten is not an instance of anything but is a

[Wikidata-bugs] [Maniphest] [Edited] T206325: Use wikibase/data-model 8.0 everywhere

2018-10-11 Thread Addshore
Addshore updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION... # Make patches switching the other extensions to 8.0 (Lexeme, MediaInfo, Wikibase) and a mediawiki-vendor patch for 8.0 too...TASK DETAILhttps://phabricator.wikimedia.org/T206325EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466603 abandoned by Mathew.onipe: wdqs: fixed autodeploy cron logging permission issue https://gerrit.wikimedia.org/r/466603TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:

[Wikidata-bugs] [Maniphest] [Edited] T206325: Use wikibase/data-model 8.0 everywhere

2018-10-11 Thread Addshore
Addshore updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...This was highlighted in https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/WikibaseLexeme/+/464811/ For this reason we will need to do things in the following order: # Make all extensions that can be compat

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466603 had a related patch set uploaded (by Mathew.onipe; owner: Mathew.onipe): [operations/puppet@production] wdqs: fixed autodeploy cron logging permission issue https://gerrit.wikimedia.org/r/466603TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Edited] T206325: Use wikibase/data-model 8.0 everywhere

2018-10-11 Thread JeroenDeDauw
JeroenDeDauw updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...**[1]** These extensions cannot be compatible with DM 7.x and 8.x at the same time because DataModel's EntityDocument already implements ClearableEntity as of 8.0TASK

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-11T13:23:44Z] Stop MySQL on db2083 to reclone db1116:3318 - T206743TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui,

[Wikidata-bugs] [Maniphest] [Edited] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Marostegui
Marostegui updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...* https://www.wikidata.org/wiki/Lexeme:L20543 DBAs updates: Action plan: T206743#4658146 Missing rows timeline: T206743#4658274 Cloning hosts progress: T206743#4658362TASK

[Wikidata-bugs] [Maniphest] [Edited] T205064: Undeploy WikibaseQuality extension from the WMF

2018-10-11 Thread Addshore
Addshore updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[] And then undeploy the extension This should consist of removing the calls to wfLoadExtension( 'WikibaseQuality' ); in mediawiki-config It also has to be removed from extensions-list, but that can be done

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-11T13:20:24Z] Stop MySQL on db1116:3318 to reclone it from db2083 - T206743TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466594 merged by jenkins-bot: [operations/mediawiki-config@master] db-codfw.php: Depool db2083 https://gerrit.wikimedia.org/r/466594TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Marostegui
Marostegui added a comment. s8 host cloning process labsdb1011 labsdb1010 labsdb1009 dbstore1002 (not sure we should reclone it, it will be replaced "soon") db1124 (sanitarium) db1116 (backup source) db1109 db1104 (candidate master) db1101 (recentchanges) db1099 (recentchanges) db1092

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466550 abandoned by Mathew.onipe: wdqs: fixed autodeploy cron logging permission issue Reason: to be splitted https://gerrit.wikimedia.org/r/466550TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T205064: Undeploy WikibaseQuality extension from the WMF

2018-10-11 Thread Addshore
Addshore added a project: Wikidata-Campsite. TASK DETAILhttps://phabricator.wikimedia.org/T205064EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Aklapper, Addshore, Nandana, NebulousIris, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic,

[Wikidata-bugs] [Maniphest] [Closed] T192145: Update Wikidata users of serialization/serialization to use version 4.0 of the library

2018-10-11 Thread Addshore
Addshore closed this task as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T192145EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jonas, AddshoreCc: Addshore, gerritbot, WMDE-leszek, Aklapper, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo,

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466594 had a related patch set uploaded (by Marostegui; owner: Marostegui): [operations/mediawiki-config@master] db-codfw.php: Depool db2083 https://gerrit.wikimedia.org/r/466594TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, gerritbotCc: gerritbot, WMDE-leszek, jcrespo, mark, Stashbot, Nikki, Marostegui, daniel, TerraCodes,

[Wikidata-bugs] [Maniphest] [Commented On] T120847: Use BCP 47 conform language codes for the HTML attribute lang

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 447054 merged by jenkins-bot: [mediawiki/extensions/Wikibase@master] Apply LanguageCode::bcp47 for lang and hreflang attributes https://gerrit.wikimedia.org/r/447054TASK DETAILhttps://phabricator.wikimedia.org/T120847EMAIL

[Wikidata-bugs] [Maniphest] [Changed Status] T205064: Undeploy WikibaseQuality extension from the WMF

2018-10-11 Thread Addshore
Addshore changed the task status from "Stalled" to "Open".Addshore updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION[x] This requires us to first merge WikibaseQuality and QualityConstraints and then get that out of the door first. [] And then undeploy the extensionTASK

[Wikidata-bugs] [Maniphest] [Blocker] T205062: Reorganizing Wikibase Quality extensions

2018-10-11 Thread Addshore
Addshore changed the status of subtask T205064: Undeploy WikibaseQuality extension from the WMF from "Stalled" to "Open". TASK DETAILhttps://phabricator.wikimedia.org/T205062EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: abian, Aklapper,

[Wikidata-bugs] [Maniphest] [Blocker] T205065: Archive the WikibaseQuality extension

2018-10-11 Thread Addshore
Addshore changed the status of subtask T205064: Undeploy WikibaseQuality extension from the WMF from "Stalled" to "Open". TASK DETAILhttps://phabricator.wikimedia.org/T205065EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Aklapper, Addshore,

[Wikidata-bugs] [Maniphest] [Closed] T205063: Merge WikibaseQuality and WikibaseQualityConstraints

2018-10-11 Thread Addshore
Addshore closed this task as "Resolved".Addshore added a comment. the change has been merged and is also deployed in productionTASK DETAILhttps://phabricator.wikimedia.org/T205063EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JeroenDeDauw, AddshoreCc:

[Wikidata-bugs] [Maniphest] [Unblock] T205062: Reorganizing Wikibase Quality extensions

2018-10-11 Thread Addshore
Addshore closed subtask T205063: Merge WikibaseQuality and WikibaseQualityConstraints as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T205062EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: abian, Aklapper, Addshore, Nandana, Lahi,

[Wikidata-bugs] [Maniphest] [Closed] T206738: Wikibase appears to be failing phan on all builds now

2018-10-11 Thread cscott
cscott closed this task as "Resolved".cscott claimed this task.cscott added a comment. Well, I rebased my two patches on top of @Legoktm's patch and the builds are passing now, so I'll call that fixed.TASK DETAILhttps://phabricator.wikimedia.org/T206738EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread jcrespo
jcrespo added a comment. We know the exact timestamps of missing rows, from db1071-bin.007238:795791989 2018-09-13 09:08:17 on the active (codfw) master: db2045-bin.005879:1036765620 to db1071-bin.007238:796727644 2018-09-13 09:58:26 on the active (codfw) master: db2045-bin.005880:132937482 We

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466550 had a related patch set uploaded (by Mathew.onipe; owner: Mathew.onipe): [operations/puppet@production] wdqs: fixed autodeploy cron logging permission issue https://gerrit.wikimedia.org/r/466550TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T194164: Start reading from change_tag_def in production

2018-10-11 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-11T11:30:41Z] Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:466271|Set some small wikis to read new for change tag backend (T194164)]] (duration: 00m 50s)TASK

[Wikidata-bugs] [Maniphest] [Commented On] T198946: Add Schema property 'sameAs' pointing to Wikidata entries

2018-10-11 Thread Jdrewniak
Jdrewniak added a comment. An update (I love to nerd out on this stuff). We're not the only ones to run into this problem. There are long-standing discussions between the relation of schema.org and Wikidata. Reading through this https://www.wikidata.org/wiki/Wikidata:Schema.org led me to this

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Marostegui
Marostegui added a subscriber: mark.Marostegui added a comment. What we know for now is that there was a gap in replication between codfw and eqiad the 13th Sept (day after the failover), so whatever was inserted during that time on codfw master never reached eqiad (for all s8 table). We don't

[Wikidata-bugs] [Maniphest] [Commented On] T194164: Start reading from change_tag_def in production

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466271 merged by jenkins-bot: [operations/mediawiki-config@master] Set some small wikis to read new for change tag backend https://gerrit.wikimedia.org/r/466271TASK DETAILhttps://phabricator.wikimedia.org/T194164EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-11T11:10:24Z] Stop MYSQL on db2085:3318 and db1099:3318 T206743TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui,

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-11T11:09:49Z] Stop MYSQL on db2088:3318 and db1099:3318 T206743TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui,

[Wikidata-bugs] [Maniphest] [Retitled] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Addshore
Addshore renamed this task from "A few lexemes disappeared" to "S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")".Addshore reassigned this task from Addshore to Marostegui. TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T198946: Add Schema property 'sameAs' pointing to Wikidata entries

2018-10-11 Thread Jdrewniak
Jdrewniak added a comment. @Niedzielski @type is tricky. The @context key refers to the vocabulary used to define the structured data. The problem is that http://schema.org and http://wikidata.org are different vocabularies, so a @type defined by Wikidata may be different than one defined by

[Wikidata-bugs] [Maniphest] [Updated] T203002: Order of Senses

2018-10-11 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)). TASK DETAILhttps://phabricator.wikimedia.org/T203002EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, ReleaseTaggerBotCc: KaMan, gerritbot, Lydia_Pintscher,

[Wikidata-bugs] [Maniphest] [Updated] T206738: Wikibase appears to be failing phan on all builds now

2018-10-11 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)). TASK DETAILhttps://phabricator.wikimedia.org/T206738EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReleaseTaggerBotCc: Addshore, gerritbot, Legoktm, cscott, Aklapper,

[Wikidata-bugs] [Maniphest] [Claimed] T194164: Start reading from change_tag_def in production

2018-10-11 Thread Ladsgroup
Ladsgroup claimed this task.Ladsgroup edited projects, added Wikidata-Campsite-Iteration-∞; removed Wikidata-Ministry-Of-Magic-Tech-Debt, Wikidata-Ministry-Of-Magic.Restricted Application added a project: User-Ladsgroup. TASK DETAILhttps://phabricator.wikimedia.org/T194164EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T176405: Order of Forms

2018-10-11 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)). TASK DETAILhttps://phabricator.wikimedia.org/T176405EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, ReleaseTaggerBotCc: KaMan, gerritbot, WMDE-leszek,

[Wikidata-bugs] [Maniphest] [Updated] T194164: Start reading from change_tag_def in production

2018-10-11 Thread gerritbot
gerritbot added a comment.Restricted Application added a project: Wikidata. Change 466271 had a related patch set uploaded (by Ladsgroup; owner: Amir Sarabadani): [operations/mediawiki-config@master] Set some small wikis to read new for change tag backend https://gerrit.wikimedia.org/r/466271TASK

[Wikidata-bugs] [Maniphest] [Updated] T194164: Start reading from change_tag_def in production

2018-10-11 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T194164EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Lucas_Werkmeister_WMDE, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo,

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466209 merged by Gehel: [operations/puppet@production] wdqs: change user for autodeploy cron task https://gerrit.wikimedia.org/r/466209TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Triaged] T206738: Wikibase appears to be failing phan on all builds now

2018-10-11 Thread Addshore
Addshore moved this task from Peer Review to Test (Verification) on the Wikidata-Campsite-Iteration-∞ board.Addshore triaged this task as "High" priority.Addshore added a comment. @cscott can you confirm this is all working now? :)TASK

[Wikidata-bugs] [Maniphest] [Commented On] T205865: Investigate decrease in wikidata dispatch times due to eqiad -> codfw DC switch

2018-10-11 Thread hoo
hoo added a comment. wikiadmin@db1109(wikidatawiki)> SELECT * FROM information_schema.tables WHERE table_name = 'wb_changes_dispatch'\G *** 1. row *** TABLE_CATALOG: def TABLE_SCHEMA: wikidatawiki TABLE_NAME: wb_changes_dispatch

[Wikidata-bugs] [Maniphest] [Updated] T206743: A few lexemes disappeared

2018-10-11 Thread Addshore
Addshore removed a project: Multi-Content-Revisions.Addshore added a comment. and removing MCR as it looks like this was some issue with replicationTASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc:

  1   2   >