[Wikidata-bugs] [Maniphest] [Lowered Priority] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread jcrespo
jcrespo lowered the priority of this task from "Unbreak Now!" to "High".jcrespo added a comment. High because data came back.TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, jcrespoCc: gerritbot,

[Wikidata-bugs] [Maniphest] [Commented On] T206619: Reorganizing Lexeme code

2018-10-11 Thread JeroenDeDauw
JeroenDeDauw added a comment. Started with moving : https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikibaseLexeme/+/466614 All changes are on branch "move". Starting with the second change there is a CS failure on Jenkins since some lines are now longer than 110 chars. I'm making sure the

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466610 merged by Gehel: [operations/puppet@production] wdqs: add logging message to autodeploy cron task https://gerrit.wikimedia.org/r/466610TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466700 merged by Gehel: [operations/puppet@production] wdqs: run autodeploy on the hour, 4 times per day https://gerrit.wikimedia.org/r/466700TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466652 merged by jenkins-bot: [operations/mediawiki-config@master] db-eqiad.php: Repool db1099:3318 https://gerrit.wikimedia.org/r/466652TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T203459: Alphabetically ordering glosses

2018-10-11 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)). TASK DETAILhttps://phabricator.wikimedia.org/T203459EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, ReleaseTaggerBotCc: gerritbot, KaMan, Lydia_Pintscher,

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466658 had a related patch set uploaded (by Marostegui; owner: Marostegui): [operations/mediawiki-config@master] db-eqiad.php: Depool db1101:3318 https://gerrit.wikimedia.org/r/466658TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466658 merged by jenkins-bot: [operations/mediawiki-config@master] db-eqiad.php: Depool db1101:3318 https://gerrit.wikimedia.org/r/466658TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466700 had a related patch set uploaded (by Gehel; owner: Gehel): [operations/puppet@production] wdqs: run autodeploy on the hour, 4 times per day https://gerrit.wikimedia.org/r/466700TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-11T15:12:50Z] Stop MySQL on db2085:3318 to reclone db1101:3318 - T206743TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466608 merged by Gehel: [operations/puppet@production] wdqs: fixed autodeploy cron logging permission issue https://gerrit.wikimedia.org/r/466608TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206619: Reorganizing Lexeme code

2018-10-11 Thread JeroenDeDauw
JeroenDeDauw added a comment. Initial moving is done, ending with https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikibaseLexeme/+/466691 The linked commit is the only one that does something other than directory/NS move. After this I want to look at things in a bit more detail, likely

[Wikidata-bugs] [Maniphest] [Updated] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread jcrespo
jcrespo added a project: User-notice.jcrespo added a comment. For #user-notice, if it seems reasonable, see T206743#4658525 for the state of things- data was temporarily lost (for around 1 day) but then it was recovered once detected. There may be smaller issues (preferences lost, what links here,

[Wikidata-bugs] [Maniphest] [Commented On] T206359: Kafka poller lag reporting is weird

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 465514 had a related patch set uploaded (by Smalyshev; owner: Smalyshev): [wikidata/query/rdf@master] Report timestamps only on single topic https://gerrit.wikimedia.org/r/465514TASK DETAILhttps://phabricator.wikimedia.org/T206359EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T206359: Kafka poller lag reporting is weird

2018-10-11 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T206359EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Gehel, Smalyshev, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo,

[Wikidata-bugs] [Maniphest] [Triaged] T206359: Kafka poller lag reporting is weird

2018-10-11 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T206359EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Gehel, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic,

[Wikidata-bugs] [Maniphest] [Triaged] T206256: Un-redirected items should be instant-indexed

2018-10-11 Thread EBjune
EBjune triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T206256EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBjuneCc: Aklapper, Sjoerddebruin, Smalyshev, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune,

[Wikidata-bugs] [Maniphest] [Created] T206767: wikidata-docker Quickstatements SSL error

2018-10-11 Thread expressionlibre
expressionlibre created this task.expressionlibre added a project: Wikidata.Restricted Application added a subscriber: Aklapper. TASK DESCRIPTIONHi, I just "docker-compose up" the wikidata-docker https://github.com/wmde/wikibase-docker/ The Quickstatement URL doesn't work : localhost:9191

[Wikidata-bugs] [Maniphest] [Updated] T198946: Add Schema property 'sameAs' pointing to Wikidata entries

2018-10-11 Thread cscott
cscott added a comment. I also worked on proper JSON+LD statements in T44063: [Epic] Provide a plain linked data interface for accessing entities and T164655: Store and serve annotations in W3C standard format. FWIW, with https://gerrit.wikimedia.org/r/384050 you get the following JSONLD for

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466710 had a related patch set uploaded (by Marostegui; owner: Marostegui): [operations/mediawiki-config@master] db-eqiad,db-codfw.php: Repool db1101:3318, db2085:3318, db2083 https://gerrit.wikimedia.org/r/466710TASK

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T199228: Define an SLO for Wikidata Query Service public endpoint and communicate it

2018-10-11 Thread Gehel
Gehel added a subscriber: Mathew.onipe.Gehel added a comment. In T199228#4655321, @Smalyshev wrote: I think update lag is not the biggest issue. Endpoint availability and response times is more important for most of the users, at least short-term. If there's a lag spike that goes away, most users

[Wikidata-bugs] [Maniphest] [Commented On] T206636: Provide a way to have test servers on real hardware, isolated from production

2018-10-11 Thread Andrew
Andrew added a comment. Hello @Gehel! We're unlikely to support bare metal on Labs in the near future, largely because our pilot program for this years ago determined that we were able to meet almost every actual use case using VMs. Can you tell me a bit more about what you need that a VM can't

[Wikidata-bugs] [Maniphest] [Commented On] T206636: Provide a way to have test servers on real hardware, isolated from production

2018-10-11 Thread Gehel
Gehel added a comment. The main contention point for WDQS (or investigating alternatives) seems to be IOPS. We tried setting up a wdqs test instance on WMCS, but IO contention meant that we were not able to keep up with the update flow. Our production instance consume ~3-4K IOPS just for updates.

[Wikidata-bugs] [Maniphest] [Commented On] T206423: The usual Lag pattern for wdqs2003 seems to be taking another turn

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466722 merged by Gehel: [operations/puppet@production] wdqs: use recent change poller on public cluster instead of kafka https://gerrit.wikimedia.org/r/466722TASK DETAILhttps://phabricator.wikimedia.org/T206423EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T106367: Generate BCP 47 conform language codes for the HTML attribute `lang`

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 460038 merged by jenkins-bot: [mediawiki/core@master] Ensure LanguageCode::bcp47() returns a valid BCP 47 language code https://gerrit.wikimedia.org/r/460038TASK DETAILhttps://phabricator.wikimedia.org/T106367EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T120847: Use BCP 47 conform language codes for the HTML attribute lang

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 460038 merged by jenkins-bot: [mediawiki/core@master] Ensure LanguageCode::bcp47() returns a valid BCP 47 language code https://gerrit.wikimedia.org/r/460038TASK DETAILhttps://phabricator.wikimedia.org/T120847EMAIL

[Wikidata-bugs] [Maniphest] [Closed] T106367: Generate BCP 47 conform language codes for the HTML attribute `lang`

2018-10-11 Thread Jdforrester-WMF
Jdforrester-WMF edited projects, added MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)); removed Patch-For-Review.Jdforrester-WMF closed this task as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T106367EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T122711: Appending ".json" to an entity url should work (Feature Request)

2018-10-11 Thread cscott
cscott added a comment. ...and adding .jsonld at the end should also work, right?TASK DETAILhttps://phabricator.wikimedia.org/T122711EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: cscottCc: cscott, Lucas_Werkmeister_WMDE, thiemowmde, Multichill, hoo,

[Wikidata-bugs] [Maniphest] [Updated] T206423: The usual Lag pattern for wdqs2003 seems to be taking another turn

2018-10-11 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T206423EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Stashbot, Smalyshev, Mathew.onipe, Gehel, Aklapper, CucyNoiD, Nandana, NebulousIris,

[Wikidata-bugs] [Maniphest] [Commented On] T206423: The usual Lag pattern for wdqs2003 seems to be taking another turn

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466722 had a related patch set uploaded (by Gehel; owner: Gehel): [operations/puppet@production] wdqs: use recent change poller on public cluster instead of kafka https://gerrit.wikimedia.org/r/466722TASK DETAILhttps://phabricator.wikimedia.org/T206423EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466710 merged by jenkins-bot: [operations/mediawiki-config@master] db-eqiad,db-codfw.php: Repool db1101:3318, db2085:3318, db2083 https://gerrit.wikimedia.org/r/466710TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T44063: [Epic] Provide a plain linked data interface for accessing entities

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 384050 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian): [mediawiki/extensions/Wikibase@master] Enable JSON-LD entity export https://gerrit.wikimedia.org/r/384050TASK DETAILhttps://phabricator.wikimedia.org/T44063EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T44063: [Epic] Provide a plain linked data interface for accessing entities

2018-10-11 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T44063EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: cscott, gerritbotCc: Realworldobject, Eroux108, Multichill, thiemowmde, Tpt, Lucas_Werkmeister_WMDE, Prtksxna,

[Wikidata-bugs] [Maniphest] [Updated] T120847: Use BCP 47 conform language codes for the HTML attribute lang

2018-10-11 Thread Jdforrester-WMF
Jdforrester-WMF removed a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T120847EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: cscott, Jdforrester-WMFCc: Jdforrester-WMF, gerritbot, cscott, Lydia_Pintscher, Aklapper, Fomafix,

[Wikidata-bugs] [Maniphest] [Commented On] T198946: Add Schema property 'sameAs' pointing to Wikidata entries

2018-10-11 Thread Niedzielski
Niedzielski added a comment. @cscott, thank you very much for these references.TASK DETAILhttps://phabricator.wikimedia.org/T198946EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NiedzielskiCc: Jdrewniak, Mholloway, gerritbot, Denny, ovasileva, Tbayer,

[Wikidata-bugs] [Maniphest] [Created] T206827: [Bug] TypeError thrown when loading page: Cannot read property '_getCachedMessage' of undefined

2018-10-11 Thread Niedzielski
Niedzielski created this task.Niedzielski added projects: Wikidata, wikiba.se, Regression.Restricted Application added a subscriber: Aklapper.Restricted Application changed the subtype of this task from "Deadline" to "Task". TASK DESCRIPTIONSteps to Reproduce Visit

[Wikidata-bugs] [Maniphest] [Commented On] T202848: Change property suggester to use hook instead of monkey patching

2018-10-11 Thread hoo
hoo added a comment. What's the state of https://gerrit.wikimedia.org/r/c/mediawiki/extensions/PropertySuggester/+/458187? @Jonas can it be merged?TASK DETAILhttps://phabricator.wikimedia.org/T202848EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jonas,

[Wikidata-bugs] [Maniphest] [Commented On] T206359: Kafka poller lag reporting is weird

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 465514 merged by jenkins-bot: [wikidata/query/rdf@master] Report timestamps only on single topic https://gerrit.wikimedia.org/r/465514TASK DETAILhttps://phabricator.wikimedia.org/T206359EMAIL

[Wikidata-bugs] [Maniphest] [Created] T206826: [Bug] TypeError thrown when loading page: wb.datamodel.Fingerprint is not a constructor

2018-10-11 Thread Niedzielski
Niedzielski created this task.Niedzielski added projects: Wikidata, wikiba.se, Regression.Restricted Application added a subscriber: Aklapper.Restricted Application changed the subtype of this task from "Deadline" to "Task". TASK DESCRIPTIONSteps to Reproduce Visit

[Wikidata-bugs] [Maniphest] [Commented On] T199228: Define an SLO for Wikidata Query Service public endpoint and communicate it

2018-10-11 Thread Smalyshev
Smalyshev added a comment. If update lag is not a big issue for our users, then we should make it clear. More precise statement would be a temporary update lag is not the highest priority issue. I.e. getting a hour-old data for a short time is not going to matter for most users, while e.g. not

[Wikidata-bugs] [Maniphest] [Edited] T202848: Change property suggester to use hook instead of monkey patching

2018-10-11 Thread hoo
hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x ] [[ https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Wikibase/+/459505/ | Teach EntitySelector._combineResults() to evaluate rank ]]...TASK DETAILhttps://phabricator.wikimedia.org/T202848EMAIL

[Wikidata-bugs] [Maniphest] [Edited] T202848: Change property suggester to use hook instead of monkey patching

2018-10-11 Thread hoo
hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x ] [[ https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Wikibase/+/459505/ | Teach EntitySelector._combineResults() to evaluate rank ]]...TASK DETAILhttps://phabricator.wikimedia.org/T202848EMAIL

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T198946: Add Schema property 'sameAs' pointing to Wikidata entries

2018-10-11 Thread Niedzielski
Niedzielski added a subscriber: pmiazga.Niedzielski added a comment. Patch revised. @ovasileva, moving to blocked pending feedback from Wikibase folks. @Jdlrobson, @pmiazga, reviews appreciated in the meantime!TASK DETAILhttps://phabricator.wikimedia.org/T198946EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T203459: Alphabetically ordering glosses

2018-10-11 Thread hoo
hoo moved this task from Peer Review to Test (Verification) on the Wikidata-Campsite-Iteration-∞ board.hoo removed a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T203459WORKBOARDhttps://phabricator.wikimedia.org/project/board/3539/EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206636: Provide a way to have test servers on real hardware, isolated from production

2018-10-11 Thread Smalyshev
Smalyshev added a comment. Our production instance consume ~3-4K IOPS just for updates. To clarify here, this would just allow us to barely run the updater. The server under production load - i.e. something we might need for performance evaluation and testing - are significantly higher, peaks

[Wikidata-bugs] [Maniphest] [Reopened] T205958: Wikibase\Repo\Search\Elastic\Tests\EntitySearchElasticFulltextTest::testSearchElastic fails on PHP 7.1

2018-10-11 Thread Legoktm
Legoktm reopened this task as "Open".Legoktm added a comment. Uhh, we seem to have regressed? It's failing again: https://integration.wikimedia.org/ci/job/wmf-quibble-vendor-mysql-php71-docker/12/consoleTextTASK DETAILhttps://phabricator.wikimedia.org/T205958EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T194273: Clean up indexes of wb_terms table

2018-10-11 Thread Marostegui
Marostegui added a comment. Is there any point on having this task if at some point wb_terms is going to be killed? Is it worth spending the time to research+alter this huge table if it will eventually be killed?TASK DETAILhttps://phabricator.wikimedia.org/T194273EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T205865: Investigate decrease in wikidata dispatch times due to eqiad -> codfw DC switch

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466029 had a related patch set uploaded (by Addshore; owner: Addshore): [mediawiki/extensions/Wikibase@master] SqlChangeDispatchCoordinator further statd tracking https://gerrit.wikimedia.org/r/466029TASK DETAILhttps://phabricator.wikimedia.org/T205865EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T205865: Investigate decrease in wikidata dispatch times due to eqiad -> codfw DC switch

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466031 had a related patch set uploaded (by Addshore; owner: Addshore): [mediawiki/extensions/Wikibase@wmf/1.32.0-wmf.24] SqlChangeDispatchCoordinator further statsd tracking https://gerrit.wikimedia.org/r/466031TASK

[Wikidata-bugs] [Maniphest] [Commented On] T205865: Investigate decrease in wikidata dispatch times due to eqiad -> codfw DC switch

2018-10-11 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-11T07:43:40Z] deploy https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Wikibase/+/466031 to mwmaint1002 only (increasing tracking of wikidata dispatching) T205865TASK

[Wikidata-bugs] [Maniphest] [Commented On] T205865: Investigate decrease in wikidata dispatch times due to eqiad -> codfw DC switch

2018-10-11 Thread Addshore
Addshore added a comment. Looking at a couple of minutes of extra timing data it looks like this is down to the selectCandidates DB query. This query must run much faster in codfw. F26506780: image.png $candidates = $dbr->selectFieldValues( $this->stateTable, 'chd_site', $where,

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 465566 merged by Gehel: [operations/puppet@production] wdqs: refactor use_git_deploy to include scap3 and autodeploy options https://gerrit.wikimedia.org/r/465566TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T206738: Wikibase appears to be failing phan on all builds now

2018-10-11 Thread Addshore
Addshore added projects: Wikidata-Campsite, Wikidata-Campsite-Iteration-∞. TASK DETAILhttps://phabricator.wikimedia.org/T206738EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Addshore, gerritbot, Legoktm, cscott, Aklapper, CucyNoiD, Nandana,

[Wikidata-bugs] [Maniphest] [Commented On] T206738: Wikibase appears to be failing phan on all builds now

2018-10-11 Thread Addshore
Addshore added a comment. I guess phan for gated extensions is one of the things that doesn't happen as part of the mwgate job in core.TASK DETAILhttps://phabricator.wikimedia.org/T206738EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Addshore,

[Wikidata-bugs] [Maniphest] [Created] T206743: A few lexemes disappeared

2018-10-11 Thread KaMan
KaMan created this task.KaMan added projects: Wikidata, Lexicographical data. TASK DESCRIPTIONI noticed strange thing. Lexemes from L20540 to L20543 just disappeared. They were neither merged, nor deleted. They for sure existed because they were created by me and I document every Polish lexeme I

[Wikidata-bugs] [Maniphest] [Triaged] T206619: Reorganizing Lexeme code

2018-10-11 Thread Addshore
Addshore triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T206619EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JeroenDeDauw, AddshoreCc: Aklapper, JeroenDeDauw, Nandana, Mringgaard, Lahi, Gq86, GoranSMilovanovic, QZanden,

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T206743: A few lexemes disappeared

2018-10-11 Thread Lea_Lacroix_WMDE
Lea_Lacroix_WMDE added subscribers: Ladsgroup, Addshore.Lea_Lacroix_WMDE added a comment. @Addshore @Ladsgroup Can you quickly look at this to try to find out what happened? Thanks :)TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Claimed] T206743: A few lexemes disappeared

2018-10-11 Thread Addshore
Addshore triaged this task as "High" priority.Addshore claimed this task.Addshore added a project: Datacenter-Switchover-2018.Restricted Application added a project: User-Addshore. TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Edited] T206743: A few lexemes disappeared

2018-10-11 Thread Addshore
Addshore updated the task description. (Show Details) CHANGES TO TASK DESCRIPTIONI noticed strange thing. Lexemes from L20540 to L20543 just disappeared. They were neither merged, nor deleted. They for sure existed because they were created by me and I document every Polish lexeme I created on [[

[Wikidata-bugs] [Maniphest] [Commented On] T206743: A few lexemes disappeared

2018-10-11 Thread Addshore
Addshore added a comment. Looking at https://www.wikidata.org/wiki/User:KaMan/brudnopis I guess L20542 also disappeared?TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Addshore, Ladsgroup,

[Wikidata-bugs] [Maniphest] [Closed] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread Mathew.onipe
Mathew.onipe closed this task as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Mathew.onipeCc: gerritbot, Aklapper, Smalyshev, Gehel, Mathew.onipe, CucyNoiD, Nandana, NebulousIris, AndyTan,

[Wikidata-bugs] [Maniphest] [Reopened] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread Mathew.onipe
Mathew.onipe reopened this task as "Open". TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Mathew.onipeCc: gerritbot, Aklapper, Smalyshev, Gehel, Mathew.onipe, CucyNoiD, Nandana, NebulousIris, AndyTan,

[Wikidata-bugs] [Maniphest] [Commented On] T206743: A few lexemes disappeared

2018-10-11 Thread KaMan
KaMan added a comment. I think L20542 was also mine used as etymology to others but I'm not 100% sure.TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, KaManCc: Addshore, Ladsgroup, Lea_Lacroix_WMDE,

[Wikidata-bugs] [Maniphest] [Updated] T206743: A few lexemes disappeared

2018-10-11 Thread Addshore
Addshore added a project: DBA.Addshore added a comment. I picked a slave for s8 in each DC. addshore@deploy1001:~$ sql wikidatawiki --host db1104 MariaDB [wikidatawiki]> select * from page where page_title = 'L20540' and page_namespace = 146; Empty set (0.00 sec) addshore@deploy2001:~$ sql

[Wikidata-bugs] [Maniphest] [Updated] T206743: A few lexemes disappeared

2018-10-11 Thread Addshore
Addshore added projects: Wikidata-Campsite, Wikidata-Campsite-Iteration-∞. TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Addshore, Ladsgroup, Lea_Lacroix_WMDE, Lexicographical data, KaMan,

[Wikidata-bugs] [Maniphest] [Commented On] T206743: A few lexemes disappeared

2018-10-11 Thread Addshore
Addshore added a comment. From the reported pages in the ticket page table CODFW: MariaDB [wikidatawiki]> select page_id from page where ( page_title = 'L20540' OR page_title = 'L20541' OR page_title = 'L20542' OR page_title = 'L20543') and page_namespace = 146; +--+ | page_id |

[Wikidata-bugs] [Maniphest] [Raised Priority] T206743: A few lexemes disappeared

2018-10-11 Thread Addshore
Addshore raised the priority of this task from "High" to "Unbreak Now!".Restricted Application added subscribers: Liuxinyu970226, TerraCodes. TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc:

[Wikidata-bugs] [Maniphest] [Commented On] T176405: Order of Forms

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 463980 merged by jenkins-bot: [mediawiki/extensions/WikibaseLexeme@master] Sort Forms in FormSet based on their numeric IDs https://gerrit.wikimedia.org/r/463980TASK DETAILhttps://phabricator.wikimedia.org/T176405EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: A few lexemes disappeared

2018-10-11 Thread Addshore
Addshore added a comment. It looks like it is more than just a few rows: CODFW: MariaDB [wikidatawiki]> SELECT count(*) from revision, page where rev_id > 745455836 and rev_id < 745468727 and page_id = rev_page; +--+ | count(*) | +--+ |12814 | +--+ 1 row in set (0.05

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466209 had a related patch set uploaded (by Mathew.onipe; owner: Mathew.onipe): [operations/puppet@production] wdqs: change user for autodeploy cron task https://gerrit.wikimedia.org/r/466209TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206738: Wikibase appears to be failing phan on all builds now

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 465958 merged by jenkins-bot: [mediawiki/extensions/Wikibase@master] Update use statements for re-namespacing of Revision-related classes https://gerrit.wikimedia.org/r/465958TASK DETAILhttps://phabricator.wikimedia.org/T206738EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T206743: A few lexemes disappeared

2018-10-11 Thread Addshore
Addshore added a project: Multi-Content-Revisions.Addshore added a comment. Tagging #multi-content-revisions as a suspectTASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: TerraCodes,

[Wikidata-bugs] [Maniphest] [Commented On] T203002: Order of Senses

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 463976 merged by jenkins-bot: [mediawiki/extensions/WikibaseLexeme@master] Sort Senses in SenseSet based on their numeric IDs https://gerrit.wikimedia.org/r/463976TASK DETAILhttps://phabricator.wikimedia.org/T203002EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T205556: Missing labels on items (statements show item IDs instead of labels even though labels are defined)

2018-10-11 Thread Billinghurst
Billinghurst added a comment. @Addshore As I mentioned above, whilst I a having some issues with WD directly, I am having greater issues with WEF framework tool's lookups. As I create items and do the lookup for matching terms it is finding items successfully, though the rendering of the name into

[Wikidata-bugs] [Maniphest] [Commented On] T205865: Investigate decrease in wikidata dispatch times due to eqiad -> codfw DC switch

2018-10-11 Thread hoo
hoo added a comment. Thanks @Marostegui but this sadly didn't help. Do you have any other ideas what could cause these discrepencies?TASK DETAILhttps://phabricator.wikimedia.org/T205865EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Stashbot,

[Wikidata-bugs] [Maniphest] [Commented On] T206743: A few lexemes disappeared

2018-10-11 Thread Marostegui
Marostegui added a comment. So for the record: we are live debugging with @Addshore on IRCTASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, MarosteguiCc: Marostegui, daniel, TerraCodes,

[Wikidata-bugs] [Maniphest] [Updated] T206743: A few lexemes disappeared

2018-10-11 Thread Addshore
Addshore removed a project: Multi-Content-Revisions.Addshore added a comment. and removing MCR as it looks like this was some issue with replicationTASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc:

[Wikidata-bugs] [Maniphest] [Commented On] T205865: Investigate decrease in wikidata dispatch times due to eqiad -> codfw DC switch

2018-10-11 Thread hoo
hoo added a comment. wikiadmin@db1109(wikidatawiki)> SELECT * FROM information_schema.tables WHERE table_name = 'wb_changes_dispatch'\G *** 1. row *** TABLE_CATALOG: def TABLE_SCHEMA: wikidatawiki TABLE_NAME: wb_changes_dispatch

[Wikidata-bugs] [Maniphest] [Triaged] T206738: Wikibase appears to be failing phan on all builds now

2018-10-11 Thread Addshore
Addshore moved this task from Peer Review to Test (Verification) on the Wikidata-Campsite-Iteration-∞ board.Addshore triaged this task as "High" priority.Addshore added a comment. @cscott can you confirm this is all working now? :)TASK

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466209 merged by Gehel: [operations/puppet@production] wdqs: change user for autodeploy cron task https://gerrit.wikimedia.org/r/466209TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T194164: Start reading from change_tag_def in production

2018-10-11 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T194164EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Lucas_Werkmeister_WMDE, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo,

[Wikidata-bugs] [Maniphest] [Updated] T194164: Start reading from change_tag_def in production

2018-10-11 Thread gerritbot
gerritbot added a comment.Restricted Application added a project: Wikidata. Change 466271 had a related patch set uploaded (by Ladsgroup; owner: Amir Sarabadani): [operations/mediawiki-config@master] Set some small wikis to read new for change tag backend https://gerrit.wikimedia.org/r/466271TASK

[Wikidata-bugs] [Maniphest] [Updated] T176405: Order of Forms

2018-10-11 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)). TASK DETAILhttps://phabricator.wikimedia.org/T176405EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, ReleaseTaggerBotCc: KaMan, gerritbot, WMDE-leszek,

[Wikidata-bugs] [Maniphest] [Updated] T206738: Wikibase appears to be failing phan on all builds now

2018-10-11 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)). TASK DETAILhttps://phabricator.wikimedia.org/T206738EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReleaseTaggerBotCc: Addshore, gerritbot, Legoktm, cscott, Aklapper,

[Wikidata-bugs] [Maniphest] [Claimed] T194164: Start reading from change_tag_def in production

2018-10-11 Thread Ladsgroup
Ladsgroup claimed this task.Ladsgroup edited projects, added Wikidata-Campsite-Iteration-∞; removed Wikidata-Ministry-Of-Magic-Tech-Debt, Wikidata-Ministry-Of-Magic.Restricted Application added a project: User-Ladsgroup. TASK DETAILhttps://phabricator.wikimedia.org/T194164EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T203002: Order of Senses

2018-10-11 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.32-notes (WMF-deploy-2018-10-16 (1.32.0-wmf.26)). TASK DETAILhttps://phabricator.wikimedia.org/T203002EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, ReleaseTaggerBotCc: KaMan, gerritbot, Lydia_Pintscher,

[Wikidata-bugs] [Maniphest] [Commented On] T198946: Add Schema property 'sameAs' pointing to Wikidata entries

2018-10-11 Thread Jdrewniak
Jdrewniak added a comment. @Niedzielski @type is tricky. The @context key refers to the vocabulary used to define the structured data. The problem is that http://schema.org and http://wikidata.org are different vocabularies, so a @type defined by Wikidata may be different than one defined by

[Wikidata-bugs] [Maniphest] [Retitled] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Addshore
Addshore renamed this task from "A few lexemes disappeared" to "S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")".Addshore reassigned this task from Addshore to Marostegui. TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-11T11:09:49Z] Stop MYSQL on db2088:3318 and db1099:3318 T206743TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui,

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-11T11:10:24Z] Stop MYSQL on db2085:3318 and db1099:3318 T206743TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui,

[Wikidata-bugs] [Maniphest] [Commented On] T194164: Start reading from change_tag_def in production

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466271 merged by jenkins-bot: [operations/mediawiki-config@master] Set some small wikis to read new for change tag backend https://gerrit.wikimedia.org/r/466271TASK DETAILhttps://phabricator.wikimedia.org/T194164EMAIL

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread Marostegui
Marostegui added a subscriber: mark.Marostegui added a comment. What we know for now is that there was a gap in replication between codfw and eqiad the 13th Sept (day after the failover), so whatever was inserted during that time on codfw master never reached eqiad (for all s8 table). We don't

[Wikidata-bugs] [Maniphest] [Commented On] T198946: Add Schema property 'sameAs' pointing to Wikidata entries

2018-10-11 Thread Jdrewniak
Jdrewniak added a comment. An update (I love to nerd out on this stuff). We're not the only ones to run into this problem. There are long-standing discussions between the relation of schema.org and Wikidata. Reading through this https://www.wikidata.org/wiki/Wikidata:Schema.org led me to this

[Wikidata-bugs] [Maniphest] [Commented On] T194164: Start reading from change_tag_def in production

2018-10-11 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-11T11:30:41Z] Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:466271|Set some small wikis to read new for change tag backend (T194164)]] (duration: 00m 50s)TASK

[Wikidata-bugs] [Maniphest] [Commented On] T206597: Refactor 'use_git_deploy' in wdqs puppet module to cater for scap3 and autodeployment modes

2018-10-11 Thread gerritbot
gerritbot added a comment. Change 466550 had a related patch set uploaded (by Mathew.onipe; owner: Mathew.onipe): [operations/puppet@production] wdqs: fixed autodeploy cron logging permission issue https://gerrit.wikimedia.org/r/466550TASK DETAILhttps://phabricator.wikimedia.org/T206597EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")

2018-10-11 Thread jcrespo
jcrespo added a comment. We know the exact timestamps of missing rows, from db1071-bin.007238:795791989 2018-09-13 09:08:17 on the active (codfw) master: db2045-bin.005879:1036765620 to db1071-bin.007238:796727644 2018-09-13 09:58:26 on the active (codfw) master: db2045-bin.005880:132937482 We

[Wikidata-bugs] [Maniphest] [Closed] T206738: Wikibase appears to be failing phan on all builds now

2018-10-11 Thread cscott
cscott closed this task as "Resolved".cscott claimed this task.cscott added a comment. Well, I rebased my two patches on top of @Legoktm's patch and the builds are passing now, so I'll call that fixed.TASK DETAILhttps://phabricator.wikimedia.org/T206738EMAIL

[Wikidata-bugs] [Maniphest] [Unblock] T205062: Reorganizing Wikibase Quality extensions

2018-10-11 Thread Addshore
Addshore closed subtask T205063: Merge WikibaseQuality and WikibaseQualityConstraints as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T205062EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: abian, Aklapper, Addshore, Nandana, Lahi,

[Wikidata-bugs] [Maniphest] [Closed] T205063: Merge WikibaseQuality and WikibaseQualityConstraints

2018-10-11 Thread Addshore
Addshore closed this task as "Resolved".Addshore added a comment. the change has been merged and is also deployed in productionTASK DETAILhttps://phabricator.wikimedia.org/T205063EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JeroenDeDauw, AddshoreCc:

[Wikidata-bugs] [Maniphest] [Blocker] T205065: Archive the WikibaseQuality extension

2018-10-11 Thread Addshore
Addshore changed the status of subtask T205064: Undeploy WikibaseQuality extension from the WMF from "Stalled" to "Open". TASK DETAILhttps://phabricator.wikimedia.org/T205065EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Aklapper, Addshore,

  1   2   >