[Wikidata-bugs] [Maniphest] T262178: One week after SDC edits the data still shows up in WCQS queries

2020-09-07 Thread Jarekt
Jarekt added a comment. I can confirm that my query works as expected today all the found duplicates were real. I did not realized that we had at maximum one week lag between edit and the update of WCQS. The length of that lag was my concern, but it sounds like it will not be addressed in

[Wikidata-bugs] [Maniphest] T259410: Is PrimarySources still an active project?

2020-09-07 Thread Pppery
Pppery added a project: Projects-Cleanup. TASK DETAIL https://phabricator.wikimedia.org/T259410 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pppery Cc: Pppery, Kiailandi, Hjfocs, Aklapper, Jingbiao95, DannyS712, Reari, dachary, Wikidata-bugs,

[Wikidata-bugs] [Maniphest] T261850: compare model accuracy with and without property suggester

2020-09-07 Thread Ladsgroup
Ladsgroup moved this task from Doing to Peer Review on the Item Quality Scoring Improvement (Item Quality Scoring Improvement - Sprint 3) board. Ladsgroup added a comment. (All are micro average

[Wikidata-bugs] [Maniphest] T261850: compare model accuracy with and without property suggester

2020-09-07 Thread Ladsgroup
Ladsgroup claimed this task. Ladsgroup moved this task from To Do to Doing on the Item Quality Scoring Improvement (Item Quality Scoring Improvement - Sprint 3) board. Restricted Application added a project: User-Ladsgroup. TASK DETAIL https://phabricator.wikimedia.org/T261850 WORKBOARD

[Wikidata-bugs] [Maniphest] T262178: One week after SDC edits the data still shows up in WCQS queries

2020-09-07 Thread Zbyszko
Zbyszko added a comment. Today's reload happened and if this (https://tinyurl.com/y5vd95rm) query is correct, there are no duplicates. @Jarekt, can you confirm? TASK DETAIL https://phabricator.wikimedia.org/T262178 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T262214: Quickstatements login error

2020-09-07 Thread Larjohn
Larjohn added a comment. This issue has been fixed in the actual magnustools repo, but it doesn't appear fixed in the docker container. TASK DETAIL https://phabricator.wikimedia.org/T262214 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Larjohn

[Wikidata-bugs] [Maniphest] T262214: Quickstatements login error

2020-09-07 Thread Larjohn
Larjohn created this task. Larjohn added a project: Wikibase-Containers. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION Steps to Reproduce: 1. Install wikibase docker 2. Head to http://localhost:9191/ 3. Click

[Wikidata-bugs] [Maniphest] T256946: Add a custom watermark generator that supports low rate streams

2020-09-07 Thread Gehel
Gehel moved this task from Scaling to Current work on the Wikidata-Query-Service board. Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T256946 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T258687: The streaming updater should read its events from multiple DC streams

2020-09-07 Thread Gehel
Gehel moved this task from Scaling to Current work on the Wikidata-Query-Service board. Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T258687 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T262020: Make sure that transaction.id assigned by Flink is unique for concurrent runs of Streaming Updater pipeline

2020-09-07 Thread Gehel
Gehel moved this task from Scaling to Current work on the Wikidata-Query-Service board. Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T262020 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T261937: Add CPU load and query concurrency as context to event logging from WDQS

2020-09-07 Thread Gehel
Gehel moved this task from All WDQS-related tasks to Current work on the Wikidata-Query-Service board. Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T261937 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL

[Wikidata-bugs] [Maniphest] T261937: Add CPU load and query concurrency as context to event logging from WDQS

2020-09-07 Thread Gehel
Gehel removed a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T261937 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: JAllemandou, Aklapper, Gehel, CBogen, Akuckartz, darthmon_wmde, Nandana,

[Wikidata-bugs] [Maniphest] T262009: Add an entry in the WDQS Runbook on killer queries

2020-09-07 Thread Gehel
Gehel added a subtask: T262002: Improve visibility into blazegraph queries causing errors. TASK DETAIL https://phabricator.wikimedia.org/T262009 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Aklapper, RKemper, Gehel, CBogen, Akuckartz,

[Wikidata-bugs] [Maniphest] T262002: Improve visibility into blazegraph queries causing errors

2020-09-07 Thread Gehel
Gehel added a parent task: T262009: Add an entry in the WDQS Runbook on killer queries. TASK DETAIL https://phabricator.wikimedia.org/T262002 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: #discovery-search, RKemper, Aklapper, CBogen,

[Wikidata-bugs] [Maniphest] T262002: Improve visibility into blazegraph queries causing errors

2020-09-07 Thread Gehel
Gehel edited projects, added Wikidata-Query-Service; removed Discovery-Search. Restricted Application added a project: Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T262002 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc:

[Wikidata-bugs] [Maniphest] T260232: BatchRowIterator slow query on commonswiki

2020-09-07 Thread gerritbot
gerritbot added a comment. Change 625642 had a related patch set uploaded (by ArielGlenn; owner: ArielGlenn): [mediawiki/core@master] don't pass page id 0 to page related queries for category change rdf dumps https://gerrit.wikimedia.org/r/625642 TASK DETAIL

[Wikidata-bugs] [Maniphest] T260869: Wikidata sitelink save, shows error message twice.

2020-09-07 Thread Jakob_WMDE
Jakob_WMDE claimed this task. Jakob_WMDE moved this task from To Do to Doing on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞) board. TASK DETAIL https://phabricator.wikimedia.org/T260869 WORKBOARD https://phabricator.wikimedia.org/project/board/3539/ EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T260232: BatchRowIterator slow query on commonswiki

2020-09-07 Thread ArielGlenn
ArielGlenn added a comment. In T260232#6390706 , @gerritbot wrote: > Change 620775 had a related patch set uploaded (by ArielGlenn; owner: ArielGlenn): > [mediawiki/core@master] don't include null page ids in query list for category

[Wikidata-bugs] [Maniphest] T205094: Investigate and restructure SQL directory, and use new MediaWiki abstract schema change features

2020-09-07 Thread Ladsgroup
Ladsgroup merged a task: T259411: Migrate Wikibase to the abstract schema. TASK DETAIL https://phabricator.wikimedia.org/T205094 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Ladsgroup Cc: WMDE-leszek, Lucas_Werkmeister_WMDE, Izno, Michael,

[Wikidata-bugs] [Maniphest] T259411: Migrate Wikibase to the abstract schema

2020-09-07 Thread Ladsgroup
Ladsgroup closed this task as a duplicate of T205094: Investigate and restructure SQL directory, and use new MediaWiki abstract schema change features. TASK DETAIL https://phabricator.wikimedia.org/T259411 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/

[Wikidata-bugs] [Maniphest] T259411: Migrate Wikibase to the abstract schema

2020-09-07 Thread Ladsgroup
Ladsgroup added a comment. I'm already doing this as part of T205094: Investigate and restructure SQL directory, and use new MediaWiki abstract schema change features . Merging these two together. TASK DETAIL

[Wikidata-bugs] [Maniphest] T258269: Add query result to the current WDQS event logging

2020-09-07 Thread JAllemandou
JAllemandou added a comment. In term of logging-size, it probably depends on the result type: in case of descriptions or other text-heavy fields, this could get bigger if high or no `LIMIT` are set in the number of returned rows. We should set a limit :) TASK DETAIL

[Wikidata-bugs] [Maniphest] T205094: Investigate and restructure SQL directory, and use new MediaWiki abstract schema change features

2020-09-07 Thread Ladsgroup
Ladsgroup moved this task from To Do to Peer Review on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞) board. Ladsgroup claimed this task. Ladsgroup added a comment. This patch needs review ^ :D TASK DETAIL https://phabricator.wikimedia.org/T205094 WORKBOARD

[Wikidata-bugs] [Maniphest] T261937: Add CPU load and query concurrency as context to event logging from WDQS

2020-09-07 Thread JAllemandou
JAllemandou added a comment. Will make it a lot easier to analyze than to have to build the 'in-flight' view of queries! TASK DETAIL https://phabricator.wikimedia.org/T261937 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: JAllemandou Cc:

[Wikidata-bugs] [Maniphest] T262178: One week after SDC edits the data still shows up in WCQS queries

2020-09-07 Thread Gehel
Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T262178 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Mahir256, Zbyszko, Aklapper, Jarekt, CBogen, Akuckartz, darthmon_wmde, Nandana,

[Wikidata-bugs] [Maniphest] T261916: tools submodule is not failing the build when running unit tests

2020-09-07 Thread Gehel
Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T261916 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: Aklapper, dcausse, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] T258354: create new rate-limited bot group for Wikidata

2020-09-07 Thread MarcoAurelio
MarcoAurelio added a comment. Instead of a new user group, a better solution would be to remove, for the Wikidata bot group, the `noratelimit` permission and adjust in {src rOMWC :wmf-config/InitialiseSettings.php} an acceptable

[Wikidata-bugs] [Maniphest] T262198: Convert P1438 from string to external ID

2020-09-07 Thread Lea_Lacroix_WMDE
Lea_Lacroix_WMDE created this task. Lea_Lacroix_WMDE added projects: Wikidata, Wikidata-Campsite. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Per request from the community,

[Wikidata-bugs] [Maniphest] T260869: Wikidata sitelink save, shows error message twice.

2020-09-07 Thread Jakob_WMDE
Jakob_WMDE removed Jakob_WMDE as the assignee of this task. Jakob_WMDE moved this task from Doing to To Do on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞) board. TASK DETAIL https://phabricator.wikimedia.org/T260869 WORKBOARD https://phabricator.wikimedia.org/project/board/3539/

[Wikidata-bugs] [Maniphest] T260966: Deploy WikibaseManifest on Wikidata.org

2020-09-07 Thread Samantha_Alipio_WMDE
Samantha_Alipio_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T260966 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Samantha_Alipio_WMDE Cc: Aklapper, Tarrow, NavinRizwi, Akuckartz, darthmon_wmde, DannyS712,

[Wikidata-bugs] [Maniphest] T262187: Wikidata entity dumps didn't start this week

2020-09-07 Thread Marostegui
Marostegui added a comment. Sorry for breaking it! I thought s8 would behave as any other sX section and if you leave a section with no members, MW would automatically pick any other host. Normally, when eqiad is the active DC, we try no to leave any section without any hosts, so we can

[Wikidata-bugs] [Maniphest] T262187: Wikidata entity dumps didn't start this week

2020-09-07 Thread ArielGlenn
ArielGlenn created this task. ArielGlenn added projects: Wikidata, Dumps-Generation. TASK DESCRIPTION This change: P12492 left the dump db group empty, and so any attempts to run wikidata entity dumps failed. The host was added back in early on

[Wikidata-bugs] [Maniphest] T262178: One week after SDC edits the data still shows up in WCQS queries

2020-09-07 Thread Zbyszko
Zbyszko added a comment. The process we have right now is that we use SDC dumps to reload the data each week. Dumps are made each Sunday, which means, that all the changes made between Aug 30th and Sep 6th will only show up in the dump released on Sep 6th. I pushed the update time from

[Wikidata-bugs] [Maniphest] T262178: One week after SDC edits the data still shows up in WCQS queries

2020-09-07 Thread Zbyszko
Zbyszko added a comment. The process we have right now is that we use SDC dumps to reload the data each week. Dumps are made each Sunday, which means, that all the changes made between Aug 30th and Sep 6th will only show up in the dump released on Sep 6th. I pushed the update time from