[Wikidata-bugs] [Maniphest] T262178: One week after SDC edits the data still shows up in WCQS queries

2020-09-07 Thread Jarekt
Jarekt added a comment.


  I can confirm that my query works as expected today all the found duplicates 
were real. I did not realized that we had at maximum one week lag between edit 
and the update of WCQS. The length of that lag was my concern, but it sounds 
like it will not be addressed in beta version

TASK DETAIL
  https://phabricator.wikimedia.org/T262178

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jarekt
Cc: Mahir256, Zbyszko, Aklapper, Jarekt, CBogen, Akuckartz, darthmon_wmde, 
Nandana, JKSTNK, Namenlos314, Lahi, PDrouin-WMF, Gq86, E1presidente, 
Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, 
Salgo60, Silverfish, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Susannaanas, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, matthiasmullie, 
aude, Tobias1984, Manybubbles, Ricordisamoa, Wesalius, Lydia_Pintscher, 
Fabrice_Florin, Raymond, Steinsplitter, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T259410: Is PrimarySources still an active project?

2020-09-07 Thread Pppery
Pppery added a project: Projects-Cleanup.

TASK DETAIL
  https://phabricator.wikimedia.org/T259410

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pppery
Cc: Pppery, Kiailandi, Hjfocs, Aklapper, Jingbiao95, DannyS712, Reari, dachary, 
Wikidata-bugs, Dinoguy1000, Ricordisamoa, Tacsipacsi, Sjoerddebruin, Tpt, 
Mbch331, Jay8g
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T261850: compare model accuracy with and without property suggester

2020-09-07 Thread Ladsgroup
Ladsgroup moved this task from Doing to Peer Review on the Item Quality Scoring 
Improvement (Item Quality Scoring Improvement - Sprint 3) board.
Ladsgroup added a comment.


  (All are micro average 

 not macro)
  
  Old-data, new features
  
  | Metric  | Without Property suggester | With Property suggester 
| Difference|
  | False positive rate | 0.057  | 0.058   
| 1.7% decrease |
  | Accuracy| 0.929  | 0.929   
| No difference |
  | roc_auc | 0.972  | 0.973   
| 0.1% increase |
  |
  
  New data, new features
  
  | Metric  | Without Property suggester | With Property suggester 
| Difference|
  | False positive rate | 0.115  | 0.116   
| 0.87% increase(!) |
  | Accuracy| 0.818  | 0.817   
| 0.1% decrease(!)  |
  | roc_auc | 0.864  | 0.866   
| 0.2% increase |
  |
  
  All data combined, new features
  
  | Metric  | Without Property suggester | With Property suggester 
| Difference|
  | False positive rate | 0.052  | 0.052   
| No difference |
  | Accuracy| 0.93   | 0.931   
| 0.1% increase |
  | roc_auc | 0.964  | 0.965   
| 0.1% increase |
  |
  
  As you can see there's not much that can be gained from item completeness 
metric, my hypotheses is that it used to be useful when all of our features 
were broken. Let's try with one thing only:
  
  Old-data, old features:
  
  | Metric  | Without Property suggester | With Property suggester 
| Difference|
  | False positive rate | 0.066  | 0.066   
| No difference |
  | Accuracy| 0.922  | 0.923   
| 0.1% increase |
  | roc_auc | 0.964  | 0.965   
| 0.1% increase |
  |
  
  Nope, no actual change :/ also in the commit that introduced it I can find 
any improvement either: 
https://github.com/wikimedia/articlequality/commit/1d0feffdcecbbee6fa11903531edc5e4e91b41e3#diff-834e2f59d8597053582b57dc05d4c08e
  
  While we are here, it's nice to compare old features and new features:
  old-data, without property suggester
  
  | Metric  | Old features | new features | Difference|
  | False positive rate | 0.066| 0.057| 14% decrease  |
  | Accuracy| 0.922| 0.929| 0.8% increase |
  | roc_auc | 0.964| 0.972| 0.8% increase |
  |
  
  It shows a sharp increase in accuracy, 1% might not be much but keep it in 
mind we are in the long tail. If I want to explain it better, we should flip 
the values for accuracy and ROC-AUC. Then you will have 9% decrease in 
inaccuracy (That value for adding property suggester with old data and old 
features is 1.3% decrease inaccuracy which is still negligible IMO)

TASK DETAIL
  https://phabricator.wikimedia.org/T261850

WORKBOARD
  https://phabricator.wikimedia.org/project/board/4952/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Aklapper, GoranSMilovanovic, Lydia_Pintscher, guergana.tzatchkova, 
Hazizibinmahdi, Akuckartz, darthmon_wmde, Michael, Nandana, Lahi, Gq86, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Ladsgroup, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T261850: compare model accuracy with and without property suggester

2020-09-07 Thread Ladsgroup
Ladsgroup claimed this task.
Ladsgroup moved this task from To Do to Doing on the Item Quality Scoring 
Improvement (Item Quality Scoring Improvement - Sprint 3) board.
Restricted Application added a project: User-Ladsgroup.

TASK DETAIL
  https://phabricator.wikimedia.org/T261850

WORKBOARD
  https://phabricator.wikimedia.org/project/board/4952/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Aklapper, GoranSMilovanovic, Lydia_Pintscher, guergana.tzatchkova, 
Hazizibinmahdi, Akuckartz, darthmon_wmde, Michael, Nandana, Lahi, Gq86, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Ladsgroup, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262178: One week after SDC edits the data still shows up in WCQS queries

2020-09-07 Thread Zbyszko
Zbyszko added a comment.


  Today's reload happened and if this (https://tinyurl.com/y5vd95rm) query is 
correct, there are no duplicates. @Jarekt, can you confirm?

TASK DETAIL
  https://phabricator.wikimedia.org/T262178

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Zbyszko
Cc: Mahir256, Zbyszko, Aklapper, Jarekt, CBogen, Akuckartz, darthmon_wmde, 
Nandana, JKSTNK, Namenlos314, Lahi, PDrouin-WMF, Gq86, E1presidente, 
Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, 
Salgo60, Silverfish, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Susannaanas, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, matthiasmullie, 
aude, Tobias1984, Manybubbles, Ricordisamoa, Wesalius, Lydia_Pintscher, 
Fabrice_Florin, Raymond, Steinsplitter, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262214: Quickstatements login error

2020-09-07 Thread Larjohn
Larjohn added a comment.


  This issue has been fixed in the actual magnustools repo, but it doesn't 
appear fixed in the docker container.

TASK DETAIL
  https://phabricator.wikimedia.org/T262214

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Larjohn
Cc: Aklapper, Larjohn, Samantha_Alipio_WMDE, Akuckartz, darthmon_wmde, Jelabra, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Asahiko, despens, Wikidata-bugs, aude, Addshore, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262214: Quickstatements login error

2020-09-07 Thread Larjohn
Larjohn created this task.
Larjohn added a project: Wikibase-Containers.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  Steps to Reproduce:
  
  1. Install wikibase docker
  2. Head to http://localhost:9191/
  3. Click "Login" on top right
  
  Actual Results:
  
  Warning:  
require_once(/data/project/magnustools/public_html/php/WikidataItem.php): 
failed to open stream: No such file or directory in 
/var/www/html/magnustools/public_html/php/wikidata.php on line 
5
  
  Fatal error:  require_once(): Failed opening required 
'/data/project/magnustools/public_html/php/WikidataItem.php' 
(include_path='.:/usr/local/lib/php') in 
/var/www/html/magnustools/public_html/php/wikidata.php on line 
5
  
  Expected Results:
  A login form?

TASK DETAIL
  https://phabricator.wikimedia.org/T262214

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Larjohn
Cc: Aklapper, Larjohn, Samantha_Alipio_WMDE, Akuckartz, darthmon_wmde, Jelabra, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Asahiko, despens, Wikidata-bugs, aude, Addshore, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T256946: Add a custom watermark generator that supports low rate streams

2020-09-07 Thread Gehel
Gehel moved this task from Scaling to Current work on the 
Wikidata-Query-Service board.
Gehel added a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T256946

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Zbyszko, dcausse, Aklapper, CBogen, Akuckartz, darthmon_wmde, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T258687: The streaming updater should read its events from multiple DC streams

2020-09-07 Thread Gehel
Gehel moved this task from Scaling to Current work on the 
Wikidata-Query-Service board.
Gehel added a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T258687

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Thadguidry, dcausse, Aklapper, CBogen, Akuckartz, darthmon_wmde, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262020: Make sure that transaction.id assigned by Flink is unique for concurrent runs of Streaming Updater pipeline

2020-09-07 Thread Gehel
Gehel moved this task from Scaling to Current work on the 
Wikidata-Query-Service board.
Gehel added a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T262020

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Zbyszko, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T261937: Add CPU load and query concurrency as context to event logging from WDQS

2020-09-07 Thread Gehel
Gehel moved this task from All WDQS-related tasks to Current work on the 
Wikidata-Query-Service board.
Gehel added a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T261937

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: JAllemandou, Aklapper, Gehel, CBogen, Akuckartz, darthmon_wmde, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T261937: Add CPU load and query concurrency as context to event logging from WDQS

2020-09-07 Thread Gehel
Gehel removed a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T261937

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: JAllemandou, Aklapper, Gehel, CBogen, Akuckartz, darthmon_wmde, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262009: Add an entry in the WDQS Runbook on killer queries

2020-09-07 Thread Gehel
Gehel added a subtask: T262002: Improve visibility into blazegraph queries 
causing errors.

TASK DETAIL
  https://phabricator.wikimedia.org/T262009

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, RKemper, Gehel, CBogen, Akuckartz, darthmon_wmde, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262002: Improve visibility into blazegraph queries causing errors

2020-09-07 Thread Gehel
Gehel added a parent task: T262009: Add an entry in the WDQS Runbook on killer 
queries.

TASK DETAIL
  https://phabricator.wikimedia.org/T262002

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: #discovery-search, RKemper, Aklapper, CBogen, Akuckartz, darthmon_wmde, 
Nandana, Namenlos314, jijiki, Klaas_Z4us_V, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, elukey, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331, Jay8g
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262002: Improve visibility into blazegraph queries causing errors

2020-09-07 Thread Gehel
Gehel edited projects, added Wikidata-Query-Service; removed Discovery-Search.
Restricted Application added a project: Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T262002

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: #discovery-search, RKemper, Aklapper, CBogen, Akuckartz, darthmon_wmde, 
Nandana, Namenlos314, jijiki, Klaas_Z4us_V, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, elukey, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Manybubbles, Mbch331, Jay8g
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T260232: BatchRowIterator slow query on commonswiki

2020-09-07 Thread gerritbot
gerritbot added a comment.


  Change 625642 had a related patch set uploaded (by ArielGlenn; owner: 
ArielGlenn):
  [mediawiki/core@master] don't pass page id 0 to page related queries for 
category change rdf dumps
  
  https://gerrit.wikimedia.org/r/625642

TASK DETAIL
  https://phabricator.wikimedia.org/T260232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: ArielGlenn, CBogen, Cparle, Umherirrender, DannyS712, Naike, WDoranWMF, 
Krinkle, aaron, Reedy, Ladsgroup, Aklapper, Marostegui, XeroS_SkalibuR, 
Alter-paule, jannee_e, Beast1978, Un1tY, Akuckartz, eprodromou, Hook696, 
Adidsone1, darthmon_wmde, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, Gaboe420, Phukettaxigroup, Giuliamocci, Cpaulf30, Lahi, Gq86, 
Af420, Ramsey-WMF, Darkminds3113, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, Jayprakash12345, Lunewa, QZanden, EBjune, merbst, 
LawExplorer, Vali.matei, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, 
Jonas, Xmlizer, Volker_E, gnosygnu, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, GWicke, Dcljr, Dinoguy1000, Manybubbles, Mbch331, Rxy, Jay8g, Ltrlg
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T260869: Wikidata sitelink save, shows error message twice.

2020-09-07 Thread Jakob_WMDE
Jakob_WMDE claimed this task.
Jakob_WMDE moved this task from To Do to Doing on the Wikidata-Campsite 
(Wikidata-Campsite-Iteration-∞) board.

TASK DETAIL
  https://phabricator.wikimedia.org/T260869

WORKBOARD
  https://phabricator.wikimedia.org/project/board/3539/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jakob_WMDE
Cc: Jakob_WMDE, Lucas_Werkmeister_WMDE, HakanIST, Aklapper, Akuckartz, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T260232: BatchRowIterator slow query on commonswiki

2020-09-07 Thread ArielGlenn
ArielGlenn added a comment.


  In T260232#6390706 , 
@gerritbot wrote:
  
  > Change 620775 had a related patch set uploaded (by ArielGlenn; owner: 
ArielGlenn):
  > [mediawiki/core@master] don't include null page ids in query list for 
category dumps
  >
  > https://gerrit.wikimedia.org/r/620775
  
  I have tested the above patch by doing a manual run of the cron script on 
snapshot1008 as the dumpsgen user:
  
dumpsgen@snapshot1008:~$ /usr/local/bin/dumpcategoriesrdf.sh --config 
/etc/dumps/confs/wikidump.conf.other --list 
/srv/mediawiki/dblists/categories-rdf.dblist
  
  It completed in a little under 4 hours for all wikis. What is needed to get 
the patch merged?

TASK DETAIL
  https://phabricator.wikimedia.org/T260232

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn
Cc: ArielGlenn, CBogen, Cparle, Umherirrender, DannyS712, Naike, WDoranWMF, 
Krinkle, aaron, Reedy, Ladsgroup, Aklapper, Marostegui, XeroS_SkalibuR, 
Alter-paule, jannee_e, Beast1978, Un1tY, Akuckartz, eprodromou, Hook696, 
Adidsone1, darthmon_wmde, Kent7301, joker88john, CucyNoiD, Nandana, 
Namenlos314, Gaboe420, Phukettaxigroup, Giuliamocci, Cpaulf30, Lahi, Gq86, 
Af420, Ramsey-WMF, Darkminds3113, Bsandipan, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, Jayprakash12345, Lunewa, QZanden, EBjune, merbst, 
LawExplorer, Vali.matei, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, 
Jonas, Xmlizer, Volker_E, gnosygnu, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, GWicke, Dcljr, Dinoguy1000, Manybubbles, Mbch331, Rxy, Jay8g, Ltrlg
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T205094: Investigate and restructure SQL directory, and use new MediaWiki abstract schema change features

2020-09-07 Thread Ladsgroup
Ladsgroup merged a task: T259411: Migrate Wikibase to the abstract schema.

TASK DETAIL
  https://phabricator.wikimedia.org/T205094

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: WMDE-leszek, Lucas_Werkmeister_WMDE, Izno, Michael, Ladsgroup, daniel, 
Addshore, Aklapper, Matthias_Geisler_WMDE, Jonas, Alter-paule, Hazizibinmahdi, 
Beast1978, Un1tY, Akuckartz, Hook696, Iflorez, darthmon_wmde, Kent7301, 
alaa_wmde, joker88john, DannyS712, CucyNoiD, Nandana, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Pablo-WMDE, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Dinoguy1000, Lydia_Pintscher, Mbch331, Jay8g
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T259411: Migrate Wikibase to the abstract schema

2020-09-07 Thread Ladsgroup
Ladsgroup closed this task as a duplicate of T205094: Investigate and 
restructure SQL directory, and use new MediaWiki abstract schema change 
features.

TASK DETAIL
  https://phabricator.wikimedia.org/T259411

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Aklapper, Ladsgroup, Naike, Akuckartz, darthmon_wmde, Nandana, lucamauri, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Agabi10, Scott_WUaS, Wikidata-bugs, aude, Anomie, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T259411: Migrate Wikibase to the abstract schema

2020-09-07 Thread Ladsgroup
Ladsgroup added a comment.


  I'm already doing this as part of T205094: Investigate and restructure SQL 
directory, and use new MediaWiki abstract schema change features 
. Merging these two together.

TASK DETAIL
  https://phabricator.wikimedia.org/T259411

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Aklapper, Ladsgroup, Naike, Akuckartz, darthmon_wmde, Nandana, lucamauri, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Agabi10, Scott_WUaS, Wikidata-bugs, aude, Anomie, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T258269: Add query result to the current WDQS event logging

2020-09-07 Thread JAllemandou
JAllemandou added a comment.


  In term of logging-size, it probably depends on the result type: in case of 
descriptions or other text-heavy fields, this could get bigger if high or no 
`LIMIT` are set in the number of returned rows. We should set a limit :)

TASK DETAIL
  https://phabricator.wikimedia.org/T258269

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: JAllemandou
Cc: JAllemandou, GoranSMilovanovic, Gehel, Aklapper, CBogen, Akuckartz, 
darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T205094: Investigate and restructure SQL directory, and use new MediaWiki abstract schema change features

2020-09-07 Thread Ladsgroup
Ladsgroup moved this task from To Do to Peer Review on the Wikidata-Campsite 
(Wikidata-Campsite-Iteration-∞) board.
Ladsgroup claimed this task.
Ladsgroup added a comment.


  This patch needs review ^ :D

TASK DETAIL
  https://phabricator.wikimedia.org/T205094

WORKBOARD
  https://phabricator.wikimedia.org/project/board/3539/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: WMDE-leszek, Lucas_Werkmeister_WMDE, Izno, Michael, Ladsgroup, daniel, 
Addshore, Aklapper, Matthias_Geisler_WMDE, Jonas, Alter-paule, Hazizibinmahdi, 
Beast1978, Un1tY, Akuckartz, Hook696, Iflorez, darthmon_wmde, Kent7301, 
alaa_wmde, joker88john, DannyS712, CucyNoiD, Nandana, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Pablo-WMDE, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Dinoguy1000, Lydia_Pintscher, Mbch331, Jay8g
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T261937: Add CPU load and query concurrency as context to event logging from WDQS

2020-09-07 Thread JAllemandou
JAllemandou added a comment.


  Will make it a lot easier to analyze than to have to build the 'in-flight' 
view of queries!

TASK DETAIL
  https://phabricator.wikimedia.org/T261937

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: JAllemandou
Cc: JAllemandou, Aklapper, Gehel, CBogen, Akuckartz, darthmon_wmde, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262178: One week after SDC edits the data still shows up in WCQS queries

2020-09-07 Thread Gehel
Gehel added a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T262178

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Mahir256, Zbyszko, Aklapper, Jarekt, CBogen, Akuckartz, darthmon_wmde, 
Nandana, JKSTNK, Namenlos314, Lahi, PDrouin-WMF, Gq86, E1presidente, 
Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, 
Salgo60, Silverfish, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Susannaanas, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, matthiasmullie, 
aude, Tobias1984, Manybubbles, Ricordisamoa, Wesalius, Lydia_Pintscher, 
Fabrice_Florin, Raymond, Steinsplitter, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T261916: tools submodule is not failing the build when running unit tests

2020-09-07 Thread Gehel
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T261916

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse, Gehel
Cc: Aklapper, dcausse, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T258354: create new rate-limited bot group for Wikidata

2020-09-07 Thread MarcoAurelio
MarcoAurelio added a comment.


  Instead of a new user group, a better solution would be to remove, for the 
Wikidata bot group, the `noratelimit` permission and adjust in {src rOMWC 
:wmf-config/InitialiseSettings.php}
 an acceptable rate limit for all bots if needed. Currently non-autoconfirmed 
users gets 8 edits per minute, while autoconfirmed gets 90 edits per minute. 90 
edits/minute. Should be an acceptable limit, and just requires a simple config 
patch instead of (a) create a new group and (b) move accounts between groups.

TASK DETAIL
  https://phabricator.wikimedia.org/T258354

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MarcoAurelio
Cc: MarcoAurelio, Urbanecm, ItamarWMDE, Lucas_Werkmeister_WMDE, Hazard-SJ, 
pywikibot-bugs-list, Multichill, Rschen7754, Pasleim, matej_suchanek, tfmorris, 
Ladsgroup, Mike_Peel, Mohammed_Sadat_WMDE, Dipsacus_fullonum, Bugreporter, 
MisterSynergy, Lea_Lacroix_WMDE, Aklapper, Lydia_Pintscher, JohnsonLee01, 
SHEKH, Dijkstra, Alter-paule, Beast1978, Un1tY, Khutuck, Akuckartz, Zkhalido, 
Hook696, Iflorez, darthmon_wmde, Kent7301, alaa_wmde, joker88john, Viztor, 
CucyNoiD, Nandana, Wenyi, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, 
Bsandipan, GoranSMilovanovic, QZanden, Tbscho, MayS, LawExplorer, Lewizho99, 
Mdupont, JJMC89, Maathavan, Dvorapa, _jensen, rosalieper, Altostratus, 
Avicennasis, Scott_WUaS, Jonas, mys_721tx, Wikidata-bugs, aude, jayvdb, 
Ricordisamoa, Masti, Alchimista, Mbch331, Rxy
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262198: Convert P1438 from string to external ID

2020-09-07 Thread Lea_Lacroix_WMDE
Lea_Lacroix_WMDE created this task.
Lea_Lacroix_WMDE added projects: Wikidata, Wikidata-Campsite.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  Per request from the community, 

 please convert P1438  from 
string to external ID.

TASK DETAIL
  https://phabricator.wikimedia.org/T262198

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lea_Lacroix_WMDE
Cc: Lydia_Pintscher, Lea_Lacroix_WMDE, Aklapper, Akuckartz, darthmon_wmde, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T260869: Wikidata sitelink save, shows error message twice.

2020-09-07 Thread Jakob_WMDE
Jakob_WMDE removed Jakob_WMDE as the assignee of this task.
Jakob_WMDE moved this task from Doing to To Do on the Wikidata-Campsite 
(Wikidata-Campsite-Iteration-∞) board.

TASK DETAIL
  https://phabricator.wikimedia.org/T260869

WORKBOARD
  https://phabricator.wikimedia.org/project/board/3539/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jakob_WMDE
Cc: Jakob_WMDE, Lucas_Werkmeister_WMDE, HakanIST, Aklapper, Akuckartz, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T260966: Deploy WikibaseManifest on Wikidata.org

2020-09-07 Thread Samantha_Alipio_WMDE
Samantha_Alipio_WMDE updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T260966

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Samantha_Alipio_WMDE
Cc: Aklapper, Tarrow, NavinRizwi, Akuckartz, darthmon_wmde, DannyS712, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Dinoguy1000, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262187: Wikidata entity dumps didn't start this week

2020-09-07 Thread Marostegui
Marostegui added a comment.


  Sorry for breaking it! I thought s8 would behave as any other sX section and 
if you leave a section with no members, MW would automatically pick any other 
host.
  Normally, when eqiad is the active DC, we try no to leave any section without 
any hosts, so we can control the load better among the rest of the replicas. As 
eqiad is now depooled, I thought it wasn't worth specifically placing another 
replica on that group, as MW would chose any other host and as they are all 
idle, there would be no issues.
  
  On IRC Ariel just explained that wikidata is a snowflake here and it is 
forced to only look for the dump group, so in that sense it doesn't behave like 
I would have expected (same as any other sX section).
  Sorry again!

TASK DETAIL
  https://phabricator.wikimedia.org/T262187

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Marostegui
Cc: Marostegui, RKemper, ArielGlenn, jannee_e, Akuckartz, darthmon_wmde, 
Nandana, Lahi, Gq86, GoranSMilovanovic, Lunewa, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, gnosygnu, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262187: Wikidata entity dumps didn't start this week

2020-09-07 Thread ArielGlenn
ArielGlenn created this task.
ArielGlenn added projects: Wikidata, Dumps-Generation.

TASK DESCRIPTION
  This change: P12492  left the dump 
db group empty, and so any attempts to run wikidata entity dumps failed. The 
host was added back in early on September 7. The dumps for this week should be 
restarted; you'll want to coordinate this with the deployment of 
https://gerrit.wikimedia.org/r/c/operations/puppet/+/622342 which should be 
deployed when no jobs are running.
  
  Wikidata entity dumps use the flag --dbgroupdefault; it would be a good idea 
for that flag to permit fallback to use of any host in the special case that 
the requested group is empty.

TASK DETAIL
  https://phabricator.wikimedia.org/T262187

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn
Cc: RKemper, ArielGlenn, jannee_e, Akuckartz, darthmon_wmde, Nandana, Lahi, 
Gq86, GoranSMilovanovic, Lunewa, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, gnosygnu, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262178: One week after SDC edits the data still shows up in WCQS queries

2020-09-07 Thread Zbyszko
Zbyszko added a comment.


  The process we have right now is that we use SDC dumps to reload the data 
each week. Dumps are made each Sunday, which means, that all the changes made 
between Aug 30th and Sep 6th will only show up in the dump released on  Sep 
6th. I pushed the update time from Tuesday to Monday, so that the change is 
visible faster, but it still dependent on the dump itself. Since the current 
process takes around 4h, we decided  not to do the reload more often. Reload 
should happen today, so after today the change should be visible.
  
  Please note that this is a limitation of the beta service - real time updates 
will be implemented at some point.

TASK DETAIL
  https://phabricator.wikimedia.org/T262178

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Zbyszko
Cc: Mahir256, Zbyszko, Aklapper, Jarekt, CBogen, Akuckartz, darthmon_wmde, 
Nandana, JKSTNK, Namenlos314, Lahi, PDrouin-WMF, Gq86, E1presidente, 
Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, 
Salgo60, Silverfish, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Susannaanas, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, matthiasmullie, 
aude, Tobias1984, Manybubbles, Ricordisamoa, Wesalius, Lydia_Pintscher, 
Fabrice_Florin, Raymond, Steinsplitter, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T262178: One week after SDC edits the data still shows up in WCQS queries

2020-09-07 Thread Zbyszko
Zbyszko added a comment.


  The process we have right now is that we use SDC dumps to reload the data 
each week. Dumps are made each Sunday, which means, that all the changes made 
between Aug 30th and Sep 6th will only show up in the dump released on  Sep 
6th. I pushed the update time from Tuesday to Monday, so that the change is 
visible faster, but it still dependent on the dump itself. Since the current 
process takes around 4h, we decided  not to do the reload more often. Reload 
should happen today, so after today the change should be visible.
  
  Please note that this is a limitation of the beta service - real time updates 
will be implemented at some point.

TASK DETAIL
  https://phabricator.wikimedia.org/T262178

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Zbyszko
Cc: Mahir256, Zbyszko, Aklapper, Jarekt, CBogen, Akuckartz, darthmon_wmde, 
Nandana, JKSTNK, Namenlos314, Lahi, PDrouin-WMF, Gq86, E1presidente, 
Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, 
Salgo60, Silverfish, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Susannaanas, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, matthiasmullie, 
aude, Tobias1984, Manybubbles, Ricordisamoa, Wesalius, Lydia_Pintscher, 
Fabrice_Florin, Raymond, Steinsplitter, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs