[Wikidata-bugs] [Maniphest] [Edited] T202282: Autogenerating Forms

2018-09-14 Thread KaMan
KaMan updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...- [[ https://www.wikidata.org/wiki/Module:Lexeme-pl | Module:Lexeme-pl ]]
- [[ https://www.wikidata.org/wiki/User:GZWDer/newentity.js | User:GZWDer/newentity.js ]]

**Example:**...TASK DETAILhttps://phabricator.wikimedia.org/T202282EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KaManCc: PeterBowman, KaMan, WMDE-leszek, Lydia_Pintscher, Lea_Lacroix_WMDE, Mringgaard, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T204397: Special:MergeLexemes not appears in Special:SpecialPages

2018-09-14 Thread Bugreporter
Bugreporter created this task.Bugreporter added projects: Wikidata, Lexicographical data.
TASK DESCRIPTIONTASK DETAILhttps://phabricator.wikimedia.org/T204397EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: BugreporterCc: Bugreporter, Mringgaard, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T202764: Wikidata produces a lot of failed requests for recentchanges API

2018-09-14 Thread Krinkle
Krinkle added a comment.
Earlier when I was investigating with Stas, performing the slow recentchanges api request with X-Wikimedia-Debug: log shows the following in Logstash:

[DEBUG] [DBConnection] Wikimedia\Rdbms\LoadBalancer::getReaderIndex: using server db2080 for group 'api'

Which indeed shows that it is using a dbhost from the "api" group instead of the "rc" group.

The actual query:

[DEBUG] [DBQuery]

SELECT rc_id,rc_timestamp, rc_namespace,rc_title,rc_cur_id, rc_type,rc_deleted, rc_this_oldid,rc_last_oldid  FROM `recentchanges`WHERE (rc_timestamp>='2018091411') AND rc_namespace IN ('0','120')  AND rc_type IN ('0','1','3','6')   ORDER BY rc_timestamp ASC,rc_id ASC LIMIT 101

runtime: 27.811768054962 seconds

I do note that while I can reproduce maybe 8 of 10 times with the codfw mwdebug hosts, I could not on the eqiad mwdebug hosts.

Stas found the same when executing it from the command-line, that it is slow from mwmaint2001.codfw but normal from mwmaint1001.eqiad.

I haven't looked further, but I would assume that either means that in eqiad it is correctly picking the "rc" group, or that in eqiad the query is fast on dbhosts from the "api" group.TASK DETAILhttps://phabricator.wikimedia.org/T202764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KrinkleCc: Reedy, gerritbot, Krinkle, Addshore, Yurik, jcrespo, Imarlier, Ladsgroup, Lydia_Pintscher, WMDE-leszek, Aklapper, Gehel, Smalyshev, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Marostegui, merbst, LawExplorer, Vali.matei, Lewizho99, Minhnv-2809, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, Luke081515, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, Krenair, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204136: Enable the {{SHORTDESC}} magic word on the Malayalam Wikipedia

2018-09-14 Thread Adithyak1997
Adithyak1997 added a comment.
What I need is, I would like to remove the sentence ഫലകം:SHORTDESC: from https://ml.wikipedia.org/wiki/%E0%B4%AB%E0%B4%B2%E0%B4%95%E0%B4%82:SHORTDESC this template.TASK DETAILhttps://phabricator.wikimedia.org/T204136EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Adithyak1997Cc: DannyH, Lydia_Pintscher, Niharika, Tgr, kaldari, Adithyak1997, Aklapper, Akhiljaxxn, aezell, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, JJMC89, B20180, Samwilson, Luke081515, Nakon, MusikAnimal, Fhocutt, Wikidata-bugs, Snowolf, Mooeypoo, aude, Ricordisamoa, -jem-, Shizhao, Mbch331, Rxy, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T202764: Wikidata produces a lot of failed requests for recentchanges API

2018-09-14 Thread Reedy
Reedy added a comment.

In T202764#4585276, @Smalyshev wrote:
I tried db2085:3318 and the result the same as other codfw host. So if that's what actual API is using, that could be the reason why it is so slow.


It should be the rc hosts it's using for those queriesTASK DETAILhttps://phabricator.wikimedia.org/T202764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Reedy, gerritbot, Krinkle, Addshore, Yurik, jcrespo, Imarlier, Ladsgroup, Lydia_Pintscher, WMDE-leszek, Aklapper, Gehel, Smalyshev, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Marostegui, merbst, LawExplorer, Vali.matei, Lewizho99, Minhnv-2809, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, Luke081515, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, Krenair, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T202764: Wikidata produces a lot of failed requests for recentchanges API

2018-09-14 Thread Smalyshev
Smalyshev added a comment.
I tried db2085:3318 and the result the same as other codfw host. So if that's what actual API is using, that could be the reason why it is so slow.TASK DETAILhttps://phabricator.wikimedia.org/T202764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Reedy, gerritbot, Krinkle, Addshore, Yurik, jcrespo, Imarlier, Ladsgroup, Lydia_Pintscher, WMDE-leszek, Aklapper, Gehel, Smalyshev, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Marostegui, merbst, LawExplorer, Vali.matei, Lewizho99, Minhnv-2809, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, Luke081515, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, Krenair, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T202764: Wikidata produces a lot of failed requests for recentchanges API

2018-09-14 Thread Smalyshev
Smalyshev added a comment.
@Reedy I am not sure which host, I just logged in to maintenance host for eqiad and codfw. Lookups show db2082.codfw.wmnet and db1092.eqiad.wmnet.TASK DETAILhttps://phabricator.wikimedia.org/T202764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Reedy, gerritbot, Krinkle, Addshore, Yurik, jcrespo, Imarlier, Ladsgroup, Lydia_Pintscher, WMDE-leszek, Aklapper, Gehel, Smalyshev, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Marostegui, merbst, LawExplorer, Vali.matei, Lewizho99, Minhnv-2809, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, Luke081515, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, Krenair, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unassigned] T202764: Wikidata produces a lot of failed requests for recentchanges API

2018-09-14 Thread Krinkle
Krinkle removed Krinkle as the assignee of this task.Krinkle edited projects, added Performance-Team (Radar); removed Performance-Team.
TASK DETAILhttps://phabricator.wikimedia.org/T202764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KrinkleCc: gerritbot, Krinkle, Addshore, Yurik, jcrespo, Imarlier, Ladsgroup, Lydia_Pintscher, WMDE-leszek, Aklapper, Gehel, Smalyshev, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Marostegui, merbst, LawExplorer, Vali.matei, Lewizho99, Minhnv-2809, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, Luke081515, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, Krenair, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T202764: Wikidata produces a lot of failed requests for recentchanges API

2018-09-14 Thread Smalyshev
Smalyshev added a project: DBA.Smalyshev added a comment.
Looks like codfw one does not use index. @jcrespo do you have any idea why that could happen?TASK DETAILhttps://phabricator.wikimedia.org/T202764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Krinkle, SmalyshevCc: gerritbot, Krinkle, Addshore, Yurik, jcrespo, Imarlier, Ladsgroup, Lydia_Pintscher, WMDE-leszek, Aklapper, Gehel, Smalyshev, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Marostegui, merbst, LawExplorer, Vali.matei, Lewizho99, Minhnv-2809, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, Luke081515, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, Krenair, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T202764: Wikidata produces a lot of failed requests for recentchanges API

2018-09-14 Thread Smalyshev
Smalyshev added a comment.
Explains:

codfw:

P7551 (An Untitled Masterwork)
eqiad:
P7552 (An Untitled Masterwork)TASK DETAILhttps://phabricator.wikimedia.org/T202764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Krinkle, SmalyshevCc: gerritbot, Krinkle, Addshore, Yurik, jcrespo, Imarlier, Ladsgroup, Lydia_Pintscher, WMDE-leszek, Aklapper, Gehel, Smalyshev, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Vali.matei, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T202764: Wikidata produces a lot of failed requests for recentchanges API

2018-09-14 Thread Smalyshev
Smalyshev added a comment.
This query:

SELECT  rc_id,rc_timestamp,rc_namespace,rc_title,rc_cur_id,rc_type,rc_deleted,rc_this_oldid,rc_last_oldid  FROM `recentchanges`WHERE (rc_timestamp>='2018091411') AND rc_namespace IN ('0','120')  AND rc_type IN ('0','1','3','6')   ORDER BY rc_timestamp ASC,rc_id ASC LIMIT 101  ;

on mwmaint1001 takes 0.00 sec, on mwmaint2001 takes 56.50 sec!TASK DETAILhttps://phabricator.wikimedia.org/T202764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Krinkle, SmalyshevCc: gerritbot, Krinkle, Addshore, Yurik, jcrespo, Imarlier, Ladsgroup, Lydia_Pintscher, WMDE-leszek, Aklapper, Gehel, Smalyshev, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Vali.matei, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T202764: Wikidata produces a lot of failed requests for recentchanges API

2018-09-14 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T202764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Krinkle, gerritbotCc: gerritbot, Krinkle, Addshore, Yurik, jcrespo, Imarlier, Ladsgroup, Lydia_Pintscher, WMDE-leszek, Aklapper, Gehel, Smalyshev, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Vali.matei, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T202764: Wikidata produces a lot of failed requests for recentchanges API

2018-09-14 Thread gerritbot
gerritbot added a comment.
Change 460613 had a related patch set uploaded (by Krinkle; owner: Krinkle):
[mediawiki/core@master] debug: Allow the DBQuery channel to be used

https://gerrit.wikimedia.org/r/460613TASK DETAILhttps://phabricator.wikimedia.org/T202764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Krinkle, gerritbotCc: gerritbot, Krinkle, Addshore, Yurik, jcrespo, Imarlier, Ladsgroup, Lydia_Pintscher, WMDE-leszek, Aklapper, Gehel, Smalyshev, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Vali.matei, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T192006: wdqs-frontend docker image should rebuild automatically when a new patch is pushed to master

2018-09-14 Thread thcipriani
thcipriani added a comment.

In T192006#4579891, @Addshore wrote:
@thcipriani just checking, but this would result in an image of whatever is currently on master right?


Depends on how it's setup. For Mathoid a container is built and pushed to docker-registry.wikimedia.org/wikimedia/mediawiki-services-mathoid that is tagged with a timestamp. This currently happens for every merge to master if the tests are passing and helm test passes.TASK DETAILhttps://phabricator.wikimedia.org/T192006EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, thciprianiCc: thcipriani, Addshore, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, Gstupp, LawExplorer, Abbe98, Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T202764: Wikidata produces a lot of failed requests for recentchanges API

2018-09-14 Thread Smalyshev
Smalyshev added a comment.
Doesn't seem to be WDQS related entirely - e.g. if I call 'https://www.wikidata.org/w/api.php?format=json=""> - i.e. try to load 100 items from start of the day today - it takes 29 seconds:

real	0m29.500s
user	0m0.023s
sys	0m0.011s

I don't think it's normal for this operation to take this long. Same with different timestamp: 'https://www.wikidata.org/w/api.php?format=json="">

takes 0.3s. No idea why.TASK DETAILhttps://phabricator.wikimedia.org/T202764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Krinkle, SmalyshevCc: Krinkle, Addshore, Yurik, jcrespo, Imarlier, Ladsgroup, Lydia_Pintscher, WMDE-leszek, Aklapper, Gehel, Smalyshev, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Vali.matei, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T204378: Github complains about security issues in Wikibase dependencies

2018-09-14 Thread Reedy
Reedy closed this task as a duplicate of T204119: Some versions of ffi and rubyzip reported as vulnerable.
TASK DETAILhttps://phabricator.wikimedia.org/T204378EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Aklapper, Smalyshev, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T204379: Rename "wikibaselexeme-api-error-*" message keys to "apierror-wikibaselexeme-*

2018-09-14 Thread Amire80
Amire80 created this task.Amire80 added projects: Lexicographical data, I18n.Restricted Application added a project: Wikidata.
TASK DESCRIPTIONIf I understand correctly, this is a follow up to T185761.

There are many message keys in WikibaseLexeme that begin with "wikibaselexeme-api-error-*". If these are apierror messages, they must begin with "apierror-wikibaselexeme-", according to https://www.mediawiki.org/wiki/API:Localisation .TASK DETAILhttps://phabricator.wikimedia.org/T204379EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Amire80Cc: Amire80, Mringgaard, Lahi, Gq86, GoranSMilovanovic, Jayprakash12345, QZanden, LawExplorer, Srdjan_m, MuhammadShuaib, LNDDYL, Psychoslave, Wikidata-bugs, aude, Gryllida, Shizhao, Darkdadaah, Arrbee, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204136: Enable the {{SHORTDESC}} magic word on the Malayalam Wikipedia

2018-09-14 Thread DannyH
DannyH added a comment.
@Adithyak1997, it's possible that there's a misunderstanding about what this template does. What are you hoping to do with this template?TASK DETAILhttps://phabricator.wikimedia.org/T204136EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DannyHCc: DannyH, Lydia_Pintscher, Niharika, Tgr, kaldari, Adithyak1997, Aklapper, Akhiljaxxn, aezell, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, JJMC89, B20180, Samwilson, Luke081515, Nakon, MusikAnimal, Fhocutt, Wikidata-bugs, Snowolf, Mooeypoo, aude, Ricordisamoa, -jem-, Shizhao, Mbch331, Rxy, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T204378: Github complains about security issues in Wikibase dependencies

2018-09-14 Thread Smalyshev
Smalyshev created this task.Smalyshev added a project: Wikidata.Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTIONI get these complaints for Wikibase:


ffi: upgrade to ~> 1.9.24
rubyzip: upgrade to ~> 1.2.2


Both from Gemfile.lock .TASK DETAILhttps://phabricator.wikimedia.org/T204378EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T203311: Add es-formal and hu-formal to excluded monolingual text codes

2018-09-14 Thread MarcoAurelio
MarcoAurelio added a comment.
Shall we wait till the wmf.22 train arrives to Wikidata to test if this worked before marking this task as resolved? Thanks.TASK DETAILhttps://phabricator.wikimedia.org/T203311EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarcoAurelioCc: gerritbot, MarcoAurelio, Aklapper, Nikki, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204136: Enable the {{SHORTDESC}} magic word on the Malayalam Wikipedia

2018-09-14 Thread Adithyak1997
Adithyak1997 added a comment.
@DannyH  and @Lydia_Pintscher . I would like to ask two questions to you both since you both have commented against the use of the magic word on malayalam wikipedia. My first question is: if English wikipedia can use a feature , then why can't it be used in other wikipedias? According to what I think, all the wikipedias are equal and needs to be developed equally. It is the duty of each and every wikipedian to make their wikipedia move forward and attain its objectives (or targets). In such a case, why do you block our wikipedia from enhancing to upper levels? My second question is: Malayalam wikipedia, as understood by me is that there are very less members i think a maximum of 2 or 3 who actually knows to edit and correct template errors(the same in the case of template creation also). There are thousands of templates required in malayalam wikipedia which, only through the help of english wikipedia can be created or worked correctly. In such a scenario, how do you think can our wikipedia become better without the help of these helpful features?TASK DETAILhttps://phabricator.wikimedia.org/T204136EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Adithyak1997Cc: DannyH, Lydia_Pintscher, Niharika, Tgr, kaldari, Adithyak1997, Aklapper, Akhiljaxxn, aezell, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, JJMC89, B20180, Samwilson, Luke081515, Nakon, MusikAnimal, Fhocutt, Wikidata-bugs, Snowolf, Mooeypoo, aude, Ricordisamoa, -jem-, Shizhao, Mbch331, Rxy, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204136: Enable the {{SHORTDESC}} magic word on the Malayalam Wikipedia

2018-09-14 Thread DannyH
DannyH added a comment.
We're not going to enable this magic word on any other wikis right now. People should update the short descriptions on Wikidata.TASK DETAILhttps://phabricator.wikimedia.org/T204136EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DannyHCc: DannyH, Lydia_Pintscher, Niharika, Tgr, kaldari, Adithyak1997, Aklapper, Akhiljaxxn, aezell, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, JJMC89, B20180, Samwilson, Luke081515, Nakon, MusikAnimal, Fhocutt, Wikidata-bugs, Snowolf, Mooeypoo, aude, Ricordisamoa, -jem-, Shizhao, Mbch331, Rxy, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204136: Enable the {{SHORTDESC}} magic word on the Malayalam Wikipedia

2018-09-14 Thread Lydia_Pintscher
Lydia_Pintscher added a comment.
I would like this magic word to not spread even more. It's bad enough on enwp for Wikidata already. Please!TASK DETAILhttps://phabricator.wikimedia.org/T204136EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Lydia_Pintscher, Niharika, Tgr, kaldari, Adithyak1997, Aklapper, Akhiljaxxn, aezell, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, JJMC89, B20180, Samwilson, Luke081515, Nakon, MusikAnimal, Fhocutt, Wikidata-bugs, Snowolf, Mooeypoo, aude, Ricordisamoa, -jem-, Shizhao, Mbch331, Rxy, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Subscribers] T204136: Enable the {{SHORTDESC}} magic word on the Malayalam Wikipedia

2018-09-14 Thread Niharika
Niharika added subscribers: kaldari, Tgr, Niharika.Niharika added a comment.
CC @Tgr @kaldariTASK DETAILhttps://phabricator.wikimedia.org/T204136EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NiharikaCc: Niharika, Tgr, kaldari, Adithyak1997, Aklapper, Akhiljaxxn, aezell, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, JJMC89, B20180, Samwilson, Luke081515, Nakon, MusikAnimal, Fhocutt, Wikidata-bugs, Snowolf, Mooeypoo, aude, Ricordisamoa, -jem-, Shizhao, Mbch331, Rxy, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Triaged] T202287: Implement new File page design using OOUI (multi-lingual captions only)

2018-09-14 Thread Ramsey-WMF
Ramsey-WMF triaged this task as "High" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T202287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Cparle, Ramsey-WMFCc: gerritbot, MarkTraceur, Aklapper, Ramsey-WMF, PDrouin-WMF, Cparle, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, E1presidente, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, V4switch, LawExplorer, Lewizho99, Maathavan, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Subscribers] T203496: Implement visual changes on CleanChanges for SDC

2018-09-14 Thread Ramsey-WMF
Ramsey-WMF added a subscriber: MarkTraceur.Ramsey-WMF added a comment.

In T203496#4583848, @Prtksxna wrote:
Hey @Ramsey-WMF! I have installed the CleanChanges extension on my local mediawiki. Could you point me to the steps to follow to see it in action?


I refer this to the expertise of @MarkTraceur :)TASK DETAILhttps://phabricator.wikimedia.org/T203496EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Prtksxna, Ramsey-WMFCc: MarkTraceur, Aklapper, Prtksxna, Nirzar, PDrouin-WMF, Ramsey-WMF, Lahi, E1presidente, Cparle, Anooprao, SandraF_WMF, Tramullas, Acer, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T203067: account creation captcha broken on structured-commons test system

2018-09-14 Thread Lydia_Pintscher
Lydia_Pintscher closed this task as "Resolved".Lydia_Pintscher moved this task from Test (Verification) to Done on the Wikidata-Campsite-Iteration-∞ board.
TASK DETAILhttps://phabricator.wikimedia.org/T203067WORKBOARDhttps://phabricator.wikimedia.org/project/board/3539/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, Lydia_PintscherCc: Addshore, Magnus, WMDE-leszek, Aklapper, Lydia_Pintscher, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Jonas, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204317: Don’t send SPARQL prefixes with WikibaseQualityConstraints queries

2018-09-14 Thread Smalyshev
Smalyshev added a comment.
A simple solution, I suppose, would be to completely skip prefixes for REGEX queries, which are (I believe) the most common queries we send out and never need any prefixes.

This looks like a good start.TASK DETAILhttps://phabricator.wikimedia.org/T204317EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Lahi, Gq86, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T204364: Rate limit wdqs logs

2018-09-14 Thread Gehel
Gehel created this task.Gehel added projects: Wikidata-Query-Service, Operations, Wikimedia-Logstash.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: Wikidata.
TASK DESCRIPTIONWe recently had cases of wdqs sending >10K logs per seconds to logstash. This overloads logstash and should be avoided.

We should probably rate limit by logger / message template.

logback does not seem to provide this kind of functionality out of the box (the closest to that is the DuplicateMessageFilter.TASK DETAILhttps://phabricator.wikimedia.org/T204364EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Smalyshev, fgiunchedi, Gehel, Aklapper, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T195828: Check constraints on Forms and Senses when loading Lexeme entity page

2018-09-14 Thread gerritbot
gerritbot added a comment.
Change 460557 had a related patch set uploaded (by Pablo Grass (WMDE); owner: Pablo Grass (WMDE)):
[mediawiki/extensions/WikibaseQualityConstraints@master] gadget: separate functionalities

https://gerrit.wikimedia.org/r/460557TASK DETAILhttps://phabricator.wikimedia.org/T195828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pablo-WMDE, gerritbotCc: gerritbot, Tarrow, Aklapper, Lucas_Werkmeister_WMDE, Mringgaard, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, merbst, LawExplorer, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Smalyshev
Smalyshev added a comment.
All bans are temporary, so as soon as traffic returns to normal the bans will expire. It would be nice if there was a way to wbqc to respect the 429 throttling header, which will avoid bans.TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Tpt, aborrero, Pintoch, Stashbot, Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Zylc, Davinaclare77, Qtn1293, 1978Gage2001, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Agabi10, Xmlizer, srodlund, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T196226: HTML 'id' values should be unique in Wikidata lexeme pages

2018-09-14 Thread gerritbot
gerritbot added a comment.
Change 460379 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Add html data attribute to statement groups for dom hydration

https://gerrit.wikimedia.org/r/460379TASK DETAILhttps://phabricator.wikimedia.org/T196226EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jakob_WMDE, gerritbotCc: gerritbot, Pablo-WMDE, Lydia_Pintscher, abian, Mringgaard, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T155368: Add monolingual language code hbo (Biblical Hebrew)

2018-09-14 Thread Amire80
Amire80 added a comment.
Um, I'm not sure whether I'm in a conflict of interest here or not...

I'm a member of Langcom, and I speak Hebrew, and I learned it academically. The hbo code is definitely not ambiguous. Biblical Hebrew is very well-defined: it's the Hebrew as contained in the Bible. By definition one cannot add anything to it—the book had been written more then two thousand years ago.

I am wondering however, how is this useful in Wikidata. hbo is useful when it's important to distinguish between modern and Biblical Hebrew, especially for technical reasons, because it's often useful to display them in different fonts (many common modern Hebrew fonts don't support Biblical diacritical marks well). What's useful in Wikidata, however, is to write names of Biblical characters, for example, but they are written identically in modern Hebrew. For example, the famous Biblical names Moses (משה), David (דוד), and Solomon (שלמה) are all spelled in a way that is unusual for modern Hebrew, but because they are so common, their Biblical spelling is retained by convention. No distinction should be necessary here. It is useful to write a separate variant of the name with vowel diacritics (niqud), but there is already the vocalized name for this purpose.

So I'm not sure why is this necessary, but I'll be happy to hear examples where a distinction between "he" and "hbo" is useful.TASK DETAILhttps://phabricator.wikimedia.org/T155368EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Amire80Cc: Amire80, gerritbot, Mbch331, PokestarFan, Esc3300, Lydia_Pintscher, GerardM, jhsoby, Aklapper, Bugreporter, Kieubinhtb, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, tabish.shaikh91, Adrian1985, Asad_Ali_Palijo, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Soteriaspace, RazeSoldier, Jayprakash12345, Th3d3v1ls, JakeTheDeveloper, Ramalepe, Liugev6, QZanden, Zoranzoki21, merbst, LawExplorer, Lewizho99, Maathavan, TerraCodes, D3r1ck01, MuhammadShuaib, SimmeD, Wikidata-bugs, aude, TheDJ___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Tpt
Tpt added a comment.
@Jonas Thank you for your feedback.

is it necessary for your tool to run the constraint checks in parallel?

No, I am going to switch to a sequential processing. Thanks for the idea!

Using WDQS instead would be a good idea, because then only your tool would get throttled.

It's what I already do to start filling my database. And I was using the recent changes to get the "most recent" violations i.e. the ones that the users are probably the most willing to fix and that have an higher probability to be vandalism. I just restarted the tool and I now only use WDQS and some calls to the QualityApi to get the conflict labels, but only at a 1/s rate.TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, TptCc: Tpt, aborrero, Pintoch, Stashbot, Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Zylc, Davinaclare77, Qtn1293, 1978Gage2001, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Agabi10, Xmlizer, srodlund, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T173214: Support GraphQL Queries across Wikimedia

2018-09-14 Thread gerritbot
gerritbot added a comment.
Change 460546 merged by Dbarratt:
[labs/tools/graphql@master] Add a language fallback system

https://gerrit.wikimedia.org/r/460546TASK DETAILhttps://phabricator.wikimedia.org/T173214EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Smalyshev, Lydia_Pintscher, Addshore, larsgw, Saerdnaer, simon04, bearND, Siznax, Tpt, Jonas, Ricordisamoa, hoo, Lucas_Werkmeister_WMDE, Aklapper, dbarratt, PokestarFan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, Tgr___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T173214: Support GraphQL Queries across Wikimedia

2018-09-14 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T173214EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Smalyshev, Lydia_Pintscher, Addshore, larsgw, Saerdnaer, simon04, bearND, Siznax, Tpt, Jonas, Ricordisamoa, hoo, Lucas_Werkmeister_WMDE, Aklapper, dbarratt, PokestarFan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, Tgr___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T173214: Support GraphQL Queries across Wikimedia

2018-09-14 Thread gerritbot
gerritbot added a comment.
Change 460546 had a related patch set uploaded (by Dbarratt; owner: Dbarratt):
[labs/tools/graphql@master] Add a language fallback system

https://gerrit.wikimedia.org/r/460546TASK DETAILhttps://phabricator.wikimedia.org/T173214EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Smalyshev, Lydia_Pintscher, Addshore, larsgw, Saerdnaer, simon04, bearND, Siznax, Tpt, Jonas, Ricordisamoa, hoo, Lucas_Werkmeister_WMDE, Aklapper, dbarratt, PokestarFan, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, Tgr___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T204264: Add displaying/editing statements to File page

2018-09-14 Thread Cparle
Cparle added a parent task: T181458: Prototype new File page functionality for Structured Data on Commons.
TASK DETAILhttps://phabricator.wikimedia.org/T204264EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: CparleCc: Aklapper, Cparle, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, V4switch, LawExplorer, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T181458: Prototype new File page functionality for Structured Data on Commons

2018-09-14 Thread Cparle
Cparle added a subtask: T204264: Add displaying/editing statements to File page.
TASK DETAILhttps://phabricator.wikimedia.org/T181458EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: CparleCc: MarkTraceur, PDrouin-WMF, Ramsey-WMF, Aklapper, Lahi, Gq86, E1presidente, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, V4switch, LawExplorer, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Jonas
Jonas added a comment.
@Tpt is it necessary for your tool to run the constraint checks in parallel?
Using WDQS instead would be a good idea, because then only your tool would get throttled.
The problem there is that just a fraction of all violations are in there at the moment.TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, JonasCc: Tpt, aborrero, Pintoch, Stashbot, Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Zylc, Davinaclare77, Qtn1293, 1978Gage2001, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Agabi10, Xmlizer, srodlund, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Tpt
Tpt added a comment.
Sorry everyone for the troubles. I was experimenting with a tool that tries to find corrections for constraint violations.
I have modified it to send a proper User-Agent for all its requests to the Wikidata API but not restarted it.

@Wikidata team: what would be an ok request rate to the constraints violation API? The alternative options for me from using the WikibaseQuality API does not look very compelling:



look directly for violations from WDQS but it's probably not much better in term of load for the query service and it won't use any cache implemented by WikibaseQuality.

use its own WDQS but it means to find an other hosting than tools labs.
TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, TptCc: Tpt, aborrero, Pintoch, Stashbot, Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Zylc, Davinaclare77, Qtn1293, 1978Gage2001, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Agabi10, Xmlizer, srodlund, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204233: Timeline in an embedded Wikidata Query Service does not render.

2018-09-14 Thread Fnielsen
Fnielsen added a comment.
If one switch to table view and back to timeline view with the left switcher then the timeline appears.TASK DETAILhttps://phabricator.wikimedia.org/T204233EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: FnielsenCc: Fnielsen, Aklapper, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Salgo60, Jonas, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T196226: HTML 'id' values should be unique in Wikidata lexeme pages

2018-09-14 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)).
TASK DETAILhttps://phabricator.wikimedia.org/T196226EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jakob_WMDE, ReleaseTaggerBotCc: gerritbot, Pablo-WMDE, Lydia_Pintscher, abian, Mringgaard, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T196226: HTML 'id' values should be unique in Wikidata lexeme pages

2018-09-14 Thread gerritbot
gerritbot added a comment.
Change 459806 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Add optional html id prefix to statement groups

https://gerrit.wikimedia.org/r/459806TASK DETAILhttps://phabricator.wikimedia.org/T196226EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jakob_WMDE, gerritbotCc: gerritbot, Pablo-WMDE, Lydia_Pintscher, abian, Mringgaard, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T195828: Check constraints on Forms and Senses when loading Lexeme entity page

2018-09-14 Thread gerritbot
gerritbot added a comment.
Change 460524 had a related patch set uploaded (by Pablo Grass (WMDE); owner: Pablo Grass (WMDE)):
[mediawiki/extensions/WikibaseQualityConstraints@master] gadget: encapsulate in a module

https://gerrit.wikimedia.org/r/460524TASK DETAILhttps://phabricator.wikimedia.org/T195828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pablo-WMDE, gerritbotCc: gerritbot, Tarrow, Aklapper, Lucas_Werkmeister_WMDE, Mringgaard, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, merbst, LawExplorer, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204233: Timeline in an embedded Wikidata Query Service does not render.

2018-09-14 Thread Fnielsen
Fnielsen added a comment.
The status code associated with embeddings where the timeline is missing is 200 (as far as I can determine). In the console I identify no relevant errors.TASK DETAILhttps://phabricator.wikimedia.org/T204233EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: FnielsenCc: Fnielsen, Aklapper, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Salgo60, Jonas, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T203496: Implement visual changes on CleanChanges for SDC

2018-09-14 Thread Prtksxna
Prtksxna added a comment.
Hey @Ramsey-WMF! I have installed the CleanChanges extension on my local mediawiki. Could you point me to the steps to follow to see it in action?TASK DETAILhttps://phabricator.wikimedia.org/T203496EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PrtksxnaCc: Aklapper, Prtksxna, Nirzar, PDrouin-WMF, Ramsey-WMF, Lahi, E1presidente, Cparle, Anooprao, SandraF_WMF, Tramullas, Acer, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Reassigned] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Addshore
Addshore reassigned this task from Addshore to Smalyshev.
TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, AddshoreCc: Tpt, aborrero, Pintoch, Stashbot, Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Zylc, Davinaclare77, Qtn1293, 1978Gage2001, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Agabi10, Xmlizer, srodlund, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Lowered Priority] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Addshore
Addshore lowered the priority of this task from "Unbreak Now!" to "High".Addshore added a comment.
The API request rate has returned to a normal level:

F25850152: image.png

As have the SPARQL error codes being hit by the WBQC extension.

The rate of wdqs queries being banned / throttled is also down:

F25850185: image.png

@Smalyshev do we have to manually unban localhost somewhere to get quality constraints sparql requests back or will that happen automatically?TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Tpt, aborrero, Pintoch, Stashbot, Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Zylc, Davinaclare77, Qtn1293, 1978Gage2001, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Agabi10, Xmlizer, srodlund, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Subscribers] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread aborrero
aborrero added a subscriber: Tpt.aborrero added a comment.
We stopped now the corhist tool which belongs to @Tpt, please check the tool. Now that the tool has been terminated, the traffic in wikidata seems back to normal.TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, aborreroCc: Tpt, aborrero, Pintoch, Stashbot, Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Zylc, Davinaclare77, Qtn1293, 1978Gage2001, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Agabi10, Xmlizer, srodlund, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-cloud) [2018-09-14T11:22:34Z]  T204267 stop the corhist tool (k8s) because is hammering the wikidata APITASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, StashbotCc: aborrero, Pintoch, Stashbot, Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Zylc, Davinaclare77, Qtn1293, 1978Gage2001, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Agabi10, Xmlizer, srodlund, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread aborrero
aborrero added a comment.

In T204267#4583629, @Pintoch wrote:
@aborrero thanks for the ping. I do not recognize the shape of the queries as coming from this tool though. The openrefine-wikidata tool should do relatively few SPARQL queries, whose results are cached in redis. How did you determine that this tool is the source of the problem?


Sorry for the noise, after stopping your tool we still see the same traffic. Feel free to restart your tool and again: sorry.

Problem is that we can't identify the tool by the server logs because there isn't any meaningful UA, so we are walking a bit blind. Your tool had the wikidata name in it, so that was the first candidate.TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, aborreroCc: aborrero, Pintoch, Stashbot, Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Zylc, Davinaclare77, Qtn1293, 1978Gage2001, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Agabi10, Xmlizer, srodlund, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Pintoch
Pintoch added a comment.
@aborrero thanks for the ping. I do not recognize the shape of the queries as coming from this tool though. The openrefine-wikidata tool should do relatively few SPARQL queries, whose results are cached in redis. How did you determine that this tool is the source of the problem?TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, PintochCc: aborrero, Pintoch, Stashbot, Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Zylc, Davinaclare77, Qtn1293, 1978Gage2001, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Agabi10, Xmlizer, srodlund, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Subscribers] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread aborrero
aborrero added subscribers: Pintoch, aborrero.aborrero added a comment.
Ping @Pintoch , this seems to be your tool.TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, aborreroCc: aborrero, Pintoch, Stashbot, Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Zylc, Davinaclare77, Qtn1293, 1978Gage2001, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Agabi10, Xmlizer, srodlund, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-cloud) [2018-09-14T10:51:35Z]  T204267 stop the openrefine-wikidata tool (k8s) because is hammering the wikidata APITASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, StashbotCc: Stashbot, Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Zylc, Davinaclare77, Qtn1293, 1978Gage2001, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Agabi10, Xmlizer, srodlund, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T204331: Wikibase does not accept "+g"-formatted strings as quantities

2018-09-14 Thread matej_suchanek
matej_suchanek created this task.matej_suchanek added projects: Pywikibot-core, Pywikibot-Wikidata, Wikidata.Restricted Application added subscribers: pywikibot-bugs-list, Aklapper.
TASK DESCRIPTIONimport pywikibot
repo = pywikibot.Site('wikidata', 'wikidata')
item = pywikibot.ItemPage(repo, 'Q209351')
claim = item.get()['claims']['P2370'][0]
print(claim.getTarget())
claim.getTarget().upperBound = claim.getTarget().lowerBound = None
item.editEntity(summary='remove explicit bounds')

Prints:

{
"amount": "+1e-28",
"lowerBound": "+1e-28",
"unit": "http://www.wikidata.org/entity/Q25343",
"upperBound": "+1e-28"
}

Result: WARNING: API error modification-failed: Data value corrupt: "+1e-28" is not a well formed decimal value

Per https://www.wikidata.org/wiki/Special:EntityData/Q209351.json, Pywikibot recieves values like "+0.0001" (strings) but these are handled using Decimal and then saved as "+1e-28" (format(value, "+g")). Either Wikibase should be updated to accept values in such a format or Pywikibot shouldn't submit them.TASK DETAILhttps://phabricator.wikimedia.org/T204331EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Aklapper, matej_suchanek, pywikibot-bugs-list, Lahi, Gq86, GoranSMilovanovic, QZanden, Tbscho, MayS, LawExplorer, Mdupont, JJMC89, Avicennasis, mys_721tx, Wikidata-bugs, aude, jayvdb, Ricordisamoa, Dalba, Masti, Alchimista, Mbch331, Rxy___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T204317: Don’t send SPARQL prefixes with WikibaseQualityConstraints queries

2018-09-14 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE created this task.Lucas_Werkmeister_WMDE added projects: Wikidata, Wikibase-Quality, Wikibase-Quality-Constraints.Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTIONAs @Smalyshev points out in T204267#4581546, we’re sending a bunch of prefixes with each SPARQL query, even though they are probably already defined by default. We should try to avoid this, to reduce traffic to WDQS.

One complication is that we need to filter out statements with deprecated rank, and the IRIs of the “rank” predicate and the “Deprecated” node are different, depending on whether the query service is serving “munged” data (wikiba.se/ontology#) or not (wikiba.se/ontology-beta#). We currently do this by defining both wikibase and wikibase-beta prefixes explicitly, and removing deprecated statements using both prefixes, but that doesn’t work if we rely on the query service’ built-in notion of the wikibase prefix (which is always the non-beta version, regardless of whether the data went through the munger or not).

A simple solution, I suppose, would be to completely skip prefixes for REGEX queries, which are (I believe) the most common queries we send out and never need any prefixes.TASK DETAILhttps://phabricator.wikimedia.org/T204317EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Lahi, Gq86, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Addshore
Addshore added a project: Cloud-Services.
TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Zylc, Davinaclare77, Qtn1293, 1978Gage2001, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Agabi10, Xmlizer, srodlund, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Addshore
Addshore added a comment.
Looks like it is tools-worker-1021.tools.eqiad.wmflabsTASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Agabi10, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T202265: Add 'tmp1' index that is in WMF production to the Wikibase install SQL files

2018-09-14 Thread Jonas
Jonas added a comment.
I added a comment to the create command.TASK DETAILhttps://phabricator.wikimedia.org/T202265EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Matthias_Geisler_WMDE, JonasCc: Jonas, Marostegui, Ladsgroup, Addshore, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T202265: Add 'tmp1' index that is in WMF production to the Wikibase install SQL files

2018-09-14 Thread Jonas
Jonas updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...CREATE INDEX `tmp1` ON wb_terms (`term_language`,`term_type`,`term_entity_type`,`term_search_key`) COMMENT 'term search index (in use)';...TASK DETAILhttps://phabricator.wikimedia.org/T202265EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Matthias_Geisler_WMDE, JonasCc: Marostegui, Ladsgroup, Addshore, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Addshore
Addshore added a project: Operations.Addshore added a comment.
Tagging operations as we want to block these requestsTASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Agabi10, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Addshore
Addshore added a comment.
Quick investigation shows that the increase in sparql requests is likely due to the 4x/5x increase in API requests (there was 10x increase at the peak of the spike).
Looking at the web requests most requests seem to be coming from a single UA / IP. so lets aim to block those requests.

{P7547}TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Agabi10, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Project Column] T178187: Support Javascript-based tools on Wikimedia Commons in the transition to structured data

2018-09-14 Thread Qgil
Qgil moved this task from Backlog to Jul-Sep-2018 on the CommRel-Specialists-Support board.Qgil edited projects, added CommRel-Specialists-Support (Jul-Sep-2018); removed CommRel-Specialists-Support.
TASK DETAILhttps://phabricator.wikimedia.org/T178187WORKBOARDhttps://phabricator.wikimedia.org/project/board/3451/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Keegan, QgilCc: 0x010C, Keegan, Elitre, zhuyifei1999, Jarekt, RP88, Qgil, Legoktm, Steinsplitter, SandraF_WMF, Aklapper, Mh-3110, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, GoranSMilovanovic, QZanden, enigmaeth, rohitt, Tramullas, Acer, LawExplorer, Dixtosa, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Dinoguy1000, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Claimed] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Addshore
Addshore claimed this task.Restricted Application added a project: User-Addshore.
TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Agabi10, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Jonas
Jonas added a comment.
Seems the #wikibase-quality-constraints extension is the source:

https://grafana.wikimedia.org/dashboard/db/wikidata-quality?refresh=10s=1=now-30d=now

https://github.com/wikimedia/mediawiki-extensions-WikibaseQualityConstraints/blob/c3687c1626323134e546ba924f3a838470c1f188/src/ConstraintCheck/Helper/SparqlHelper.php#L486

It seems SPARQL error codes increased drastically
F25847853: image.pngTASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JonasCc: Jonas, Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Agabi10, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T183487: MCR schema migration stage 3: drop support for legacy fields (wmf production)

2018-09-14 Thread daniel
daniel added a comment.
@awight It is, via T183490. https://wikifarm.wmflabs.org/mcr/index.php/Deployment_Pert_ChartTASK DETAILhttps://phabricator.wikimedia.org/T183487EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: awight, gerritbot, Tgr, Jdforrester-WMF, Anomie, Addshore, aude, Aklapper, daniel, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, JJMC89, Agabi10, Wikidata-bugs, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T204304: WikibaseQualityConstraints travis build status

2018-09-14 Thread Pablo-WMDE
Pablo-WMDE created this task.Pablo-WMDE added projects: Wikibase-Quality-Constraints, Wikidata.Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTIONApparently WikibaseQualityConstraints currently gets built on travis. Unfortunately it fails/errors on all builds.

Questions


What values does the travis build bring us that we do not get from Jenkins (answer might possibly be the PHP matrix testing)? Depending on the answer decision could be taken to phase it out.
which steps are required to make it green?
notification channels (slack, irc) are configured but apparently do not reach us. Should we change that to our (todo) incident email?
TASK DETAILhttps://phabricator.wikimedia.org/T204304WORKBOARDhttps://phabricator.wikimedia.org/project/board/1202/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pablo-WMDECc: Aklapper, Pablo-WMDE, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, LawExplorer, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T183487: MCR schema migration stage 3: drop support for legacy fields (wmf production)

2018-09-14 Thread awight
awight added a comment.
Should this be a subtask of T174045: DB schema migration for MCR?TASK DETAILhttps://phabricator.wikimedia.org/T183487EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: awightCc: awight, gerritbot, Tgr, Jdforrester-WMF, Anomie, Addshore, aude, Aklapper, daniel, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, JJMC89, Agabi10, Wikidata-bugs, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Smalyshev
Smalyshev updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONLooking at Kibana, I see a lot of banned requests marked with wbqc happening on the internal cluster. In the last 4 hours, it's 2,428,030 events (more than 300 per second!). Something is clearly not right there. Needs to be checked what is causing this. TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Agabi10, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T197658: Provide easy script to reset Blazegraph

2018-09-14 Thread Addshore
Addshore added a comment.

In T197658#4582768, @despens wrote:
So I guess the whole change history is not available in the Wikibase API after migrating the database from the previous install.


It is RecentChanges that you need to look at.
The age of the stuff in RC is configured by https://www.mediawiki.org/wiki/Manual:$wgRCMaxAge
Depending on the MW version it could be anywhere between 7 and 90 days. And of course this can be altered by your config.

Would it be correct then to export the full ttl dump, load it into Blazegraph, and then run the updater again?

If the changes are not in RecentChanges, then yes.TASK DETAILhttps://phabricator.wikimedia.org/T197658EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Tarrow, Smalyshev, tk, Aklapper, Addshore, despens, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Gstupp, merbst, LawExplorer, Avner, Gehel, Abbe98, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T200563: wdq1003 is anomalous

2018-09-14 Thread Smalyshev
Smalyshev added a comment.
So, weird thing: now that we switched data centers, wdqs2003 is showing the same anomaly. Could it be that our load balancing is not balancing the load evenly for these hosts?TASK DETAILhttps://phabricator.wikimedia.org/T200563EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Stashbot, Gehel, Aklapper, Smalyshev, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Smalyshev
Smalyshev added a project: Wikibase-Quality.Smalyshev added a subscriber: Addshore.
TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Addshore, TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Agabi10, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Triaged] T204267: Flood of WDQS requests from wbqc

2018-09-14 Thread Smalyshev
Smalyshev triaged this task as "Unbreak Now!" priority.Smalyshev added a comment.Restricted Application added subscribers: Liuxinyu970226, TerraCodes.
12,499,055 throttling events in last 24 hours. This is definitely not good.TASK DETAILhttps://phabricator.wikimedia.org/T204267EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: TerraCodes, Liuxinyu970226, Aklapper, Smalyshev, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Agabi10, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T203078: Create test system for WDQ UI

2018-09-14 Thread Matthias_Geisler_WMDE
Matthias_Geisler_WMDE updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[ X ] Figure out where to deploy it  [wdq-ui.wmflabs.org](http://wdq-ui.wmflabs.org/)
[ X ] Deploy and update cronTASK DETAILhttps://phabricator.wikimedia.org/T203078EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Matthias_Geisler_WMDECc: Smalyshev, Aklapper, Jonas, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Salgo60, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T197658: Provide easy script to reset Blazegraph

2018-09-14 Thread despens
despens added a comment.
Thank you @Smalyshev!

It seems like the --conceptUri switch is a part of munger. It is not accepted as a parameter for runUpdate.sh.

After checking this, I did also modify the Wikibase's LocalSettings.php to explicitely use http (without 's') for concept URLs:

$wgWBRepoSettings['conceptBaseUri'] = 'http://staging.catalog.rhizome.org/entity/';

The API delivers RDF with the http protocol used in all local name spaces, too: http://staging.catalog.rhizome.org/wiki/Special:EntityData/Q1996.ttl

Now, running the updater still only updates 26 edits:

bash-4.4# ./runUpdate.sh -- -w staging.catalog.rhizome.org -s 2001010100 --init
Updating via http://localhost:/bigdata/namespace/wdq/sparql
OpenJDK 64-Bit Server VM warning: Cannot open file /var/log/wdqs/wdqs-updater_jvm_gc.pid119.log due to No such file or directory

I> No access restrictor found, access to any MBean is allowed
Jolokia: Agent started with URL http://127.0.0.1:8778/jolokia/
#logback.classic pattern: %d{HH:mm:ss.SSS} [%thread] %-5level %logger{36} - %msg%n
05:57:09.390 [main] INFO  o.w.q.r.t.change.RecentChangesPoller - Got 26 changes, from Q2596@77721@20180130201206|81595 to Q4977@77814@20180215170648|81689
05:57:09.809 [main] INFO  org.wikidata.query.rdf.tool.Updater - Polled up to 2018-02-15T17:06:48Z (next: 20180215170711|81690) at (0.0, 0.0, 0.0) updates per second and (0.0, 0.0, 0.0) milliseconds per second
05:57:09.885 [main] INFO  o.w.q.r.t.change.RecentChangesPoller - Skipping change with bogus title:  Main Page
05:57:09.887 [main] INFO  o.w.q.r.t.change.RecentChangesPoller - Got 9 changes, from Q4977@77815@20180215170711|81690 to Q1166@77841@20180708070530|81717
05:57:09.976 [main] INFO  org.wikidata.query.rdf.tool.Updater - Polled up to 2018-07-08T07:05:30Z at (0.0, 0.0, 0.0) updates per second and (0.0, 0.0, 0.0) milliseconds per second
05:57:10.008 [main] INFO  o.w.q.r.t.change.RecentChangesPoller - Got no real changes
05:57:10.009 [main] INFO  org.wikidata.query.rdf.tool.Updater - Sleeping for 10 secs
05:57:20.036 [main] INFO  o.w.q.r.t.change.RecentChangesPoller - Got no real changes

So I guess the whole change history is not available in the Wikibase API after migrating the database from the previous install.

Would it be correct then to export the full ttl dump, load it into Blazegraph, and then run the updater again?TASK DETAILhttps://phabricator.wikimedia.org/T197658EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: despensCc: Tarrow, Smalyshev, tk, Aklapper, Addshore, despens, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Gstupp, merbst, LawExplorer, Avner, Gehel, Abbe98, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs