[Wikidata-bugs] [Maniphest] [Edited] T179991: Add a geo lookup service to WDQS based on the .map pages on Commons

2017-11-12 Thread Yurik 
Yurik updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...```lang=sparql
  ?wd wdt:P625 ?location .
  BIND(geof:lookup('World Countries Outline.map', ?location, 'iso') as ?iso)
```

```lang=sparql
SERVICE wikibase:geolookup {...TASK DETAILhttps://phabricator.wikimedia.org/T179991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: daniel, Smalyshev, Aklapper, Yurik, Lahi, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Reasno, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, Base, aude, Tobias1984, Manybubbles, jayvdb, zhuyifei1999, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T179106: Drop the "wb_terms.wb_terms_language" index

2017-11-12 Thread Marostegui 
Marostegui updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[] labsdb1001.eqiad.wmnet	3306 (not possible, read-only host: T179464)
[x] labsdb1003.eqiad.wmnet	3306
[x] labsdb1009.eqiad.wmnet	3306
[x] labsdb1010.eqiad.wmnet	3306
[x] labsdb1011.eqiad.wmnet	3306
[x] db1095.eqiad.wmnet	3306
[x] dbstore1001.eqiad.wmnet	3306
[x] dbstore1002.eqiad.wmnet	3306...[x] db1104.eqiad.wmnet	3306...TASK DETAILhttps://phabricator.wikimedia.org/T179106EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Lydia_Pintscher, Stashbot, Ladsgroup, daniel, Marostegui, Aklapper, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T174789: Install an instance of GLAMpipe on Toolforge

2017-11-12 Thread SandraF_WMF 
SandraF_WMF closed this task as "Resolved".SandraF_WMF added a comment.
Here it is!  http://glampipe.wmflabs.org/TASK DETAILhttps://phabricator.wikimedia.org/T174789EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Susannaanas, SandraF_WMFCc: Quiddity, Zache, Sadads, SandraF_WMF, Aklapper, Lahi, PDrouin-WMF, E1presidente, Ramsey-WMF, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, JeanFred, Steinsplitter, Mbch331, Keegan, Elitre, Qgil___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T179106: Drop the "wb_terms.wb_terms_language" index

2017-11-12 Thread Stashbot 
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-11-13T07:38:53Z]  Deploy alter table to db1104 - T179106TASK DETAILhttps://phabricator.wikimedia.org/T179106EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, StashbotCc: Lydia_Pintscher, Stashbot, Ladsgroup, daniel, Marostegui, Aklapper, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T178271: Allow Kirk and Martijn (JClarity) access to our WDQS production servers

2017-11-12 Thread MoritzMuehlenhoff 
MoritzMuehlenhoff added subscribers: RStallman-legalteam, MoritzMuehlenhoff.MoritzMuehlenhoff added a comment.
I'm adding @RStallman-legalteam for preparing the NDAs for Martijn and Kirk.TASK DETAILhttps://phabricator.wikimedia.org/T178271EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBjune, MoritzMuehlenhoffCc: MoritzMuehlenhoff, RStallman-legalteam, Karianna, debt, EBjune, Gehel, Aklapper, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, merbst, Avner, Zppix, Jdrewniak, Jonas, FloNight, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, mark, JanZerebecki, faidon, Mbch331, Rxy, Jay8g, Krenair, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T179106: Drop the "wb_terms.wb_terms_language" index

2017-11-12 Thread Stashbot 
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-11-13T07:33:35Z]  Optimize wb_terms table on db2052 - T179106TASK DETAILhttps://phabricator.wikimedia.org/T179106EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, StashbotCc: Lydia_Pintscher, Stashbot, Ladsgroup, daniel, Marostegui, Aklapper, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T179106: Drop the "wb_terms.wb_terms_language" index

2017-11-12 Thread Marostegui 
Marostegui added a comment.
The index has been dropped from all codfw.
I am optimizing a non-compressed slave to see if the gain is worth the time. As we have seen that probably for a compressed one is not.

root@neodymium:/home/marostegui/git/software/dbtools# cat s5.hosts | grep codfw | while read host port; do echo $host:$port; mysql --skip-ssl wikidatawiki -h$host -P$port -e "show create table wb_terms\G" | grep wb_terms_language; done
dbstore2001.codfw.wmnet:3315
db2089.codfw.wmnet:3315
db2086.codfw.wmnet:3315
db2085.codfw.wmnet:3315
db2084.codfw.wmnet:3315
db2083.codfw.wmnet:3306
db2082.codfw.wmnet:3306
db2081.codfw.wmnet:3306
db2080.codfw.wmnet:3306
db2079.codfw.wmnet:3306
db2075.codfw.wmnet:3306
db2038.codfw.wmnet:3306
db2045.codfw.wmnet:3306
db2052.codfw.wmnet:3306
db2059.codfw.wmnet:3306
db2066.codfw.wmnet:3306
db2023.codfw.wmnet:3306

This is the non-compressed status:

root@db2052:~# ls -lh /srv/sqldata/wikidatawiki/wb_terms.ibd
-rw-rw 1 mysql mysql 718G Nov 13 07:32 /srv/sqldata/wikidatawiki/wb_terms.ibdTASK DETAILhttps://phabricator.wikimedia.org/T179106EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Lydia_Pintscher, Stashbot, Ladsgroup, daniel, Marostegui, Aklapper, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T174168: Update the Frequently Asked Questions (FAQ) pages about Structured Data on Commons

2017-11-12 Thread SandraF_WMF 
SandraF_WMF closed subtask T179908: Clarify in FAQ how Structured Commons will work with categories on Wikimedia Commons as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T174168EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Abit, PokestarFan, Elitre, Aklapper, Ramsey-WMF, SandraF_WMF, Lahi, PDrouin-WMF, E1presidente, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Jay8g, Keegan, Qgil___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T179908: Clarify in FAQ how Structured Commons will work with categories on Wikimedia Commons

2017-11-12 Thread SandraF_WMF 
SandraF_WMF closed this task as "Resolved".SandraF_WMF added a comment.
FAQ is updated with a new question and answer! Improvements are of course very welcome. https://commons.wikimedia.org/wiki/Commons:Structured_data/About/FAQ#How_can_the_information_in_Commons_categories_be_used_for_structured_data_on_Commons.3FTASK DETAILhttps://phabricator.wikimedia.org/T179908EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Ramsey-WMF, Aklapper, Elitre, PokestarFan, Abit, SandraF_WMF, Lahi, PDrouin-WMF, E1presidente, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Jay8g, Keegan, Qgil___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T179106: Drop the "wb_terms.wb_terms_language" index

2017-11-12 Thread Marostegui 
Marostegui updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] db2086.codfw.wmnet	3315
[x] db2085.codfw.wmnet	3315
[x] db2084.codfw.wmnet	3315
[x] db2083.codfw.wmnet	3306
[x] db2082.codfw.wmnet	3306
[x] db2081.codfw.wmnet	3306
[x] db2080.codfw.wmnet	3306
[x] db2079.codfw.wmnet	3306
[x] db2075.codfw.wmnet	3306
[x] db2038.codfw.wmnet	3306
[x] db2045.codfw.wmnet	3306
[x] db2052.codfw.wmnet	3306
[x] db2059.codfw.wmnet	3306
[x] db2066.codfw.wmnet	3306
[x] db2023.codfw.wmnet	3306...TASK DETAILhttps://phabricator.wikimedia.org/T179106EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Lydia_Pintscher, Stashbot, Ladsgroup, daniel, Marostegui, Aklapper, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T179793: Consider dropping the "wb_items_per_site.wb_ips_site_page" index

2017-11-12 Thread Marostegui 
Marostegui closed this task as "Resolved".Marostegui added a comment.
This is all done:

root@neodymium:/home/marostegui/git/software/dbtools# cat s5.hosts | grep -v "labs" | while read host port; do echo $host:$port; mysql --skip-ssl wikidatawiki -h$host -P$port -e "show create table wb_items_per_site\G" | grep wb_ips_site_page; done
dbstore2001.codfw.wmnet:3315
db2089.codfw.wmnet:3315
db2086.codfw.wmnet:3315
db2085.codfw.wmnet:3315
db2084.codfw.wmnet:3315
db2083.codfw.wmnet:3306
db2082.codfw.wmnet:3306
db2081.codfw.wmnet:3306
db2080.codfw.wmnet:3306
db2079.codfw.wmnet:3306
db2075.codfw.wmnet:3306
db2038.codfw.wmnet:3306
db2045.codfw.wmnet:3306
db2052.codfw.wmnet:3306
db2059.codfw.wmnet:3306
db2066.codfw.wmnet:3306
db2023.codfw.wmnet:3306
db1095.eqiad.wmnet:3306
dbstore1001.eqiad.wmnet:3306
dbstore1002.eqiad.wmnet:3306
db1070.eqiad.wmnet:3306
db1071.eqiad.wmnet:3306
db1082.eqiad.wmnet:3306
db1087.eqiad.wmnet:3306
db1092.eqiad.wmnet:3306
db1096.eqiad.wmnet:3306
db1099.eqiad.wmnet:3306
db1100.eqiad.wmnet:3306
db1104.eqiad.wmnet:3306
db1106.eqiad.wmnet:3306
db1063.eqiad.wmnet:3306TASK DETAILhttps://phabricator.wikimedia.org/T179793EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Stashbot, Marostegui, Aklapper, Ladsgroup, Multichill, daniel, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T179793: Consider dropping the "wb_items_per_site.wb_ips_site_page" index

2017-11-12 Thread Marostegui 
Marostegui updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] db1096.eqiad.wmnet
[x] db1099.eqiad.wmnet
[x] db1100.eqiad.wmnet
[x] db1104.eqiad.wmnet
[x] db1106.eqiad.wmnet
[x] db1063.eqiad.wmnet...TASK DETAILhttps://phabricator.wikimedia.org/T179793EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Stashbot, Marostegui, Aklapper, Ladsgroup, Multichill, daniel, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T179793: Consider dropping the "wb_items_per_site.wb_ips_site_page" index

2017-11-12 Thread Marostegui 
Marostegui updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] db1087.eqiad.wmnet
[x] db1092.eqiad.wmnet...TASK DETAILhttps://phabricator.wikimedia.org/T179793EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Stashbot, Marostegui, Aklapper, Ladsgroup, Multichill, daniel, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T179793: Consider dropping the "wb_items_per_site.wb_ips_site_page" index

2017-11-12 Thread Marostegui 
Marostegui updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] db1070.eqiad.wmnet
[x] db1071.eqiad.wmnet
[x] db1082.eqiad.wmnet...TASK DETAILhttps://phabricator.wikimedia.org/T179793EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Stashbot, Marostegui, Aklapper, Ladsgroup, Multichill, daniel, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T179793: Consider dropping the "wb_items_per_site.wb_ips_site_page" index

2017-11-12 Thread Marostegui 
Marostegui updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[] labsdb1001.eqiad.wmnet (read only host: T179464)
[x] labsdb1003.eqiad.wmnet
[x] labsdb1009.eqiad.wmnet
[x] labsdb1010.eqiad.wmnet
[x] labsdb1011.eqiad.wmnet
[x] db1095.eqiad.wmnet...TASK DETAILhttps://phabricator.wikimedia.org/T179793EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Stashbot, Marostegui, Aklapper, Ladsgroup, Multichill, daniel, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T179793: Consider dropping the "wb_items_per_site.wb_ips_site_page" index

2017-11-12 Thread Marostegui 
Marostegui updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] dbstore1001.eqiad.wmnet
[x] dbstore1002.eqiad.wmnet...TASK DETAILhttps://phabricator.wikimedia.org/T179793EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Stashbot, Marostegui, Aklapper, Ladsgroup, Multichill, daniel, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T179793: Consider dropping the "wb_items_per_site.wb_ips_site_page" index

2017-11-12 Thread Marostegui 
Marostegui updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...Progress:

[] eqiadeqiad:
[] labsdb1001.eqiad.wmnet
[] labsdb1003.eqiad.wmnet
[] labsdb1009.eqiad.wmnet
[] labsdb1010.eqiad.wmnet
[] labsdb1011.eqiad.wmnet
[] db1095.eqiad.wmnet
[] dbstore1001.eqiad.wmnet
[] dbstore1002.eqiad.wmnet
[] db1070.eqiad.wmnet
[] db1071.eqiad.wmnet
[] db1082.eqiad.wmnet
[] db1087.eqiad.wmnet
[] db1092.eqiad.wmnet
[] db1096.eqiad.wmnet
[] db1099.eqiad.wmnet
[] db1100.eqiad.wmnet
[] db1104.eqiad.wmnet
[] db1106.eqiad.wmnet
[] db1063.eqiad.wmnet


[x] codfw
TASK DETAILhttps://phabricator.wikimedia.org/T179793EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Stashbot, Marostegui, Aklapper, Ladsgroup, Multichill, daniel, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T179793: Consider dropping the "wb_items_per_site.wb_ips_site_page" index

2017-11-12 Thread Marostegui 
Marostegui updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...If we want, we could make the implementations of `getLinks` throw if `$siteIds` is not set, but I'm not sure that's even needed here (as per the above comment).

Progress:

[] eqiad
[x] codfw
TASK DETAILhttps://phabricator.wikimedia.org/T179793EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Stashbot, Marostegui, Aklapper, Ladsgroup, Multichill, daniel, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T179793: Consider dropping the "wb_items_per_site.wb_ips_site_page" index

2017-11-12 Thread Marostegui 
Marostegui added a comment.
index dropped from codfw:

root@neodymium:/home/marostegui/git/software/dbtools# cat s5.hosts | grep codfw | while read host port; do echo $host:$port; mysql --skip-ssl wikidatawiki -h$host -P$port -e "show create table wb_items_per_site\G" | grep wb_ips_site_page; done
dbstore2001.codfw.wmnet:3315
db2089.codfw.wmnet:3315
db2086.codfw.wmnet:3315
db2085.codfw.wmnet:3315
db2084.codfw.wmnet:3315
db2083.codfw.wmnet:3306
db2082.codfw.wmnet:3306
db2081.codfw.wmnet:3306
db2080.codfw.wmnet:3306
db2079.codfw.wmnet:3306
db2075.codfw.wmnet:3306
db2038.codfw.wmnet:3306
db2045.codfw.wmnet:3306
db2052.codfw.wmnet:3306
db2059.codfw.wmnet:3306
db2066.codfw.wmnet:3306
db2023.codfw.wmnet:3306TASK DETAILhttps://phabricator.wikimedia.org/T179793EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Stashbot, Marostegui, Aklapper, Ladsgroup, Multichill, daniel, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T179793: Consider dropping the "wb_items_per_site.wb_ips_site_page" index

2017-11-12 Thread Stashbot 
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-11-13T06:44:49Z]  Deploy alter table directly on codfw s5 master (db2023), this will generate lag on codfw - T179793TASK DETAILhttps://phabricator.wikimedia.org/T179793EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, StashbotCc: Stashbot, Marostegui, Aklapper, Ladsgroup, Multichill, daniel, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T179106: Drop the "wb_terms.wb_terms_language" index

2017-11-12 Thread Marostegui 
Marostegui added a comment.

In T179106#3750305, @Marostegui wrote:
Going to test+optimize on db2089 which has wb_terms compressed.

-rw-rw 1 mysql mysql 529G Nov 10 10:25 /srv/sqldata.s5/wikidatawiki/wb_terms.ibd


Not a big win after the optimization on a compressed table:

-rw-rw 1 mysql mysql 496G Nov 13 06:37 /srv/sqldata.s5/wikidatawiki/wb_terms.ibdTASK DETAILhttps://phabricator.wikimedia.org/T179106EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Lydia_Pintscher, Stashbot, Ladsgroup, daniel, Marostegui, Aklapper, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T179106: Drop the "wb_terms.wb_terms_language" index

2017-11-12 Thread Stashbot 
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-11-13T06:18:21Z]  Deploy alter table db2086 - T179106TASK DETAILhttps://phabricator.wikimedia.org/T179106EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, StashbotCc: Lydia_Pintscher, Stashbot, Ladsgroup, daniel, Marostegui, Aklapper, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T179106: Drop the "wb_terms.wb_terms_language" index

2017-11-12 Thread Marostegui 
Marostegui updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] dbstore2001.codfw.wmnet	3315
[x] db2089.codfw.wmnet	3315...TASK DETAILhttps://phabricator.wikimedia.org/T179106EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: Lydia_Pintscher, Stashbot, Ladsgroup, daniel, Marostegui, Aklapper, hoo, Lahi, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T180314: WDQS geof:distance() throws an error on some P625 value

2017-11-12 Thread Yurik 
Yurik created this task.Yurik added a project: Wikidata-Query-Service.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery.
TASK DESCRIPTIONSELECT
  ?wd ?loc
WHERE {
  ?wd wdt:P625 ?loc .
  BIND(geof:distance("Point(0 0)"^^geo:wktLiteral, ?loc) as ?dist)
  FILTER(?dist < 0.01)
}

I would think that geof:distance should not throw an error on invalid value, but instead either return unbound, or a NaN, but instead the whole query crashes.

Also, this seems to indicate that some other validation is failing, and an invalid P625 makes it into the WDQS.

Unknown error: EastWest: -290.38000

java.util.concurrent.ExecutionException: java.util.concurrent.ExecutionException: org.openrdf.query.QueryEvaluationException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.Exception: task=ChunkTask{query=9c55ede5-1891-4fae-a40e-a992b04277f6,bopId=3,partitionId=-1,sinkId=6,altSinkId=null}, cause=java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: EastWest: -290.38000
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:206)
	at com.bigdata.rdf.sail.webapp.BigdataServlet.submitApiTask(BigdataServlet.java:293)
	at com.bigdata.rdf.sail.webapp.QueryServlet.doSparqlQuery(QueryServlet.java:654)
	at com.bigdata.rdf.sail.webapp.QueryServlet.doGet(QueryServlet.java:288)
	at com.bigdata.rdf.sail.webapp.RESTServlet.doGet(RESTServlet.java:240)
	at com.bigdata.rdf.sail.webapp.MultiTenancyServlet.doGet(MultiTenancyServlet.java:271)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:687)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:769)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1667)
	at org.wikidata.query.rdf.blazegraph.throttling.ThrottlingFilter.doFilter(ThrottlingFilter.java:288)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1650)
	at ch.qos.logback.classic.helpers.MDCInsertingServletFilter.doFilter(MDCInsertingServletFilter.java:49)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1650)
	at org.wikidata.query.rdf.blazegraph.filters.ClientIPFilter.doFilter(ClientIPFilter.java:43)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1650)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:583)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
	at org.eclipse.jetty.server.Server.handle(Server.java:497)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248)
	at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:610)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:539)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.ExecutionException: org.openrdf.query.QueryEvaluationException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.Exception: task=ChunkTask{query=9c55ede5-1891-4fae-a40e-a992b04277f6,bopId=3,partitionId=-1,sinkId=6,altSinkId=null}, cause=java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: EastWest: -290.38000
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at com.bigdata.rdf.sail.webapp.QueryServlet$SparqlQueryTask.call(QueryServlet.java:865)
	at com.bigdata.rdf.sail.webapp.QueryServlet$SparqlQueryTask.call(QueryServlet.java:671)
	at com.bigdata.rdf.task.ApiTaskForIndexManager.call(ApiTaskForIndexManager.java:68)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more

[Wikidata-bugs] [Maniphest] [Created] T180311: Deleting a page that's on a deletion list gives a warning that other pages link to it

2017-11-12 Thread ChristianKl 
ChristianKl created this task.ChristianKl added a project: Wikidata.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONI chose to delete Q43024662. When I click on the deletion action I get shown:
"Warning: Other pages link to or transclude the page you are about to delete."

When I click on the list it shows:
Wikidata:Requests for deletions ‎ (← links | edit)
Wikidata:Requests for deletions/All ‎ (← links | edit)
User:MisterSynergy/sysop/empty items ‎ (← links | edit)

Those three aren't reasons to warn me and a lot of deletion candidates show up on those links. The fact that the lists trigger the warning creates a lot of false alarms and thus it encourages admins to simply ignore the warning.

It would be good to have a list of websites that get ignored for the purposes of the deletion warning.TASK DETAILhttps://phabricator.wikimedia.org/T180311EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ChristianKlCc: Aklapper, ChristianKl, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T180304: Uses P629 (edition of) to improve language links between Wikisources

2017-11-12 Thread Peachey88 
Peachey88 updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...We should add a feature that uses `P629` (edition of) to find if two Wikisource pages shares the same work and so build interlanguage links between them.

A nice way to retrieve these links would be to do a SPARQL query or to use `P629` to get the work item and  	`P747` (edition) to get all the editionsTASK DETAILhttps://phabricator.wikimedia.org/T180304EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Peachey88Cc: Aklapper, Tpt, Lahi, GoranSMilovanovic, QZanden, Bodhisattwa, Samwilson, Yann, Wikidata-bugs, aude, jayvdb, Shizhao, Billinghurst, Mbch331, jayantanth, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T180303: Uses P629 (edition of) to add Wikipedia link in the other projects sidebar of Wikisource

2017-11-12 Thread Peachey88 
Peachey88 updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONWikisources pages are connected using sitelinks to the edition items of Wikidata and Wikipedia articles to the work items. The edition item is connected with `P629` to the work item. It would be nice to use this relation to fill automatically the other projects sidebar of WikisourceTASK DETAILhttps://phabricator.wikimedia.org/T180303EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Peachey88Cc: Aklapper, Tpt, Lahi, GoranSMilovanovic, QZanden, Bodhisattwa, Samwilson, Yann, Wikidata-bugs, aude, jayvdb, Shizhao, Billinghurst, Mbch331, jayantanth, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T180304: Uses P629 (edition of) to improve language links between Wikisources

2017-11-12 Thread Tpt 
Tpt added projects: Wikisource, Wikidata.
TASK DETAILhttps://phabricator.wikimedia.org/T180304EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: TptCc: Aklapper, Tpt, Lahi, GoranSMilovanovic, QZanden, Bodhisattwa, Samwilson, Yann, Wikidata-bugs, aude, jayvdb, Shizhao, Billinghurst, Mbch331, jayantanth, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T180303: Uses P629 (edition of) to add Wikipedia link in the other projects sidebar of Wikisource

2017-11-12 Thread Tpt 
Tpt updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...It could be implemented using the OtherProjectsSidebarHook inside of the "Wikisource" extension that is not yet deployed or inside of the WikimediaBadges extension (just like what is done for Commons categories).
TASK DETAILhttps://phabricator.wikimedia.org/T180303EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: TptCc: Aklapper, Tpt, Lahi, GoranSMilovanovic, QZanden, Bodhisattwa, Samwilson, Yann, Wikidata-bugs, aude, jayvdb, Shizhao, Billinghurst, Mbch331, jayantanth, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T180303: Uses P629 (edition of) to add Wikipedia link in the other projects sidebar of Wikisource

2017-11-12 Thread Tpt 
Tpt created this task.Tpt added projects: Wikidata, Wikisource.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONWikisources pages are connected using sitelinks to the edition items of Wikidata and Wikipedia articles to the work items. The edition item is connected with P629 to the work item. It would be nice to use this relation to fill automatically the other projects sidebar of Wikisource.

It could be implemented inside of the "Wikisource" extension that is not yet deployed or inside of the WikimediaBadges extension (just like what is done for Commons categories).TASK DETAILhttps://phabricator.wikimedia.org/T180303EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: TptCc: Aklapper, Tpt, Lahi, GoranSMilovanovic, QZanden, Bodhisattwa, Samwilson, Yann, Wikidata-bugs, aude, jayvdb, Shizhao, Billinghurst, Mbch331, jayantanth, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T137810: [Task] Add monolingual language code mn-Mong

2017-11-12 Thread Liuxinyu970226 
Liuxinyu970226 added a comment.
Not sure if this TWN thread is related or not: https://translatewiki.net/wiki/Thread:Support/Please_support_%22Traditional_Mongolian_Script%22, where I also made a comment that in favor of mvf and aganist mn-MongTASK DETAILhttps://phabricator.wikimedia.org/T137810EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Liuxinyu970226Cc: ChristianKl, C933103, jhsoby, thiemowmde, Liuxinyu970226, Lydia_Pintscher, GerardM, Aklapper, Zppix, Popolon, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T154589: evaluate creation of en-us for Wikidata monolingual strings

2017-11-12 Thread Psychoslave 
Psychoslave added a comment.
I replied to https://meta.wikimedia.org/wiki/2017_Community_Wishlist_Survey/Wikidata/Add_en-us_as_a_separate_language which is linking here as follow:

While I share the concern about the symptom, I'm not sure it's really a technical problem, but more an editorial one about accepted language granularity. That is, the problem surely go far beyond en-US, as I would expect that even within US you will find regional linguistic variations. Actually, even in small town you might find notable dialectal variations. So surely recognize en-US would be fine, but this wouldn't solve the underlying problem.

To give a more concrete example and take some distance with the American English concern which highly mix the linguistic granularity concern with the hegemony concern, I propose to look at the case of Alemannic. It gather a lot of problematic that arise that one face when trying to categorise discourse practices under the abstract notion of language.

First, the English Wikipedia article  presents it as a group of dialects of the Upper German branch of the Germanic language family. ISO 639-3 distinguishes four languages for this group: gsw (Swiss German), swg (Swabian German), wae (Walser German) and gct (Alemán Coloniero, spoken since 1843 in Venezuela).

Additionally, Alsatian dialect is clearly a part of this group.  Under the ISO 639-3 segmentation it is coded under gsw. There is a Alemannic version of Wikipedia, but  hosted under the als subdomain, which obviously come from Alsatian.

Finally, a dialect of Alsatian German is spoken in Amish communities of the United States and Canada.

I'm curious to know how the language committee deals with that kind of problem, and eager to read any documentation you might point me to regarding this topic, and processes used by the language committee.TASK DETAILhttps://phabricator.wikimedia.org/T154589EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lea_Lacroix_WMDE, PsychoslaveCc: Psychoslave, Liuxinyu970226, Mbch331, jhsoby, PokestarFan, Izno, Esc3300, GerardM, Lea_Lacroix_WMDE, Aklapper, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, aude___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Retitled] T101629: Merge.js should not check conflicts itself but rely on API

2017-11-12 Thread matej_suchanek 
matej_suchanek renamed this task from "Merge.js should ignore sitelink conflicts and rely on API" to "Merge.js should not check conflicts itself but rely on API".
TASK DETAILhttps://phabricator.wikimedia.org/T101629EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Mbch331, Ricordisamoa, Lydia_Pintscher, Sjoerddebruin, Ebraminio, matej_suchanek, Aklapper, Lahi, GoranSMilovanovic, QZanden, dachary, Wikidata-bugs, aude___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T101629: Merge.js should ignore sitelink conflicts and rely on API

2017-11-12 Thread matej_suchanek 
matej_suchanek added a subtask: T180296: API should report why the merge failed, just like Special:MergeItems does.
TASK DETAILhttps://phabricator.wikimedia.org/T101629EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Mbch331, Ricordisamoa, Lydia_Pintscher, Sjoerddebruin, Ebraminio, matej_suchanek, Aklapper, Lahi, GoranSMilovanovic, QZanden, dachary, Wikidata-bugs, aude___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T180296: API should report why the merge failed, just like Special:MergeItems does

2017-11-12 Thread matej_suchanek 
matej_suchanek added a parent task: T101629: Merge.js should ignore sitelink conflicts and rely on API.
TASK DETAILhttps://phabricator.wikimedia.org/T180296EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: matej_suchanek, Aklapper, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T180296: API should report why the merge failed, just like Special:MergeItems does

2017-11-12 Thread matej_suchanek 
matej_suchanek created this task.matej_suchanek added projects: Wikidata, MediaWiki-extensions-WikibaseRepository.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONCurrently, the API only reports Attempted modification of the item failed.

However, on Special:MergeItems you will see more detailed report like The two items cannot be merged because one of them links to the other using property P460.

This should help users figure out why they cannot merge two items using the gadget.TASK DETAILhttps://phabricator.wikimedia.org/T180296EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: matej_suchanek, Aklapper, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs