[Wikidata-bugs] [Maniphest] [Updated] T178515: Enable description usage tracking on further wikis

2017-10-18 Thread Marostegui
Marostegui added a comment.
That is fine by me - let's leave ruwiki aside for now while we finish purging up its recentchanges table (T12) on all the pending hosts.
Please keep giving us a heads up on the irc channel before you enable it on those new wikis.

Thanks!TASK DETAILhttps://phabricator.wikimedia.org/T178515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, MarosteguiCc: Liuxinyu970226, jcrespo, Marostegui, Cosine02, jeblad, Aklapper, hoo, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Fuzheado, Cwek, Wikidata-bugs, aude, zhuyifei1999, Shizhao, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)

2017-10-18 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-19T05:46:43Z]  Optimize recentchanges, pagelinks and templatelinks on db1102 for s6 - T174509 T12TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, StashbotCc: gerritbot, Stashbot, Jdforrester-WMF, Bawolff, Lydia_Pintscher, hoo, Ladsgroup, Base, Aklapper, TerraCodes, Jay8g, Marostegui, jcrespo, Lordiis, GoranSMilovanovic, Adik2382, Abiyoyo, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Jack_who_built_the_house, Lewizho99, Minhnv-2809, Maathavan, Iniquity, Luke081515, Wikidata-bugs, aude, putnik, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)

2017-10-18 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-19T05:45:12Z]  Optimize recentchanges, pagelinks and templatelinks on db1064 - T174509 T12TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, StashbotCc: gerritbot, Stashbot, Jdforrester-WMF, Bawolff, Lydia_Pintscher, hoo, Ladsgroup, Base, Aklapper, TerraCodes, Jay8g, Marostegui, jcrespo, Lordiis, GoranSMilovanovic, Adik2382, Abiyoyo, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Jack_who_built_the_house, Lewizho99, Minhnv-2809, Maathavan, Iniquity, Luke081515, Wikidata-bugs, aude, putnik, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178515: Enable description usage tracking on further wikis

2017-10-18 Thread Shizhao
Shizhao added a project: Chinese-Sites.
TASK DETAILhttps://phabricator.wikimedia.org/T178515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, ShizhaoCc: jcrespo, Marostegui, Cosine02, jeblad, Aklapper, hoo, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Fuzheado, Cwek, Wikidata-bugs, aude, zhuyifei1999, Shizhao, Mbch331, Liuxinyu970226, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T170281: Raise PHP version requirement of Wikibase (and its related extensions) to 5.6

2017-10-18 Thread Jdforrester-WMF
Jdforrester-WMF added a subtask: T178538: Bump PHP requirement to 5.6 in 1.31.
TASK DETAILhttps://phabricator.wikimedia.org/T170281EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jdforrester-WMFCc: Ricordisamoa, PokestarFan, thiemowmde, Reedy, Lucas_Werkmeister_WMDE, aude, hoo, ArielGlenn, daniel, Lydia_Pintscher, Jonas, Aleksey_WMDE, WMDE-leszek, Aklapper, GoranSMilovanovic, QZanden, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T138371: WordPress plugin to associate tags with Wikidata IDs

2017-10-18 Thread abian
abian added a comment.

In T138371#3689998, @Zeko wrote:
Quick but non trivial question here: I am considering using external libraries for some things, as I intend to release the plugin under a GPL, can somebody tell me what kind of problems can we have if I use libraries as bootstrap??


"MIT licensed software can be integrated into GPL software, but not the other way around". If you want to publish the plugin under a GPL, I think there will be no problem.

The MIT and the GPL are free software licenses and, therefore, compatible with the Wikimedia movement.TASK DETAILhttps://phabricator.wikimedia.org/T138371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Zeko, abianCc: Philipjohn21, Liuxinyu970226, Samwilson, Mbch331, Framawiki, DanBri, Esh77, Lydia_Pintscher, abian, Tramullas, Zeko, Aklapper, Pigsonthewing, Zppix, GoranSMilovanovic, QZanden, Psychoslave, Wikidata-bugs, aude___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178533: Find out why nginx log in logstash has no 429s

2017-10-18 Thread Smalyshev
Smalyshev created this task.Smalyshev added a project: Wikidata-Query-Service.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery.
TASK DESCRIPTIONLooking at nginx log in logstash, I notice that it does not have any entries with status 429, while other error statuses (500, 400, etc.) are present. This looks anomalous - 429 should be appearing in the logs too. We need to figure out why it happens and fix it if possible.TASK DETAILhttps://phabricator.wikimedia.org/T178533EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Gehel, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T176515: More flexible user experience for monitoring Wikidata changes from client, using new filters

2017-10-18 Thread jmatazzoni
jmatazzoni edited projects, added Collaboration-Team-Triage; removed Collaboration-Team-Triage (Collab-Team-Q2-Oct-Dec-2017).
TASK DETAILhttps://phabricator.wikimedia.org/T176515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jmatazzoniCc: Petar.petkovic, Liuxinyu970226, Tbayer, Zache, Noella94, hoo, Trizek-WMF, Lea_Lacroix_WMDE, Elitre, RP88, Catrope, SBisson, Mattflaschen-WMF, Aklapper, eranroz, GoranSMilovanovic, QZanden, Iniquity, jmatazzoni, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178530: Improve field mapping for nginx logstash

2017-10-18 Thread Smalyshev
Smalyshev added a project: User-Smalyshev.
TASK DETAILhttps://phabricator.wikimedia.org/T178530EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: dcausse, Gehel, EBernhardson, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, fgiunchedi, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T175948: Add normalized predicates to Blazegraph vocabulary

2017-10-18 Thread Smalyshev
Smalyshev added a comment.
In this case, if I understand correctly, we need something like:

Yes, that sounds correct.TASK DETAILhttps://phabricator.wikimedia.org/T175948EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Gehel, Aklapper, Smalyshev, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178530: Improve field mapping for nginx logstash

2017-10-18 Thread EBernhardson
EBernhardson added a project: Wikimedia-Logstash.
TASK DETAILhttps://phabricator.wikimedia.org/T178530EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: dcausse, Gehel, EBernhardson, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, fgiunchedi, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Claimed] T178211: Using Munge script in standalone WDQS: Fatal error munging RDF: RDFParseException: Illegal language tag char: ':'

2017-10-18 Thread Smalyshev
Smalyshev claimed this task.Smalyshev added a project: User-Smalyshev.
TASK DETAILhttps://phabricator.wikimedia.org/T178211EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Caliuser, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178530: Improve field mapping for nginx logstash

2017-10-18 Thread EBernhardson
EBernhardson added a comment.
There might be other opinions, but i think hard coding specific fields to specific types in the logstash config is reasonable as long as it's documented. The primary problem we run into is that without coordination different types can be sent to fields by different applications. While documenting and expecting applications to conform to types for all parameters is not going to happen, doing it for some limited set of useful fields seems acceptable to me.TASK DETAILhttps://phabricator.wikimedia.org/T178530EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: dcausse, Gehel, EBernhardson, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177734: License mismatch in wikidata-query-gui

2017-10-18 Thread Smalyshev
Smalyshev added a comment.
Hmm I think GUI should be Apache, as it does not rely directly on any GPL code AFAIK. And main docs in WDQS repo says so. I'm not sure why the code has GPL tags, maybe some confusion. My preference is to take it to Apache, but if it's for some reason is impossible, GPL I guess would work too.TASK DETAILhttps://phabricator.wikimedia.org/T177734EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Lucas_Werkmeister_WMDE, Aklapper, Yurik, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T178315: munge.sh error on latest-all.ttl.gz: "java.lang.RuntimeException: Error switching chunks"

2017-10-18 Thread Smalyshev
Smalyshev closed this task as "Resolved".Smalyshev claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T178315EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Gehel, gerritbot, Smalyshev, Framawiki, Donglixp, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178530: Improve field mapping for nginx logstash

2017-10-18 Thread Smalyshev
Smalyshev added a comment.
My checks show that request_time and upstream_time only used by nginx, but response_size is also used by webrequest. While it is used in the same meaning, I wonder if changing the type won't disrupt anything. response_size is less important for me than the rest, so if it proves a problem, we could omit it.TASK DETAILhttps://phabricator.wikimedia.org/T178530EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: dcausse, Gehel, EBernhardson, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178530: Improve field mapping for nginx logstash

2017-10-18 Thread Smalyshev
Smalyshev added a project: Wikidata-Query-Service.Smalyshev added subscribers: EBernhardson, Gehel, dcausse.Herald added projects: Wikidata, Discovery.
TASK DETAILhttps://phabricator.wikimedia.org/T178530EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: dcausse, Gehel, EBernhardson, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Subscribers] T178492: Create a more controlled WDQS cluster

2017-10-18 Thread Smalyshev
Smalyshev added a subscriber: mobrovac.Smalyshev added a comment.
I am not familiar with the details of dependent services (would be nice to document it somewhere? or point me to the place where it is already documented :) but in general unless you need an instant response, 429 should not be a cause for immediate failure. For offline functionality, 429 should cause retry within prescribed time. For online, it'd depend on the case, but if it's a secondary UI element, the script can just try and load it later, maybe?TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: mobrovac, Jonas, Aklapper, debt, Smalyshev, Gehel, Gq86, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Acer, merbst, Avner, FloNight, Xmlizer, Susannaanas, jkroll, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T151717: Usage tracking: record which statement group is used

2017-10-18 Thread hoo
hoo removed a project: Patch-For-Review.hoo added a comment.
We're already at 6,213,948 statement usages on cawiki (this is a lot).

The number of usages is still growing strong there, but it seems to be within sane bounds.TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Marostegui, Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178515: Enable description usage tracking on further wikis

2017-10-18 Thread hoo
hoo added subscribers: Marostegui, jcrespo.hoo added a project: DBA.
TASK DETAILhttps://phabricator.wikimedia.org/T178515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: jcrespo, Marostegui, Cosine02, jeblad, Aklapper, hoo, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")

2017-10-18 Thread hoo
hoo updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] Evaluate statistics from T177155data from T177155
[] Remove `'D'` from `$wgWBClientSettings['disabledUsageAspects']` on a few more wikis (T178515)
[] Remove `'D'` from `$wgWBClientSettings['disabledUsageAspects']` on commons (Which shouldthis might be the wiki where this has the biggest effect)...TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: thiemowmde, gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, GoranSMilovanovic, QZanden, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T178515: Enable description usage tracking on further wikis

2017-10-18 Thread hoo
hoo updated the task description. (Show Details)Herald added subscribers: jeblad, Cosine02.
CHANGES TO TASK DESCRIPTION...* `dewiki`
* `hewiki`
* `lvwiki`
* `mediawikiwiki`
* `metawiki`
* `nnwiki`
* `nowiki`
* `ruwikinews`
* ``* `zhwiki`

Also I suggest `ruwiki`: It has so many usages that there just have to be some description usages (you would think…).TASK DETAILhttps://phabricator.wikimedia.org/T178515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Cosine02, jeblad, Aklapper, hoo, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178515: Enable description usage tracking on further wikis

2017-10-18 Thread hoo
hoo created this task.hoo added projects: Wikidata, MediaWiki-extensions-WikibaseClient.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONI suggest to also enable description usage tracking on further wikis. Currently we don't have a single description usage, even though the usage type is active on several wikis.

After some mwgreping for wikis which potentially use descriptions, I identified the following wikis:


``
``
``
``
TASK DETAILhttps://phabricator.wikimedia.org/T178515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, hoo, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Block] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")

2017-10-18 Thread hoo
hoo created subtask T178515: Enable description usage tracking on further wikis.
TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: thiemowmde, gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, GoranSMilovanovic, QZanden, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Claimed] T177353: Metrics for SDoC: look at search hits based on which element the search is hitting

2017-10-18 Thread chelsyx
chelsyx claimed this task.chelsyx edited projects, added Discovery-Analysis (Current work); removed Discovery-Analysis.
TASK DETAILhttps://phabricator.wikimedia.org/T177353EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: chelsyxCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T151717: Usage tracking: record which statement group is used

2017-10-18 Thread hoo
hoo updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] https://gerrit.wikimedia.org/r/384592TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Marostegui, Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178491: Make WDQS throttling more aggressive

2017-10-18 Thread debt
debt added a parent task: Restricted Task.
TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, debtCc: gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Zppix, Maathavan, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg, mmodell___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Triaged] T178491: Make WDQS throttling more aggressive

2017-10-18 Thread debt
debt triaged this task as "High" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, debtCc: gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Zppix, Maathavan, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg, mmodell___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177022: Add an API module for querying MediaInfo entities by file page title

2017-10-18 Thread gerritbot
gerritbot added a comment.
Change 384996 had a related patch set uploaded (by MarkTraceur; owner: MarkTraceur):
[mediawiki/extensions/WikibaseMediaInfo@master] [WIP] Add lookup services for title <--> ID

https://gerrit.wikimedia.org/r/384996TASK DETAILhttps://phabricator.wikimedia.org/T177022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarkTraceur, gerritbotCc: Aleksey_WMDE, thiemowmde, Lydia_Pintscher, Addshore, gerritbot, Cparle, MBinder_WMF, Ramsey-WMF, Aklapper, MarkTraceur, E1presidente, Jmmuguerza, SandraF_WMF, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Acer, V4switch, Lewizho99, Maathavan, Susannaanas, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178492: Create a more controlled WDQS cluster

2017-10-18 Thread Jonas
Jonas added a comment.
My understanding is that the structured data on commons project will rely on WDQS for some of its functionalities. If we want that project to be stable, we need to address the WDQS stability issues.

In what form does it rely on it?
What I can say is that #wikibase-quality-constraints depends on WDQS and also on short response times.
Could we maybe create an official list?TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JonasCc: Jonas, Aklapper, debt, Smalyshev, Gehel, Gq86, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Acer, merbst, Avner, FloNight, Xmlizer, Susannaanas, jkroll, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178491: Make WDQS throttling more aggressive

2017-10-18 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, gerritbotCc: gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Zppix, Maathavan, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg, mmodell___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178491: Make WDQS throttling more aggressive

2017-10-18 Thread gerritbot
gerritbot added a comment.
Change 384986 had a related patch set uploaded (by Gehel; owner: Gehel):
[wikidata/query/rdf@master] Make throttling more aggressive

https://gerrit.wikimedia.org/r/384986TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, gerritbotCc: gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg, mmodell___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178492: Create a more controlled WDQS cluster

2017-10-18 Thread Gehel
Gehel created this task.Gehel added projects: Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint, Structured-Data-Commons.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery.
TASK DESCRIPTIONWDQS is by design a fragile service. We allow arbitrary users to run arbitrary SPARQL queries. This is similar to allow any user direct access to our production MySQL databases. This is fine as long as the expectations are managed. It is definitely wrong when services from which we expect stable response time and availability start depending on it.

Splitting WDQS in a public, do whatever you want service and a different more controlled service make sense. This would be similar to what we do with MySQL, splitting it between a production service and labs replicas, with different expectations.

My understanding is that the structured data on commons project will rely on WDQS for some of its functionalities. If we want that project to be stable, we need to address the WDQS stability issues.TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Aklapper, debt, Smalyshev, Gehel, Gq86, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Acer, merbst, Avner, Jonas, FloNight, Xmlizer, Susannaanas, jkroll, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178447: Make semantic choices for clarity between Commons items and Wikidata items ("labels" vs. "captions", etc.)

2017-10-18 Thread matthiasmullie
matthiasmullie removed a project: Easy.
TASK DETAILhttps://phabricator.wikimedia.org/T178447EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matthiasmullieCc: Aklapper, MBinder_WMF, Cparle, MarkTraceur, Ramsey-WMF, TerraCodes, E1presidente, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, V4switch, Susannaanas, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178491: Make WDQS throttling more aggressive

2017-10-18 Thread Gehel
Gehel created this task.Gehel added projects: Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint, Operations, Wikimedia-Incident.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery.
TASK DESCRIPTIONA recent incident on WDQS show that our throttling is not aggressive enough. The current throttling starts tracking users only once they make a request which takes more than 10 seconds to complete. This does not prevent a single user from generating enough short request to overload the system. We should reduce this threshold (or even remove it entirely), without changing the current limits.

For the record, the current limits are:


60 seconds of processing time per minute (peak at 120 seconds)
30 errors per minute (peak at 60)
TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Smalyshev, Gehel, Aklapper, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg, mmodell___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178445: flapping monitoring for recommendation_api on scb

2017-10-18 Thread Gehel
Gehel added a comment.
I'm not sure why we have a retry in the first place. An exponential back-off would be good, or to honor the "Retry-After" HTTP header sent by WDQS on 429 errors.TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Joe, Volans, mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178455: Disambiguation for Wikidata search from tags terms in wordpress

2017-10-18 Thread Zeko
Zeko added a comment.
F10293586: image.png

Created a setup page and added a list with a tag list (please ignore the tag names), in each one its possible to add a wiki id manually (won't be saved yet) or just press the "search" button that later on will call a _javascript_ function that will open a dialog with a list of results to select.TASK DETAILhttps://phabricator.wikimedia.org/T178455EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ZekoCc: Zppix, Pigsonthewing, Aklapper, Tramullas, abian, Lydia_Pintscher, Esh77, DanBri, Framawiki, Mbch331, Samwilson, Liuxinyu970226, Philipjohn21, Zeko, GoranSMilovanovic, QZanden, Psychoslave, Wikidata-bugs, aude___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


Re: [Wikidata] Turning Lists to Wikidata

2017-10-18 Thread Yuri Astrakhan
The idea with .tab is to treat it like a blob from wikibase perspective,
just like an image. There was some discussion on importing it into wdqs,
but that hasn't progressed much.

The headers use nonlocalizable ids, Latin chars only, digits, underscores.
But it supports titles--localized names for the ids.

Tab format is a subset of a well know standard, but I can't find a link to
the discussion with one of the standard writers. I think it was
http://specs.frictionlessdata.io/table-schema/

The biggest problem is the missing ui to edit it.
On Wed, Oct 18, 2017, 07:03 Antonin Delpeuch (lists) <
li...@antonin.delpeuch.eu> wrote:

> I like the idea of storing tables in Commons, but for now I am still
> using Wikidata to store the lists I upload, because:
>
> * tabular data is not integrated with WDQS as far as I know
> * the tabular data format is quite poor compared to things like
> https://www.w3.org/TR/tabular-metadata/
> * it is not clear to me how this new Wikibase datatype should be used by
> the community. Should we create tabular counterparts of many existing
> properties? Should we have one generic tabular property for use as a
> qualifier of a traditional property?
>
> I find the feature very promising, but for now it is still in its
> infancy. I don't see how I could use it for edits like this one:
>
> https://www.wikidata.org/w/index.php?title=Q37461404=578074181=578071885
>
> Antonin
>
> On 18/10/2017 11:50, Yuri Astrakhan wrote:
> >
> > when you say "wikidata is not well  suited for lists data", you refer
> > to wikibase or WDQS here?
> >
> >
> > Wikibase, per Daniel K.
> >
> >
> > the  data:Bea.gov/GDP by state.tab above is certainly a good
> > representation for efficient delivery (via json) and display of data.
> > but inefficient for further data sharing without URIs.
> >
> >
> > What do you mean by further sharing without uri?
> >
> > Btw, there is a wikidata property to link to the .map data pages. Not
> > sure about the .tab, but might also work
> >
> >
> > ___
> > Wikidata mailing list
> > Wikidata@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/wikidata
> >
>
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata-bugs] [Maniphest] [Raised Priority] T178187: Support Javascript-based tools on Wikimedia Commons in the transition to structured data

2017-10-18 Thread SandraF_WMF
SandraF_WMF raised the priority of this task from "Low" to "Normal".SandraF_WMF added a comment.
I'd say it's normal priority. Will probably not be solved in one quarter though.TASK DETAILhttps://phabricator.wikimedia.org/T178187EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Qgil, Legoktm, Steinsplitter, SandraF_WMF, Aklapper, E1presidente, Ramsey-WMF, Jmmuguerza, GoranSMilovanovic, Ivana_Isadora, QZanden, enigmaeth, rohitt, Acer, Jseddon, FloNight, Dixtosa, Trizek-WMF, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331, Keegan, Elitre___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


Re: [Wikidata] Turning Lists to Wikidata

2017-10-18 Thread Antonin Delpeuch (lists)
I like the idea of storing tables in Commons, but for now I am still
using Wikidata to store the lists I upload, because:

* tabular data is not integrated with WDQS as far as I know
* the tabular data format is quite poor compared to things like
https://www.w3.org/TR/tabular-metadata/
* it is not clear to me how this new Wikibase datatype should be used by
the community. Should we create tabular counterparts of many existing
properties? Should we have one generic tabular property for use as a
qualifier of a traditional property?

I find the feature very promising, but for now it is still in its
infancy. I don't see how I could use it for edits like this one:
https://www.wikidata.org/w/index.php?title=Q37461404=578074181=578071885

Antonin

On 18/10/2017 11:50, Yuri Astrakhan wrote:
> 
> when you say "wikidata is not well  suited for lists data", you refer
> to wikibase or WDQS here?
> 
> 
> Wikibase, per Daniel K.
> 
> 
> the  data:Bea.gov/GDP by state.tab above is certainly a good
> representation for efficient delivery (via json) and display of data.
> but inefficient for further data sharing without URIs.
> 
> 
> What do you mean by further sharing without uri? 
> 
> Btw, there is a wikidata property to link to the .map data pages. Not
> sure about the .tab, but might also work
> 
> 
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
> 


___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Turning Lists to Wikidata

2017-10-18 Thread Marco Neumann
On Wed, Oct 18, 2017 at 12:50 PM, Yuri Astrakhan
 wrote:
>
>> when you say "wikidata is not well  suited for lists data", you refer
>> to wikibase or WDQS here?
>
>
> Wikibase, per Daniel K.
>>
>>
>> the  data:Bea.gov/GDP by state.tab above is certainly a good
>> representation for efficient delivery (via json) and display of data.
>> but inefficient for further data sharing without URIs.
>
>
> What do you mean by further sharing without uri?

if the cell is identified by a string rather than a URI (as it is the
case in the example above) disambiguation is necessary and error
prone.

e.g. Berlin

wd:Q64
wd:Q4579913
wd:Q5932836

> Btw, there is a wikidata property to link to the .map data pages. Not sure
> about the .tab, but might also work
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>



-- 


---
Marco Neumann
KONA

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Turning Lists to Wikidata

2017-10-18 Thread Yuri Astrakhan
> when you say "wikidata is not well  suited for lists data", you refer
> to wikibase or WDQS here?
>

Wikibase, per Daniel K.

>
> the  data:Bea.gov/GDP by state.tab above is certainly a good
> representation for efficient delivery (via json) and display of data.
> but inefficient for further data sharing without URIs.
>

What do you mean by further sharing without uri?

Btw, there is a wikidata property to link to the .map data pages. Not sure
about the .tab, but might also work
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Turning Lists to Wikidata

2017-10-18 Thread Marco Neumann
when you say "wikidata is not well  suited for lists data", you refer
to wikibase or WDQS here?

the  data:Bea.gov/GDP by state.tab above is certainly a good
representation for efficient delivery (via json) and display of data.
but inefficient for further data sharing without URIs.

On Tue, Oct 17, 2017 at 9:08 PM, Yuri Astrakhan  wrote:
> There is a better alternative to storing lists -
> https://www.mediawiki.org/wiki/Help:Tabular_Data -- it allows you to store a
> CSV-like table of data on Commons, with localized columns, and access it
> from all other wikis from the  and Lua scripts.
>
> A good example of it -- "per state GDP" page  -- see graph in the upper
> right corner.
>
> Page: List_of_U.S._states_by_GDP
> Data: GDP_by_state.tab
>
> Wikidata is not very well  suited for lists data, but tabular data was
> designed for a relatively large (up to 2mb) lists.
>
> On Tue, Oct 17, 2017 at 12:46 PM, Marco Neumann 
> wrote:
>>
>> great I will be on site as well, so we will have a little more time to
>> discuss this in detail.
>>
>> On Tue, Oct 17, 2017 at 4:30 PM, Antonin Delpeuch (lists)
>>  wrote:
>> > Hi Marco,
>> >
>> > I agree that many of these lists and tables could be harvested (with
>> > some care, of course).
>> >
>> > However, I don't think that the information they contain should go to
>> > the Wikidata item they are associated with. This Wikidata item mostly
>> > exists to store inter-language links, but is poorly connected to the
>> > rest of the knowledge graph. This tax revenue and GDP information should
>> > go to the country items themselves.
>> >
>> > I am working on the problem of extraction of statements from lists and
>> > tables and will write a tutorial when the tools are ready. WikidataCon
>> > attendees might have a glimpse of that in this session:
>> >
>> > https://www.wikidata.org/wiki/Wikidata:WikidataCon_2017/Submissions/OpenRefine_demo
>> >
>> > Cheers,
>> > Antonin
>> >
>> > On 17/10/2017 12:07, Marco Neumann wrote:
>> >> I have noticed a lack of actual data in wikidata representations of
>> >> wikipedia list.
>> >>
>> >> for example
>> >>
>> >> List of countries by tax revenue to GDP ratio
>> >>
>> >> https://en.wikipedia.org/wiki/List_of_countries_by_tax_revenue_to_GDP_ratio
>> >>
>> >> to
>> >>
>> >> List of countries by tax revenue as percentage of GDP (Q2529105)
>> >> https://www.wikidata.org/wiki/Q2529105
>> >>
>> >>
>> >> is there currently a development in the wikidata community to
>> >> transform these lists into wikibase items and last but not least
>> >> produce RDF respresentations for WDQS?
>> >>
>> >> best,
>> >> Marco
>> >>
>> >
>> >
>> > ___
>> > Wikidata mailing list
>> > Wikidata@lists.wikimedia.org
>> > https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
>>
>>
>> --
>>
>>
>> ---
>> Marco Neumann
>> KONA
>>
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>



-- 


---
Marco Neumann
KONA

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata-bugs] [Maniphest] [Created] T178476: Integrate code review patch sets

2017-10-18 Thread Hjfocs
Hjfocs created this task.Hjfocs added projects: Wikidata-primary-sources, Wikidata.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONTASK DETAILhttps://phabricator.wikimedia.org/T178476EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HjfocsCc: Aklapper, Hjfocs, GoranSMilovanovic, Kiailandi, QZanden, dachary, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Tpt, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T173747: Migrate the back end code to a separate repository

2017-10-18 Thread Hjfocs
Hjfocs closed this task as "Resolved".Hjfocs moved this task from Doing to Done on the Wikidata-primary-sources board.Hjfocs added a comment.

Standalone module based on WDQS release 0.2.5: https://github.com/marfox/pst-backend ;
WDQS fork that integrates the above repo as a submodule: https://github.com/marfox/wikidata-query-rdf/tree/release4pst ;
original primary sources tool repo now uses the WDQS fork as a submodule: https://github.com/Wikidata/primarysources/tree/towards-v2 .
TASK DETAILhttps://phabricator.wikimedia.org/T173747WORKBOARDhttps://phabricator.wikimedia.org/project/board/2788/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HjfocsCc: Hjfocs, Aklapper, Smalyshev, GoranSMilovanovic, Kiailandi, QZanden, dachary, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Tpt, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Subscribers] T178445: flapping monitoring for recommendation_api on scb

2017-10-18 Thread mobrovac
mobrovac added subscribers: Volans, Joe.mobrovac added a comment.
The amount of requests from the Recommendation API service actually makes sense. On each service checker script run, 3 requests are sent to WDQS from the service. Accounting for the number of hosts and frequency of the checks, we get to 0.5 requests per second. However, because the checker script does not receive the expected status, it retries multiple times, which brings us to the observed rate of approximately 1.5 reqs/s. @Joe, @Volans should perhaps some back-off policy be implemented in the checker script, especially when it receives 429s?TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Joe, Volans, mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Triaged] T178144: Clarify licensing status of data on Structured Commons

2017-10-18 Thread Qgil
Qgil triaged this task as "Normal" priority.Qgil added a comment.
(Assuming Normal priority, please correct if this is wrong.)TASK DETAILhttps://phabricator.wikimedia.org/T178144EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Slaporte, QgilCc: Qgil, Ricordisamoa, Lydia_Pintscher, Abit, Slaporte, SandraF_WMF, Aklapper, E1presidente, Ramsey-WMF, Jmmuguerza, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, ZhouZ, Mpaulson, Wikidata-bugs, PKM, Base, matthiasmullie, aude, jayvdb, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Jay8g, Keegan, Elitre___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used

2017-10-18 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-18T08:41:48Z]  Synchronized wmf-config/InitialiseSettings.php: Re-enable Statement usage tracking on cawiki (T151717) (duration: 00m 50s)TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, StashbotCc: Marostegui, Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used

2017-10-18 Thread gerritbot
gerritbot added a comment.
Change 384592 merged by jenkins-bot:
[operations/mediawiki-config@master] Re-enable Statement usage tracking on cawiki

https://gerrit.wikimedia.org/r/384592TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: Marostegui, Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T177155: Find test wiki(s) for new description usage and enable there

2017-10-18 Thread hoo
hoo closed this task as "Resolved".hoo removed a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T177155EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Stashbot, gerritbot, Marostegui, Aklapper, jcrespo, revi, hoo, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")

2017-10-18 Thread hoo
hoo closed subtask T177155: Find test wiki(s) for new description usage and enable there as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: thiemowmde, gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, GoranSMilovanovic, QZanden, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")

2017-10-18 Thread hoo
hoo updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] Remove `'D'` from `$wgWBClientSettings['disabledUsageAspects']` test-wise on a few wikis (all small wikis, `elwiki`, …) (T177155)
[] Evaluate statistics from T177155
[] Remove `'D'` from `$wgWBClientSettings['disabledUsageAspects']` on commons (Which should be the wiki where this has the biggest effect)...TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: thiemowmde, gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, GoranSMilovanovic, QZanden, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178445: flapping monitoring for recommendation_api on scb

2017-10-18 Thread Gehel
Gehel added a comment.
Looking at logs in logstash, it seems we throttled Recommendation API only when WDQS was overwhelmed by another user. Throttling is done on overall request time and the service was most probably already not responding correctly, or in a reasonable time.

My understanding at this point is that the flapping and alerting was reasonable. WDQS was returning 429 (throttling), but without throttling, it would probably have timed out.

Forwarding x-client-ip might still make sense. Or sending a user-agent combining the current UA and the end user UA.TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, Volans, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177155: Find test wiki(s) for new description usage and enable there

2017-10-18 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-18T08:09:34Z]  Synchronized wmf-config/InitialiseSettings.php: Enable description usage tracking on a few test wikis (T177155) (duration: 00m 50s)TASK DETAILhttps://phabricator.wikimedia.org/T177155EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, StashbotCc: Stashbot, gerritbot, Marostegui, Aklapper, jcrespo, revi, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177155: Find test wiki(s) for new description usage and enable there

2017-10-18 Thread gerritbot
gerritbot added a comment.
Change 384003 merged by jenkins-bot:
[operations/mediawiki-config@master] Enable description usage tracking on a few test wikis

https://gerrit.wikimedia.org/r/384003TASK DETAILhttps://phabricator.wikimedia.org/T177155EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, Marostegui, Aklapper, jcrespo, revi, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178455: Disambiguation for Wikidata search from tags terms in wordpress

2017-10-18 Thread Zeko
Zeko created this task.Zeko added projects: Wikimania-Hackathon-2016, Wikidata.
TASK DESCRIPTION
To add a list of the tags of the blog in the plugin setup page
Add a form to each tag in that setup page in which the user can add manually a wikidata ID
Develop a _javascript_ function to automatically search for the tag term in wikidata and return a list of wikidata items (and their related wikidata ID) to let the user choose the most accurate to the tag he is using.
Save all in Wordpress setup


Working on this right now =)

https://github.com/zeko3991/Wikidata-referencesTASK DETAILhttps://phabricator.wikimedia.org/T178455EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ZekoCc: Zppix, Pigsonthewing, Aklapper, Tramullas, abian, Lydia_Pintscher, Esh77, DanBri, Framawiki, Mbch331, Samwilson, Liuxinyu970226, Philipjohn21, Zeko, GoranSMilovanovic, QZanden, Psychoslave, Wikidata-bugs, aude___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Block] T138371: WordPress plugin to associate tags with Wikidata IDs

2017-10-18 Thread Zeko
Zeko created subtask T178455: Disambiguation for Wikidata search from tags terms in wordpress.
TASK DETAILhttps://phabricator.wikimedia.org/T138371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ZekoCc: Philipjohn21, Liuxinyu970226, Samwilson, Mbch331, Framawiki, DanBri, Esh77, Lydia_Pintscher, abian, Tramullas, Zeko, Aklapper, Pigsonthewing, Zppix, GoranSMilovanovic, QZanden, Psychoslave, Wikidata-bugs, aude___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178445: flapping monitoring for recommendation_api on scb

2017-10-18 Thread mobrovac
mobrovac added a comment.

In T178445#3692895, @Smalyshev wrote:
@mobrovac what's the rate the requests are currently sent at? IIRC the limits we have are pretty generous, but depends on the use case of course.


This is the part that I don't understand - the rate of the public end point is 0, which means that the Recommendation API service contacts WDQS on;y 4 times every 60 seconds due to the automatic monitoring script sending health-check requests to it, which doesn't seem like something that should trigger rate limiting.


In T178445#3692899, @Gehel wrote:
We could add an exception for specific user agent. Or have Recommendation API propagate some way to bucket by end user. This needs a little bit of thinking.


The latter would be ideal. We could forward the client's IP via the x-client-ip header.TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, Volans, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Claimed] T138371: WordPress plugin to associate tags with Wikidata IDs

2017-10-18 Thread Zeko
Zeko claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T138371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ZekoCc: Philipjohn21, Liuxinyu970226, Samwilson, Mbch331, Framawiki, DanBri, Esh77, Lydia_Pintscher, abian, Tramullas, Zeko, Aklapper, Pigsonthewing, Zppix, GoranSMilovanovic, QZanden, Psychoslave, Wikidata-bugs, aude___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T138371: WordPress plugin to associate tags with Wikidata IDs

2017-10-18 Thread Zeko
Zeko added a comment.
Include a field on the term edit screen (e.g. Posts > Tags > [Tag] > Edit). There is a term meta API for this in WordPress (see add_term_meta())

This is really nice to know and will save a lot of work =)

My feeling is that many site owners would find that to be undesirable - taking people away from their site to a page that might not necessarily add more to their experience. The average user is unlikely to care much for that wikidata page :)

That is something that worried me off, that could be a little intrussive

I'm not sure we can avoid the manual effort that requires of the user without interrupting the save post flow, which could be frustrating.

But what if the user has already set the associations? He can just focus on his post and forget them, that is the point of the setup page, however we could add some kind of setup during the edition of posts for new tags. Anyway I don't know how frequent is to add new tags ior how many of them can be added in a row.

The code up to this time is at https://github.com/zeko3991/Wikidata-references that is NOT the official repository.  Later on I will upload to an official repository of the University of Zaragoza.

Don't freak out if you see strange things in the code, I'm quite new at wordpress developing and still have to try trivial things to see how it works =) everything will be clean at the end.

Also I'd want to insist about the license topic I asked before.

Thank you!TASK DETAILhttps://phabricator.wikimedia.org/T138371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ZekoCc: Philipjohn21, Liuxinyu970226, Samwilson, Mbch331, Framawiki, DanBri, Esh77, Lydia_Pintscher, abian, Tramullas, Zeko, Aklapper, Pigsonthewing, Zppix, GoranSMilovanovic, QZanden, Psychoslave, Wikidata-bugs, aude___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178445: flapping monitoring for recommendation_api on scb

2017-10-18 Thread Gehel
Gehel added a comment.
@mobrovac it is possible if we can identify internal traffic. The throttling we apply is bucketed by user agent / IP, so I suspect that all the recommendation API traffic end up in the same bucket.

We could add an exception for specific user agent. Or have Recommendation API propagate some way to bucket by end user. This needs a little bit of thinking.TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, Volans, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178445: flapping monitoring for recommendation_api on scb

2017-10-18 Thread Smalyshev
Smalyshev added a comment.
@mborovac what's the rate the requests are currently sent at? IIRC the limits we have are pretty generous, but depends on the use case of course.TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, Volans, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178445: flapping monitoring for recommendation_api on scb

2017-10-18 Thread mobrovac
mobrovac added subscribers: Gehel, Smalyshev, mobrovac.mobrovac edited projects, added Services (watching), Recommendation-API, Wikidata-Query-Service; removed Services.mobrovac added a comment.Herald added projects: Wikidata, Discovery.
The 429 coming from WDQS. @Gehel, @Smalyshev would it be possible to split WDQS' rate limiting for internal and external requests?TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, Volans, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T172914: mw.wikibase.entity: Use __index to lazy register entity usages

2017-10-18 Thread hoo
hoo updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONWe should only track an all usage for an entity table loaded via [[ https://www.mediawiki.org/wiki/Extension:Wikibase_Client/Lua#mw.wikibase.getEntity | `mw.wikibase.getEntity` ]], if the data on it is actually used. This can (later on?) be expanded, along with T151717, to track the most specific usages only.

Note: This is very similar to {T76156} and might be doable in one patch, but has a different purposeSteps to get this enabled in production:
[x] Merge {T178153}
[] Deploy T178153 (27cb7f6e1615db26460d035bc8ee372f1ec15f8e)
[] Change the `disabledUsageAspects` setting
[] Enable this in the settings for all statement usage test wikis
[] Deploy this
[] Gradually enable this on all wikis

Note: This is similar to {T76156}.TASK DETAILhttps://phabricator.wikimedia.org/T172914EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: eranroz, hooCc: Bawolff, thiemowmde, gerritbot, Halfak, Aklapper, daniel, Lydia_Pintscher, aude, Liuxinyu970226, CennoxX, Scott_WUaS, Ltrlg, Oliv0, Izno, eranroz, PokestarFan, Doc_James, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178153: make disabledUsageAspects coarse graining

2017-10-18 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-24 (1.31.0-wmf.5)).
TASK DETAILhttps://phabricator.wikimedia.org/T178153EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, ReleaseTaggerBotCc: gerritbot, Lydia_Pintscher, hoo, daniel, Aklapper, eranroz, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T178153: make disabledUsageAspects coarse graining

2017-10-18 Thread hoo
hoo closed this task as "Resolved".hoo removed a project: Patch-For-Review.hoo moved this task from Review to Done on the Wikidata-Sprint board.
TASK DETAILhttps://phabricator.wikimedia.org/T178153WORKBOARDhttps://phabricator.wikimedia.org/project/board/2351/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, Lydia_Pintscher, hoo, daniel, Aklapper, eranroz, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T49288: [Epic] Track Wikidata entity usage on client pages

2017-10-18 Thread hoo
hoo closed subtask T178153: make disabledUsageAspects coarse graining  as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T49288EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: PokestarFan, DixonD, Aklapper, Bianjiang, aude, jeremyb, liangent, Wikidata-bugs, greg, Abraham, Legoktm, Tobi_WMDE_SW, Daniel_Mietchen, jayvdb, Micru, Ricordisamoa, MZMcBride, Liuxinyu970226, Ainali, Sannita, Lydia_Pintscher, Eloquence, zhuyifei1999, daniel, hoo, GoranSMilovanovic, QZanden, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unassigned] T138371: WordPress plugin to associate tags with Wikidata IDs

2017-10-18 Thread Philipjohn21
Philipjohn21 removed Zeko as the assignee of this task.Philipjohn21 added a comment.
Ah yes I see what you mean :)

F10288642: Screenshot_20171018-071334.png

Scrap that idea then... I think the field on the term edit page with an ajax search is a good idea.

I'm not sure we can avoid the manual effort that requires of the user without interrupting the save post flow, which could be frustrating.TASK DETAILhttps://phabricator.wikimedia.org/T138371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Philipjohn21Cc: Philipjohn21, Liuxinyu970226, Samwilson, Mbch331, Framawiki, DanBri, Esh77, Lydia_Pintscher, abian, Tramullas, Zeko, Aklapper, Pigsonthewing, Zppix, GoranSMilovanovic, QZanden, Psychoslave, Wikidata-bugs, aude___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs