[Wikidata-bugs] [Maniphest] [Created] T176927: WDQS updater crashed

2017-09-27 Thread Yurik
Yurik created this task.Yurik added a project: Wikidata-Query-Service.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery. TASK DESCRIPTIONWDQS updater crashed, possibly due to a DNS outage? (everything else seemed fine, professional datacenter) 05:12:21.954 [main] INFO

[Wikidata-bugs] [Maniphest] [Commented On] T12342: Use user language for namespace names

2017-09-27 Thread Quiddity
Quiddity added a comment. Hi! Can we consider re-opening this? Even just having the English fallback available would be especially useful for most developers and for many cross-wiki maintainers/admins/stewards/etc, who might not be able to read the local script. E.g. when trying to filter

[Wikidata-bugs] [Maniphest] [Updated] T175109: beta: Wikidata dispatchChanges.php causes a lot of "Wikimedia\Rdbms\DatabaseMysqlBase::unlock failed to release lock"

2017-09-27 Thread greg
greg added a project: Wikimedia-log-errors. TASK DETAILhttps://phabricator.wikimedia.org/T175109EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gregCc: Krinkle, thiemowmde, Ladsgroup, aude, Aklapper, hashar, GoranSMilovanovic, QZanden, TerraCodes, Izno,

[Wikidata-bugs] [Maniphest] [Commented On] T175741: Set ElasticSearch implementation as default for wbsearchentites on Wikidata

2017-09-27 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-09-27T23:17:05Z] Synchronized wmf-config/Wikibase.php: Make CirrusSearch default for wbsearchentities on testwikidatawiki T175741 (duration: 00m 48s)TASK DETAILhttps://phabricator.wikimedia.org/T175741EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T175741: Set ElasticSearch implementation as default for wbsearchentites on Wikidata

2017-09-27 Thread gerritbot
gerritbot added a comment. Change 381025 merged by jenkins-bot: [operations/mediawiki-config@master] Make using CirrusSearch engine default for wbsearchentities on test.wikidata.org https://gerrit.wikimedia.org/r/381025TASK DETAILhttps://phabricator.wikimedia.org/T175741EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T175109: beta: Wikidata dispatchChanges.php causes a lot of "Wikimedia\Rdbms\DatabaseMysqlBase::unlock failed to release lock"

2017-09-27 Thread Krinkle
Krinkle added a comment. Still happening. 750,000+ log entries in the last 30 days on Beta Cluster. Most are like: mediawiki WARNING wikidatawiki deployment-tin Wikimedia\Rdbms\DatabaseMysqlBase::unlock failed to release lock '' or mediawiki WARNING wikidatawiki deployment-tin

[Wikidata-bugs] [Maniphest] [Updated] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")

2017-09-27 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher,

[Wikidata-bugs] [Maniphest] [Commented On] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")

2017-09-27 Thread gerritbot
gerritbot added a comment. Change 381140 had a related patch set uploaded (by Hoo man; owner: Hoo man): [mediawiki/extensions/Wikibase@master] Add EntityUsage::DESCRIPTION_USAGE for descriptions https://gerrit.wikimedia.org/r/381140TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T173144: Tracking implicit (extensions) usages of Wikidata

2017-09-27 Thread hoo
hoo added a subtask: T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D"). TASK DETAILhttps://phabricator.wikimedia.org/T173144EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: hoo, PokestarFan, Halfak,

[Wikidata-bugs] [Maniphest] [Updated] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")

2017-09-27 Thread hoo
hoo added a parent task: T173144: Tracking implicit (extensions) usages of Wikidata. TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999,

[Wikidata-bugs] [Maniphest] [Claimed] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")

2017-09-27 Thread hoo
hoo claimed this task.hoo added a project: Wikidata-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher,

[Wikidata-bugs] [Maniphest] [Commented On] T113468: [Task] Use compact representation of diffs in EntityChange.

2017-09-27 Thread hoo
hoo added a comment. I suggest replacing the Diff in DiffChange with a new EntityDiffChangedAspects object. Initially both should be present, but only one should be in the serialized form (EntityChange::getSerializedInfo). I would introduce a new boolean feature flag which changes which of the

[Wikidata-bugs] [Maniphest] [Commented On] T176124: Lua: Make it possible to load all statements for only one property of an entity using mw.wikibase

2017-09-27 Thread Andrei_Stroe
Andrei_Stroe added a comment. Yes, it's perfectly OK, because the code I'm going to replace with a call to this function is brutely iterating through the claims table. Further filtering should be left to the calling module.TASK DETAILhttps://phabricator.wikimedia.org/T176124EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T173749: QuickStatements to RDF converter

2017-09-27 Thread Pintoch
Pintoch added a comment. @Lydia_Pintscher that makes sense. Okay, thank you to you both, we are on the same page! Given all these tickets on the topic I was worried that I had missed something obvious about this issue…TASK DETAILhttps://phabricator.wikimedia.org/T173749EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T173749: QuickStatements to RDF converter

2017-09-27 Thread Lydia_Pintscher
Lydia_Pintscher added a comment. Right and I don't think there is desire to change that. But for tools like the primary sources tool that could ingest rdf and then feed data into Wikidata through the usual API I think that'd be ok.TASK DETAILhttps://phabricator.wikimedia.org/T173749EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T173749: QuickStatements to RDF converter

2017-09-27 Thread Smalyshev
Smalyshev added a comment. Right now RDF is only a secondary database format, so all imports are supposed to go through Wikibase instance, using one of Wikibase import formats. Using RDF for import AFAIK is not a use case we currently implement.TASK

[Wikidata-bugs] [Maniphest] [Commented On] T173749: QuickStatements to RDF converter

2017-09-27 Thread Lydia_Pintscher
Lydia_Pintscher added a comment. I am not aware of any "standard" but this is the time to make one then I guess ;-)TASK DETAILhttps://phabricator.wikimedia.org/T173749EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Pintoch, Aklapper,

[Wikidata-bugs] [Maniphest] [Edited] T125500: [Epic] Index Wikidata labels and descriptions as separate fields in ElasticSearch

2017-09-27 Thread Smalyshev
Smalyshev updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[] Figure out how to properly index descriptions (may require some work with analyzers due to different languages, probably need to discuss with @dcausseT176903)...TASK

[Wikidata-bugs] [Maniphest] [Updated] T125500: [Epic] Index Wikidata labels and descriptions as separate fields in ElasticSearch

2017-09-27 Thread Smalyshev
Smalyshev added a subtask: T176903: Index wikidata descriptions. TASK DETAILhttps://phabricator.wikimedia.org/T125500EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: K4-713, Nikki, Lydia_Pintscher, Lea_Lacroix_WMDE, Stashbot, PokestarFan,

[Wikidata-bugs] [Maniphest] [Commented On] T173749: QuickStatements to RDF converter

2017-09-27 Thread Pintoch
Pintoch added a comment. @Smalyshev thanks for your quick reply! Just for clarity, I am not personally working on the PST, I was just trying to find out if there was any established way to use RDF to represent a data import. If that is the case, then other tools could use that format too (for

[Wikidata-bugs] [Maniphest] [Updated] T173749: QuickStatements to RDF converter

2017-09-27 Thread Smalyshev
Smalyshev added a comment. If I understand the use case right, you may not need the full data set, and you won't be actually importing the data into WDQS database. So you can change the RDF model according to your case. For identifiers, right now they are non-portable and implementation-dependant

[Wikidata-bugs] [Maniphest] [Commented On] T167759: Reference hash is not stable

2017-09-27 Thread Smalyshev
Smalyshev added a comment. It would be nice if we could make hashes at least reproducible by other tools... Though it might be non-trivial I admit. But now if some tool wants to generate RDF representation of Wikidata statement, there's basically no way besides using the same PHP code.TASK

[Wikidata-bugs] [Maniphest] [Commented On] T173749: QuickStatements to RDF converter

2017-09-27 Thread Pintoch
Pintoch added a comment. @Lydia_Pintscher , @Smalyshev and @Tpt : is there any info about how RDF is expected to behave as an import format for Wikidata? As far as I can tell, the RDF that gets fed into the Query Service is not designed for import at all: first, there is a lot of redundancy:

[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-09-27 Thread Gehel
Gehel added a comment. Doing some quick math: wdqs eqiad cluster has between 20 and 40 requests per seconds according to our varnish stats 3 servers in that cluster let's assume requests are routed equally to all servers, that's 10 req/second/server 1.3 GB/sec allocation rate 130MB allocated per

[Wikidata-bugs] [Maniphest] [Triaged] T175919: investigate GC times on wikidata query service

2017-09-27 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T175919EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Stashbot, gerritbot, Smalyshev, Gehel, Aklapper, Lordiis, Lucas_Werkmeister_WMDE,

[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-09-27 Thread Smalyshev
Smalyshev added a comment. I think we should be careful about cutting down heap size. The peaks is what I am worried about, and Java has a nasty habit of getting stuck once the heap is exhausted. I'd rather it not happen in the middle of the night because somebody run some heavy query...TASK

[Wikidata-bugs] [Maniphest] [Commented On] T176124: Lua: Make it possible to load all statements for only one property of an entity using mw.wikibase

2017-09-27 Thread hoo
hoo added a comment. My proposed implementation includes "deprecated" statements as well, I guess this ok here?TASK DETAILhttps://phabricator.wikimedia.org/T176124EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, Lydia_Pintscher, eranroz,

[Wikidata-bugs] [Maniphest] [Updated] T168298: UI for editing a Lexeme's language

2017-09-27 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T168298EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jakob_WMDE, gerritbotCc: gerritbot, WMDE-leszek, Jan_Dittrich, Aklapper, daniel, Lordiis, Cinemantique,

[Wikidata-bugs] [Maniphest] [Updated] T176124: Lua: Make it possible to load all statements for only one property of an entity using mw.wikibase

2017-09-27 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T176124EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, Lydia_Pintscher, eranroz, Aklapper, hoo, Andrei_Stroe, Lordiis, GoranSMilovanovic,

[Wikidata-bugs] [Maniphest] [Commented On] T176124: Lua: Make it possible to load all statements for only one property of an entity using mw.wikibase

2017-09-27 Thread gerritbot
gerritbot added a comment. Change 381028 had a related patch set uploaded (by Hoo man; owner: Hoo man): [mediawiki/extensions/Wikibase@master] Lua: Add mw.wikibase.getStatements https://gerrit.wikimedia.org/r/381028TASK DETAILhttps://phabricator.wikimedia.org/T176124EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T175741: Set ElasticSearch implementation as default for wbsearchentites on Wikidata

2017-09-27 Thread gerritbot
gerritbot added a comment. Change 381025 had a related patch set uploaded (by Smalyshev; owner: Smalyshev): [operations/mediawiki-config@master] Make using CirrusSearch engine default for wbsearchentities on test.wikidata.org https://gerrit.wikimedia.org/r/381025TASK

[Wikidata-bugs] [Maniphest] [Commented On] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. If the TTL isn’t too long (I saw a cap of 1 day in the puppet config, is that correct?), then normal expiry is probably enough.TASK DETAILhttps://phabricator.wikimedia.org/T163922EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread Ladsgroup
Ladsgroup added a comment. Nope :D We need this for all clients not just Commons.TASK DETAILhttps://phabricator.wikimedia.org/T163922EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: ema, elukey, TerraCodes, Jay8g, Liuxinyu970226,

[Wikidata-bugs] [Maniphest] [Commented On] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. Okay, in that case we can close this issue now, right?TASK DETAILhttps://phabricator.wikimedia.org/T163922EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: ema, elukey, TerraCodes, Jay8g,

[Wikidata-bugs] [Maniphest] [Changed Project Column] T102749: [Task] Implement "Value only constraint"

2017-09-27 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE moved this task from ready to go to in current sprint on the Wikidata board.Lucas_Werkmeister_WMDE added a project: Wikidata-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T102749WORKBOARDhttps://phabricator.wikimedia.org/project/board/71/EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T102749: [Task] Implement "Value only constraint"

2017-09-27 Thread gerritbot
gerritbot added a comment. Change 381005 had a related patch set uploaded (by Lucas Werkmeister (WMDE); owner: Lucas Werkmeister (WMDE)): [mediawiki/extensions/WikibaseQualityConstraints@master] Add “used as value only” constraint type https://gerrit.wikimedia.org/r/381005TASK

[Wikidata-bugs] [Maniphest] [Updated] T102749: [Task] Implement "Value only constraint"

2017-09-27 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T102749EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Lucas_Werkmeister_WMDE, PokestarFan, Mbch331, Yair_rand, Aklapper, Jonaskeutel, Lordiis,

[Wikidata-bugs] [Maniphest] [Commented On] T176841: Create wikibase/wikiba.se-deploy repo

2017-09-27 Thread Dzahn
Dzahn added a comment. New Gerrit repos (projects) might have to be requested on wiki instead, afaict. https://www.mediawiki.org/wiki/Gerrit/New_repositories/RequestsTASK DETAILhttps://phabricator.wikimedia.org/T176841EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread akosiaris
akosiaris added a comment. In T163922#3639831, @Lucas_Werkmeister_WMDE wrote: If the TTL isn’t too long (I saw a cap of 1 day in the puppet config, is that correct?), then normal expiry is probably enough. It doesn't work like that. The time that request can be cached is determined by the

[Wikidata-bugs] [Maniphest] [Commented On] T168298: UI for editing a Lexeme's language

2017-09-27 Thread gerritbot
gerritbot added a comment. Change 381000 had a related patch set uploaded (by Jakob; owner: Jakob): [mediawiki/extensions/WikibaseLexeme@master] [WIP] Make lexeme language and lexical category editable. https://gerrit.wikimedia.org/r/381000TASK DETAILhttps://phabricator.wikimedia.org/T168298EMAIL

[Wikidata-bugs] [Maniphest] [Claimed] T176124: Lua: Make it possible to load all statements for only one property of an entity using mw.wikibase

2017-09-27 Thread hoo
hoo claimed this task.hoo added projects: MediaWiki-extensions-WikibaseClient, Wikidata-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T176124EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Lydia_Pintscher, eranroz, Aklapper, hoo, Andrei_Stroe,

[Wikidata-bugs] [Maniphest] [Commented On] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread elukey
elukey added a comment. In T163922#3639504, @Lucas_Werkmeister_WMDE wrote: Is there any way to find out which URLs are garbled? Can we look for RW_PROTO in all the cached redirects, or something like that? There is a way (https://wikitech.wikimedia.org/wiki/Varnish#One-off_purges_.28bans.29)

[Wikidata-bugs] [Maniphest] [Commented On] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread daniel
daniel added a comment. @elukey, @Lucas_Werkmeister_WMDE, @Ladsgroup Thanks for the quick fix!TASK DETAILhttps://phabricator.wikimedia.org/T163922EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: ema, elukey, TerraCodes, Jay8g, Liuxinyu970226,

[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-09-27 Thread Gehel
Gehel added a comment. For comparison, wdqs2001 (which is seeing much les user traffic, but the same amount of writes) is showing a GC overhead of ~3.2%, allocation rate of 200mb/sec, max GC time of 1.7 seconds. Obvious solution to improve throughput: stop sending user traffic to our servers :)

[Wikidata-bugs] [Maniphest] [Edited] T176875: Allow access to wdqs.svc.eqiad.wmnet on port 8888

2017-09-27 Thread Addshore
Addshore updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...Would it be possible to also access wdqs.svc.eqiad.wmnet on port Allowing this would allow me to remove the hard coding of an individual machine added in https://gerrit.wikimedia.org/r/#/c/380974/TASK

[Wikidata-bugs] [Maniphest] [Created] T176875: Allow access to wdqs.svc.eqiad.wmnet on port 8888

2017-09-27 Thread Addshore
Addshore created this task.Addshore added projects: Wikidata, User-Addshore, WMDE-Analytics-Engineering, Operations, Wikidata-Query-Service.Herald added a subscriber: Aklapper.Herald added a project: Discovery. TASK DESCRIPTIONAs far as I can tell wdqs.svc.eqiad.wmnet will direct me to an active

[Wikidata-bugs] [Maniphest] [Commented On] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-27 Thread gerritbot
gerritbot added a comment. Change 380974 merged by jenkins-bot: [analytics/wmde/scripts@master] instanceof.php talk to wdqs1003: directly for now https://gerrit.wikimedia.org/r/380974TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-27 Thread gerritbot
gerritbot added a comment. Change 380975 merged by jenkins-bot: [analytics/wmde/scripts@production] instanceof.php talk to wdqs1003: directly for now https://gerrit.wikimedia.org/r/380975TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-27 Thread gerritbot
gerritbot added a comment. Change 380975 had a related patch set uploaded (by Addshore; owner: Addshore): [analytics/wmde/scripts@production] instanceof.php talk to wdqs1003: directly for now https://gerrit.wikimedia.org/r/380975TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-27 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Lydia_Pintscher, gerritbot, Addshore, Sjoerddebruin, Aklapper, Lordiis, GoranSMilovanovic, Adik2382,

[Wikidata-bugs] [Maniphest] [Claimed] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-27 Thread Addshore
Addshore claimed this task.Addshore triaged this task as "High" priority. TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Lydia_Pintscher, gerritbot, Addshore, Sjoerddebruin, Aklapper, Lordiis,

[Wikidata-bugs] [Maniphest] [Commented On] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-27 Thread gerritbot
gerritbot added a comment. Change 380974 had a related patch set uploaded (by Addshore; owner: Addshore): [analytics/wmde/scripts@master] instanceof.php talk to wdqs1003: directly for now https://gerrit.wikimedia.org/r/380974TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-27 Thread Lydia_Pintscher
Lydia_Pintscher added a comment. I'd say pretty important because it lets us see huge imports happening or changes to the ontology that have huge impacts. I'd say let's try to go with the internal endpoint if that is ok. If/when that fails we can switch to using the dumps?TASK

[Wikidata-bugs] [Maniphest] [Commented On] T174794: [Task] investigate emails about Wikidata changes from Wikipedia

2017-09-27 Thread IKhitron
IKhitron added a comment. In T174794#3639561, @Lydia_Pintscher wrote: I believe that would be helpful. enwiki: Talk page message V, Thanks X, Translations V, Mention V, Failed mention -, Successful mention -, Page link V, Connection with Wikidata X, Failed login attempts V, Login from an

[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-09-27 Thread gerritbot
gerritbot added a comment. Change 380972 had a related patch set uploaded (by Gehel; owner: Gehel): [operations/puppet@production] wdqs: reduce blazegraph heap size to 10GB https://gerrit.wikimedia.org/r/380972TASK DETAILhttps://phabricator.wikimedia.org/T175919EMAIL

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-27 Thread Addshore
Addshore added a subscriber: Lydia_Pintscher.Addshore added a comment. I have unassigned myself as the investigation of the cause is now done! @Lydia_Pintscher what priority is this?TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-27 Thread Sjoerddebruin
Sjoerddebruin added a comment. I'm okay with weekly data for this specific case.TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SjoerddebruinCc: gerritbot, Addshore, Sjoerddebruin, Aklapper,

[Wikidata-bugs] [Maniphest] [Unassigned] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-27 Thread Addshore
Addshore removed Addshore as the assignee of this task.Addshore removed a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: gerritbot, Addshore, Sjoerddebruin, Aklapper,

[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-09-27 Thread Gehel
Gehel added a comment. Looking at 21 hours of GC logs on wdqs1004, I still see 1.3GB/sec allocation rate (almost 100TB allocated over 21 hours!). GC overhead is still high at ~8%. It still looks like the heap is oversized, so I'll try to reduce more to see if that increases throughput (but I doubt

[Wikidata-bugs] [Maniphest] [Updated] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-27 Thread Addshore
Addshore added a comment. addshore@stat1005:~$ cat /srv/analytics-wmde/graphite/log/daily.03.log |grep wikidata-sparql-instanceof |grep Q11173 2017-09-26 03:01:59 wikidata-sparql-instanceof Result for: Q11173 null 2017-09-27 03:02:07 wikidata-sparql-instanceof WikidataInstanceOf::doSparqlQuery:

[Wikidata-bugs] [Maniphest] [Edited] T166892: Implement “Reference” constraint

2017-09-27 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION~~Extremely trivial (always violated, because we only check the main value) and~~ completely analogous to “Qualifier”TASK DETAILhttps://phabricator.wikimedia.org/T166892EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T168532: Check constraints on qualifiers and references

2017-09-27 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a subtask: T166892: Implement “Reference” constraint. TASK DETAILhttps://phabricator.wikimedia.org/T168532EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: abian, Ivan_A_Krestinin, gerritbot, PokestarFan,

[Wikidata-bugs] [Maniphest] [Updated] T166892: Implement “Reference” constraint

2017-09-27 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a parent task: T168532: Check constraints on qualifiers and references. TASK DETAILhttps://phabricator.wikimedia.org/T166892EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Aklapper,

[Wikidata-bugs] [Maniphest] [Commented On] T174794: [Task] investigate emails about Wikidata changes from Wikipedia

2017-09-27 Thread Lydia_Pintscher
Lydia_Pintscher added a comment. I believe that would be helpful.TASK DETAILhttps://phabricator.wikimedia.org/T174794EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: aude, Lydia_PintscherCc: jeremyb, Noella94, IKhitron, matej_suchanek, Aklapper,

[Wikidata-bugs] [Maniphest] [Commented On] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. Is there any way to find out which URLs are garbled? Can we look for RW_PROTO in all the cached redirects, or something like that?TASK DETAILhttps://phabricator.wikimedia.org/T163922EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T174794: [Task] investigate emails about Wikidata changes from Wikipedia

2017-09-27 Thread IKhitron
IKhitron added a comment. In T174794#3636534, @Noella94 wrote: Hi, What is common about those receiving those mails? The mails are sent from other wikis due to wikidata changes but the mails are not sent to all wikimedians (users). Maybe we should just put here the list of our email

[Wikidata-bugs] [Maniphest] [Commented On] T175561: Check distinct values (unique value) constraint on qualifiers and references

2017-09-27 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. Two semantics questions: Is it a constraint violation if the same value is used in a statement and elsewhere in a qualifier? Or should values only be distinct between all main snaks / all qualifiers / all references? (My current WIP implementation only

[Wikidata-bugs] [Maniphest] [Edited] T168532: Check constraints on qualifiers and references

2017-09-27 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...- [ ] #patch-for-review: [Add config for checking constraints on qualifiers and references](https://gerrit.wikimedia.org/r/#/c/376290/) ~~(might be the same as the one for switching to the new API

[Wikidata-bugs] [Maniphest] [Block] T168532: Check constraints on qualifiers and references

2017-09-27 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE created subtask T176863: Enable constraint checks on qualifiers and references on Wikidata. TASK DETAILhttps://phabricator.wikimedia.org/T168532EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: abian,

[Wikidata-bugs] [Maniphest] [Created] T176863: Enable constraint checks on qualifiers and references on Wikidata

2017-09-27 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE created this task.Lucas_Werkmeister_WMDE added projects: Wikidata, Wikibase-Quality, Wikibase-Quality-Constraints, Wikidata-Sprint, Patch-For-Review.Herald added a subscriber: Aklapper.Herald removed a project: Patch-For-Review. TASK DESCRIPTIONOnce all the code for T168532:

[Wikidata-bugs] [Maniphest] [Closed] T176771: Enable ArticlePlaceholder on bnwiki

2017-09-27 Thread hoo
hoo closed this task as "Resolved".hoo added a comment. Deployed now: https://bn.wikipedia.org/wiki/%E0%A6%AC%E0%A6%BF%E0%A6%B6%E0%A7%87%E0%A6%B7:AboutTopic/Q53TASK DETAILhttps://phabricator.wikimedia.org/T176771EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:

[Wikidata-bugs] [Maniphest] [Triaged] T176858: Represent Structured Data on Commons at WikidataCon 2017 in Berlin

2017-09-27 Thread SandraF_WMF
SandraF_WMF triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T176858EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Aklapper, SandraF_WMF, E1presidente, Ramsey-WMF, Jmmuguerza, GoranSMilovanovic,

[Wikidata-bugs] [Maniphest] [Changed Project Column] T176771: Enable ArticlePlaceholder on bnwiki

2017-09-27 Thread hoo
hoo moved this task from Doing to Done on the ArticlePlaceholder board.hoo removed a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T176771WORKBOARDhttps://phabricator.wikimedia.org/project/board/1416/EMAIL

[Wikidata-bugs] [Maniphest] [Created] T176858: Represent Structured Data on Commons at WikidataCon 2017 in Berlin

2017-09-27 Thread SandraF_WMF
SandraF_WMF created this task.SandraF_WMF added projects: Community-Liaisons (Oct-Dec 2017), Structured-Data-Commons.Herald added a subscriber: Aklapper.Herald added a project: Wikidata. TASK DESCRIPTIONGive a presentation about Structured Data on Commons at WikidataCon, and interact/network with

[Wikidata-bugs] [Maniphest] [Commented On] T176771: Enable ArticlePlaceholder on bnwiki

2017-09-27 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-09-27T12:06:48Z] Synchronized wmf-config/InitialiseSettings.php: Enable the ArticlePlaceholder on bnwiki (T176771) (duration: 00m 49s)TASK DETAILhttps://phabricator.wikimedia.org/T176771EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T176771: Enable ArticlePlaceholder on bnwiki

2017-09-27 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-09-27T12:05:34Z] Synchronized wmf-config/InitialiseSettings.php: Enable the ArticlePlaceholder on bnwiki (T176771) (duration: 01m 00s)TASK DETAILhttps://phabricator.wikimedia.org/T176771EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T176771: Enable ArticlePlaceholder on bnwiki

2017-09-27 Thread gerritbot
gerritbot added a comment. Change 380793 merged by jenkins-bot: [operations/mediawiki-config@master] Enable ArticlePlaceholder on bnwiki https://gerrit.wikimedia.org/r/380793TASK DETAILhttps://phabricator.wikimedia.org/T176771EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T173840: Send out Structured Data on Commons Newsletter - The October 2017 Edition

2017-09-27 Thread SandraF_WMF
SandraF_WMF moved this task from Jul-Sep 2017 to Oct-Dec 2017 on the Community-Liaisons board.SandraF_WMF edited projects, added Community-Liaisons (Oct-Dec 2017); removed Community-Liaisons (Jul-Sep 2017). TASK

[Wikidata-bugs] [Maniphest] [Retitled] T173840: Send out Structured Data on Commons Newsletter - The October 2017 Edition

2017-09-27 Thread SandraF_WMF
SandraF_WMF renamed this task from "Send out Structured Data on Commons Newsletter - The Post-Wikimania 2017 Edition" to "Send out Structured Data on Commons Newsletter - The October 2017 Edition". TASK DETAILhttps://phabricator.wikimedia.org/T173840EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T173924: Revisit old Structured Data on Commons documentation (2014) + summarize and archive

2017-09-27 Thread SandraF_WMF
SandraF_WMF moved this task from Jul-Sep 2017 to Oct-Dec 2017 on the Community-Liaisons board.SandraF_WMF edited projects, added Community-Liaisons (Oct-Dec 2017); removed Community-Liaisons (Jul-Sep 2017). TASK

[Wikidata-bugs] [Maniphest] [Closed] T173945: Create basic communication and partner outreach plan for Structured Data on Commons

2017-09-27 Thread SandraF_WMF
SandraF_WMF closed this task as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T173945EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Abit, BVershbow_WMF, SandraF_WMF, Aklapper, E1presidente, Ramsey-WMF, Jmmuguerza, GoranSMilovanovic,

[Wikidata-bugs] [Maniphest] [Commented On] T173945: Create basic communication and partner outreach plan for Structured Data on Commons

2017-09-27 Thread SandraF_WMF
SandraF_WMF added a comment. The first version of the plan can be considered READY. It will need lots of updating as our experience with the project grows, but the basis is there!TASK DETAILhttps://phabricator.wikimedia.org/T173945EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T174142: Build up and facilitate a focus group of Commons and Wikidata contributors for (long-term) feedback and input on Structured Data on Common

2017-09-27 Thread SandraF_WMF
SandraF_WMF moved this task from Jul-Sep 2017 to Oct-Dec 2017 on the Community-Liaisons board.SandraF_WMF edited projects, added Community-Liaisons (Oct-Dec 2017); removed Community-Liaisons (Jul-Sep 2017). TASK

[Wikidata-bugs] [Maniphest] [Changed Project Column] T174928: Initiate v1 of a glossary about Structured Data on Commons.

2017-09-27 Thread SandraF_WMF
SandraF_WMF moved this task from Jul-Sep 2017 to Oct-Dec 2017 on the Community-Liaisons board.SandraF_WMF edited projects, added Community-Liaisons (Oct-Dec 2017); removed Community-Liaisons (Jul-Sep 2017). TASK

[Wikidata-bugs] [Maniphest] [Changed Project Column] T174168: Update the Frequently Asked Questions (FAQ) pages about Structured Data on Commons

2017-09-27 Thread SandraF_WMF
SandraF_WMF moved this task from Jul-Sep 2017 to Oct-Dec 2017 on the Community-Liaisons board.SandraF_WMF edited projects, added Community-Liaisons (Oct-Dec 2017); removed Community-Liaisons (Jul-Sep 2017). TASK

[Wikidata-bugs] [Maniphest] [Changed Project Column] T173971: Get community input on tools, bots and workflows on Wikimedia Commons that will likely be affected by Structured Data on Commons.

2017-09-27 Thread SandraF_WMF
SandraF_WMF moved this task from Jul-Sep 2017 to Oct-Dec 2017 on the Community-Liaisons board.SandraF_WMF edited projects, added Community-Liaisons (Oct-Dec 2017); removed Community-Liaisons (Jul-Sep 2017). TASK

[Wikidata-bugs] [Maniphest] [Changed Project Column] T174134: Build up and facilitate a focus group of GLAM representatives for (long-term) feedback on Structured Data on Commons

2017-09-27 Thread SandraF_WMF
SandraF_WMF moved this task from Jul-Sep 2017 to Oct-Dec 2017 on the Community-Liaisons board.SandraF_WMF edited projects, added Community-Liaisons (Oct-Dec 2017); removed Community-Liaisons (Jul-Sep 2017). TASK

[Wikidata-bugs] [Maniphest] [Changed Project Column] T173979: Get community input on a wide variety of interesting Commons files that can be used as examples to prepare for metadata modelling

2017-09-27 Thread SandraF_WMF
SandraF_WMF moved this task from Jul-Sep 2017 to Oct-Dec 2017 on the Community-Liaisons board.SandraF_WMF edited projects, added Community-Liaisons (Oct-Dec 2017); removed Community-Liaisons (Jul-Sep 2017). TASK

[Wikidata-bugs] [Maniphest] [Changed Project Column] T173978: Collect and get community input on user stories related to Structured Data on Commons

2017-09-27 Thread SandraF_WMF
SandraF_WMF moved this task from Jul-Sep 2017 to Oct-Dec 2017 on the Community-Liaisons board.SandraF_WMF edited projects, added Community-Liaisons (Oct-Dec 2017); removed Community-Liaisons (Jul-Sep 2017). TASK

[Wikidata-bugs] [Maniphest] [Lowered Priority] T173820: Cleanup and update drive of information pages / portal about Structured Data on Commons

2017-09-27 Thread SandraF_WMF
SandraF_WMF moved this task from Jul-Sep 2017 to Oct-Dec 2017 on the Community-Liaisons board.SandraF_WMF edited projects, added Community-Liaisons (Oct-Dec 2017); removed Community-Liaisons (Jul-Sep 2017).SandraF_WMF lowered the priority of this task from "High" to "Normal". TASK

[Wikidata-bugs] [Maniphest] [Lowered Priority] T174565: Gather first community input and create focus groups for Structured Data on Wikimedia Commons

2017-09-27 Thread SandraF_WMF
SandraF_WMF moved this task from Jul-Sep 2017 to Oct-Dec 2017 on the Community-Liaisons board.SandraF_WMF edited projects, added Community-Liaisons (Oct-Dec 2017); removed Community-Liaisons (Jul-Sep 2017).SandraF_WMF lowered the priority of this task from "High" to "Normal". TASK

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread elukey
elukey added a subscriber: ema.elukey added a comment. I believe this is only a matter of cleaning up urls that show up garbled, @ema just did it for https://commons.wikimedia.org/data/main/Data:Bundestagswahl2017/wahlkreis46.map via

[Wikidata-bugs] [Maniphest] [Lowered Priority] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread elukey
elukey lowered the priority of this task from "Unbreak Now!" to "Normal". TASK DETAILhttps://phabricator.wikimedia.org/T163922EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: elukeyCc: elukey, TerraCodes, Jay8g, Liuxinyu970226, Lucas_Werkmeister_WMDE,

[Wikidata-bugs] [Maniphest] [Created] T176852: Redirects should not be in wb_terms table

2017-09-27 Thread Ladsgroup
Ladsgroup created this task.Ladsgroup added projects: Wikidata, MediaWiki-extensions-WikibaseRepository.Herald added a subscriber: Aklapper. TASK DESCRIPTIONFound them while checking the table: mysql:wikiadmin@db1092 [wikidatawiki]> select * from wb_terms where term_full_entity_id is null order

[Wikidata-bugs] [Maniphest] [Commented On] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread elukey
elukey added a comment. All the appservers are now returning the good version of the redirect, I think that some of them are still showing up broken due to caching.TASK DETAILhttps://phabricator.wikimedia.org/T163922EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T167114: Open view for term_full_entity_id in wb_terms table in labs

2017-09-27 Thread Ladsgroup
Ladsgroup added a comment. 92% of the populating the table has been done now and it will finish by Thursday, I think we should pick this task up.TASK DETAILhttps://phabricator.wikimedia.org/T167114EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc:

[Wikidata-bugs] [Maniphest] [Commented On] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread Ladsgroup
Ladsgroup added a comment. Also I think some are behind varnish, e.g. this works fine: https://commons.wikimedia.org/data/main/Data:Amsterdam_Districts.mapTASK DETAILhttps://phabricator.wikimedia.org/T163922EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:

[Wikidata-bugs] [Maniphest] [Commented On] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. It seems to be live on some servers and not yet on others. (And also, Varnish cashes the redirects.) I’m running this command: until ! curl -s -I https://commons.wikimedia.org/data/main/Data:Bundestagswahl2017/wahlkreis46.map?breakCache=$RANDOM | grep -qF

[Wikidata-bugs] [Maniphest] [Commented On] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread Ladsgroup
Ladsgroup added a comment. It takes around half an hour (to an hour) to nodes to pick it up and restart.TASK DETAILhttps://phabricator.wikimedia.org/T163922EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: TerraCodes, Jay8g, Liuxinyu970226,

[Wikidata-bugs] [Maniphest] [Raised Priority] T163922: Create a URL rewrite to handle the /data/ path for canonical URLs for machine readable page content

2017-09-27 Thread daniel
daniel raised the priority of this task from "High" to "Unbreak Now!".daniel added a comment.Herald added subscribers: Liuxinyu970226, Jay8g, TerraCodes. I see the fix got merged, but it doesn't seem to be live yet.TASK DETAILhttps://phabricator.wikimedia.org/T163922EMAIL

  1   2   >