[Wikidata-bugs] [Maniphest] [Commented On] T228297: Re-evaluate supporting dcatap namespace

2019-08-14 Thread Smalyshev
Smalyshev added a comment. http://dcatap.wmflabs.org/ is not up and can be queried. TASK DETAIL https://phabricator.wikimedia.org/T228297 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lokal_Profil, Bugreporter, Salgo60, WMDE

[Wikidata-bugs] [Maniphest] [Commented On] T230050: OutOfBoundsException in WikibaseQualityConstraints setup on Beta Wikidata

2019-08-14 Thread Smalyshev
Smalyshev added a comment. @WMDE-leszek you patch is still WIP, are you still working on it? TASK DETAIL https://phabricator.wikimedia.org/T230050 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: zeljkofilipin, Liuxinyu970226

[Wikidata-bugs] [Maniphest] [Triaged] T230410: wdqs updater processing events but not finding anything useful

2019-08-13 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T230410 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: jijiki, Aklapper, Mathew.onipe, Smalyshev, Gehel, darthmon_wmde, DannyS712

[Wikidata-bugs] [Maniphest] [Commented On] T230410: wdqs updater processing events but not finding anything useful

2019-08-13 Thread Smalyshev
Smalyshev added a comment. Anther point: while WDQS does fetch data from both clusters (at least is supposed to), it only tracks its timestamp by one topic: reportingTopic, which is currently eqiad.mediawiki.revision-create. Otherwise we get weird jumps in the timestamps, since different

[Wikidata-bugs] [Maniphest] [Updated] T230410: wdqs updater processing events but not finding anything useful

2019-08-13 Thread Smalyshev
Smalyshev added projects: User-Smalyshev, Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T230410 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: jijiki, Aklapper, Mathew.onipe, Smalyshev, Gehel

[Wikidata-bugs] [Maniphest] [Commented On] T230410: wdqs updater processing events but not finding anything useful

2019-08-13 Thread Smalyshev
Smalyshev added a comment. We'll also probably need to update items edited in that timeframe manually, just in case. I'll do that a bit later (and also will add docs for doing this). TASK DETAIL https://phabricator.wikimedia.org/T230410 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] [Commented On] T230410: wdqs updater processing events but not finding anything useful

2019-08-13 Thread Smalyshev
Smalyshev added a comment. This is pretty weird, the updater should be able to consume from both eqiad and codfw, maybe something between the brokers did not work, or we're not connecting to the right endpoint? The messages and the situation definitely looks like it stopped getting events

[Wikidata-bugs] [Maniphest] [Claimed] T228297: Re-evaluate supporting dcatap namespace

2019-08-13 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T228297 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lokal_Profil, Bugreporter, Salgo60, WMDE-leszek, nichtich, Gehel, Lydia_Pintscher, Lea_Lacroix_WMDE

[Wikidata-bugs] [Maniphest] [Claimed] T229608: Allow WDQS default prefixes to work with federated data

2019-08-13 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T229608 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Claimed] T161991: Whether a data type should be treated as a reference type in RDF should be defined in WikibaseRepo.datatypes.php

2019-08-13 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T161991 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Aklapper, daniel, darthmon_wmde, ET4Eva, DannyS712, Nandana, Lahi, Gq86, Darkminds3113

[Wikidata-bugs] [Maniphest] [Claimed] T174504: Coordinates are exported into RDF with excessive precision

2019-08-13 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T174504 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: thiemowmde, daniel, Aklapper, Smalyshev, darthmon_wmde, ET4Eva, DannyS712, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Edited] T230244: Restore wdqs1009 to its role as auto-deploy testing

2019-08-12 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230244 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel, Aklapper, Smalyshev, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Updated] T230247: Increase VCPU quota for wikidata-query project

2019-08-12 Thread Smalyshev
Smalyshev added a comment. I've just remembered we'd need VPS for testing SPARQL service for T141602 <https://phabricator.wikimedia.org/T141602>, so we might allocate some quote for those as well. TASK DETAIL https://phabricator.wikimedia.org/T230247 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] [Edited] T230247: Increase VCPU quota for wikidata-query project

2019-08-12 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230247 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: bd808, Aklapper, Smalyshev, darthmon_wmde, DannyS712, Nandana, JKSTNK, Fheredia, AndyTan

[Wikidata-bugs] [Maniphest] [Commented On] T221917: Create RDF dump of structured data on Commons

2019-08-12 Thread Smalyshev
Smalyshev added a comment. I've added fix for one of the issues in T222497 <https://phabricator.wikimedia.org/T222497> already but it doesn't fix everything. I think it's still would be interesting to test what happens in production - maybe not full dump but just partial, to estimat

[Wikidata-bugs] [Maniphest] [Updated] T230247: Increase VCPU quota for wikidata-query project

2019-08-11 Thread Smalyshev
Smalyshev edited projects, added Cloud-VPS (Quota-requests); removed Cloud-VPS (Project-requests). TASK DETAIL https://phabricator.wikimedia.org/T230247 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: bd808, Aklapper, Smalyshev

[Wikidata-bugs] [Maniphest] [Edited] T230247: Increase VCPU quota for wikidata-query project

2019-08-11 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230247 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: bd808, Aklapper, Smalyshev, darthmon_wmde, DannyS712, Nandana, JKSTNK, Fheredia, AndyTan

[Wikidata-bugs] [Maniphest] [Updated] T230247: Increase VCPU quota for wikidata-query project

2019-08-11 Thread Smalyshev
Smalyshev edited projects, added Cloud-VPS (Project-requests); removed Cloud-VPS. TASK DETAIL https://phabricator.wikimedia.org/T230247 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: bd808, Aklapper, Smalyshev, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Updated] T230247: Increase VCPU quota for wikidata-query project

2019-08-09 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T230247 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, DannyS712, Nandana, JKSTNK

[Wikidata-bugs] [Maniphest] [Commented On] T228297: Re-evaluate supporting dcatap namespace

2019-08-09 Thread Smalyshev
Smalyshev added a comment. > This may be moved to a separate endpoint, probably in Toolforge. I think moving it to VPS endpoint is probably the best solution. TASK DETAIL https://phabricator.wikimedia.org/T228297 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/pa

[Wikidata-bugs] [Maniphest] [Updated] T228709: Make statistics of throttled/denied WDQS clients

2019-08-09 Thread Smalyshev
Smalyshev removed a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T228709 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Lea_Lacroix_WMDE, Lydia_Pintscher, Gehel, Smalyshev

[Wikidata-bugs] [Maniphest] [Created] T230247: Increase VCPU quota for wikidata-query project

2019-08-09 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Cloud-VPS, Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION I'd like to request an increase for VCPU quota for wikidata-query project in order

[Wikidata-bugs] [Maniphest] [Updated] T230244: Restore wdqs1009 to its role as auto-deploy testing

2019-08-09 Thread Smalyshev
Smalyshev added a project: Wikidata-Query-Service. Smalyshev added a subscriber: Gehel. Restricted Application added a project: Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T230244 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev

[Wikidata-bugs] [Maniphest] [Triaged] T230050: OutOfBoundsException in WikibaseQualityConstraints setup on Beta Wikidata

2019-08-09 Thread Smalyshev
Smalyshev triaged this task as "High" priority. Smalyshev added a comment. Setting it to High priority since it will start generating problems in production as soon as the train gets there, I imagine. TASK DETAIL https://phabricator.wikimedia.org/T230050 EMAIL PREFERENC

[Wikidata-bugs] [Maniphest] [Updated] T228297: Re-evaluate supporting dcatap namespace

2019-08-07 Thread Smalyshev
Smalyshev added projects: User-Smalyshev, Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T228297 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lokal_Profil, Bugreporter, Salgo60, WMDE-leszek

[Wikidata-bugs] [Maniphest] [Triaged] T228348: Category graph includes deleted categories

2019-08-07 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T228348 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Bugreporter, darthmon_wmde, DannyS712, Nandana,

[Wikidata-bugs] [Maniphest] [Closed] T228640: WDQS missing some particular data (property P6885)

2019-08-07 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T228640 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: LiberatorG, AMDmi3, Smalyshev, Mormegil

[Wikidata-bugs] [Maniphest] [Closed] T229617: Loading dump creates multiple wikibase:Dump schema:dateModified statements

2019-08-07 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T229617 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: matej_suchanek, Cyberpower678, Vojtech.dostal, Aklapper, Mormegil, AMDmi3,

[Wikidata-bugs] [Maniphest] [Unblock] T228640: WDQS missing some particular data (property P6885)

2019-08-07 Thread Smalyshev
Smalyshev closed subtask T229617: Loading dump creates multiple wikibase:Dump schema:dateModified statements as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T228640 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: LiberatorG

[Wikidata-bugs] [Maniphest] [Edited] T230081: Wrong prefixes in Wikidata RDF export

2019-08-07 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230081 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, WMDE-leszek, Lucas_Werkmeister_WMDE, Smalyshev, darthmon_wmde, DannyS712, Nandana

[Wikidata-bugs] [Maniphest] [Created] T230081: Wrong prefixes in Wikidata RDF export

2019-08-07 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Currently, Wikidata RDF export generates wrong prefixes on beta: @prefix s: <https://wikidata.beta.wmflabs.org/entity/statement/> . @prefi

[Wikidata-bugs] [Maniphest] [Commented On] T230050: OutOfBoundsException in WikibaseQualityConstraints setup on Beta Wikidata

2019-08-07 Thread Smalyshev
Smalyshev added a comment. Note also that CheckConstraintsRdf.php contains mention of `RdfVocabulary::NS_STATEMENT` which can also possibly break after this patch. TASK DETAIL https://phabricator.wikimedia.org/T230050 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Commented On] T230050: OutOfBoundsException in WikibaseQualityConstraints setup on Beta Wikidata

2019-08-07 Thread Smalyshev
Smalyshev added a comment. So it's a bit tricky since in the new scheme the entity URI actually depends on the repository. So we probably have to check all possible entity prefixes really. Another this is - do we even need `$this->prefixes`? WDQS understands all those by default alre

[Wikidata-bugs] [Maniphest] [Commented On] T230050: OutOfBoundsException in WikibaseQualityConstraints setup on Beta Wikidata

2019-08-07 Thread Smalyshev
Smalyshev added a comment. Hmm, possibly this patch changes config requirements in some incompatible way? I'll try to check what's going on. TASK DETAIL https://phabricator.wikimedia.org/T230050 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Updated] T228503: vagrant wikibase cirrus role not working / should set $wgWBCSUseCirrus = true; to enable

2019-08-07 Thread Smalyshev
Smalyshev removed a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T228503 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Tgr, Smalyshev, Aklapper, Mvolz, darthmon_wmde, ET4Eva, DannyS712, Nandana, Lahi

[Wikidata-bugs] [Maniphest] [Closed] T210044: Data corruption when loading RDF data into WDQS

2019-08-06 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev added a comment. No recent instances of this, so I think it's fixed now. TASK DETAIL https://phabricator.wikimedia.org/T210044 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Sm

[Wikidata-bugs] [Maniphest] [Assigned] T229876: blazegraph journal on wdqs1005 has doubled in space

2019-08-06 Thread Smalyshev
Smalyshev assigned this task to Gehel. TASK DETAIL https://phabricator.wikimedia.org/T229876 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Smalyshev Cc: Smalyshev, Igorkim78, Gehel, Aklapper, darthmon_wmde, Legado_Shulgin, DannyS712

[Wikidata-bugs] [Maniphest] [Triaged] T229876: blazegraph journal on wdqs1005 has doubled in space

2019-08-06 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. Smalyshev added a comment. @Gehel I think for now we need to reload the DB from other server and repool it. Let's keep an eye on this problem and see if it ever happens again. TASK DETAIL https://phabricator.wikimedia.org/T229

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T229876: blazegraph journal on wdqs1005 has doubled in space

2019-08-05 Thread Smalyshev
Smalyshev added subscribers: Igorkim78, Smalyshev. Smalyshev added a comment. The journal dump says: `There are 755560 commit points.`. Probably not a normal situation. TASK DETAIL https://phabricator.wikimedia.org/T229876 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] [Assigned] T229655: bad interaction of lang() with wikibase:label

2019-08-05 Thread Smalyshev
Smalyshev assigned this task to Igorkim78. TASK DETAIL https://phabricator.wikimedia.org/T229655 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Igorkim78, Smalyshev Cc: Smalyshev, Igorkim78, Aklapper, VladimirAlexiev, darthmon_wmde, DannyS712

[Wikidata-bugs] [Maniphest] [Updated] T222321: Make /entity/ alias work for Commons

2019-08-03 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T222321 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lucas_Werkmeister_WMDE, Tpt, Addshore, Ramsey-WMF, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] [Updated] T229608: Allow WDQS default prefixes to work with federated data

2019-08-03 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T229608 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400

[Wikidata-bugs] [Maniphest] [Commented On] T228640: WDQS missing some particular data (property P6885)

2019-08-03 Thread Smalyshev
Smalyshev added a comment. If the item has been edited since that time, it is probably not affected. If not, then it depends - whether the modification has been made before dumping code got to it or after. There's no real way for me to know it for each item, at least I don't think I know

[Wikidata-bugs] [Maniphest] [Commented On] T228640: WDQS missing some particular data (property P6885)

2019-08-03 Thread Smalyshev
Smalyshev added a comment. I've updated affected items from 2019-07-02T12:59:28 to 2019-07-03. The items between 2019-07-01T23:00:02Z and 2019-07-02T12:59:28 still may be missing updates, but since all streams from that time seem to be already purged, I can't update them, so please tell me

[Wikidata-bugs] [Maniphest] [Edited] T229608: Allow WDQS default prefixes to work with federated data

2019-08-02 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T229608 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, DannyS712, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86

[Wikidata-bugs] [Maniphest] [Edited] T229608: Allow WDQS default prefixes to work with federated data

2019-08-02 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T229608 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, DannyS712, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86

[Wikidata-bugs] [Maniphest] [Triaged] T229655: bad interaction of lang() with wikibase:label

2019-08-02 Thread Smalyshev
Smalyshev added subscribers: Igorkim78, Smalyshev. Smalyshev triaged this task as "Normal" priority. Smalyshev added a comment. @Igorkim78 I wonder if you have any idea about this. TASK DETAIL https://phabricator.wikimedia.org/T229655 EMAIL PREFERENCES https://phabricator.wik

[Wikidata-bugs] [Maniphest] [Triaged] T229634: Flaky selenium tests block merging to Wikibase

2019-08-01 Thread Smalyshev
Smalyshev triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T229634 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, darthmon_wmde, DannyS712, Nandana, Mringgaard,

[Wikidata-bugs] [Maniphest] [Created] T229634: Flaky selenium tests block merging to Wikibase

2019-08-01 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata, Lexicographical data, Wikimedia-production-error (Shared Build Failure). TASK DESCRIPTION Similar to what was reported at the past, I am getting various failures on Wikibase https://integration.wikimedia.org/ci/job/quibble

[Wikidata-bugs] [Maniphest] [Updated] T228640: WDQS missing some particular data (property P6885)

2019-08-01 Thread Smalyshev
Smalyshev added a comment. Looks like the earliest dump started at 2019-07-01T23:00:02Z and the latest at 2019-07-03T16:20:54Z. Between those dates, there might be updates missed due to T229617 <https://phabricator.wikimedia.org/T229617>. I'll try to update it but the problem is t

[Wikidata-bugs] [Maniphest] [Created] T229617: Loading dump creates multiple wikibase:Dump schema:dateModified statements

2019-08-01 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata, Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint. TASK DESCRIPTION Since RDF dumps are sharded, resulting dump contains multiple wikibase:Dump schema:dateModified statements. When starting Updater anew from fresh

[Wikidata-bugs] [Maniphest] [Triaged] T229617: Loading dump creates multiple wikibase:Dump schema:dateModified statements

2019-08-01 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T229617 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: matej_suchanek, Cyberpower678, Vojtech.dostal, Aklapper, Mormeg

[Wikidata-bugs] [Maniphest] [Triaged] T229377: Make WDQS deploy not require chrome tests

2019-08-01 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T229377 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev C

[Wikidata-bugs] [Maniphest] [Claimed] T221917: Create RDF dump of structured data on Commons

2019-08-01 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T221917 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: hoo, ArielGlenn, WMDE-leszek, Poyekhali, Steinsplitter, Aklapper, Lydia_Pintscher, Bugreporter, Tgr

[Wikidata-bugs] [Maniphest] [Claimed] T222321: Make /entity/ alias work for Commons

2019-08-01 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T222321 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lucas_Werkmeister_WMDE, Tpt, Addshore, Ramsey-WMF, Lydia_Pintscher, Aklapper, Smalyshev, Hook696, Daryl

[Wikidata-bugs] [Maniphest] [Updated] T229608: Allow WDQS default prefixes to work with federated data

2019-08-01 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T229608 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, DannyS712, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86

[Wikidata-bugs] [Maniphest] [Triaged] T229608: Allow WDQS default prefixes to work with federated data

2019-08-01 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T229608 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, DannyS712, Nandana, JKSTNK, Lahi, P

[Wikidata-bugs] [Maniphest] [Created] T229608: Allow WDQS default prefixes to work with federated data

2019-08-01 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata, SDC General, Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Right now, WDQS assumes for it's default prefix/URL system that entity and predicate prefixes come from the same host

[Wikidata-bugs] [Maniphest] [Commented On] T229482: PHP Warning: Wikibase\Lib\Store\Sql\WikiPageEntityRevisionLookup::getEntityRevision: Entity not loaded

2019-08-01 Thread Smalyshev
Smalyshev added a comment. > I'm not sure if the best solution is to change that AJAX request (or the PHP method it eventually triggers) to treat null results as non-errors, or if some other approach should be used to determine whether or not structured data exists for a given f

[Wikidata-bugs] [Maniphest] [Lowered Priority] T177734: License mismatch in wikidata-query-gui

2019-08-01 Thread Smalyshev
Smalyshev lowered the priority of this task from "High" to "Low". TASK DETAIL https://phabricator.wikimedia.org/T177734 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lydia_Pintscher, Smalyshev, Lucas_Werkmeister_W

[Wikidata-bugs] [Maniphest] [Commented On] T154260: Support language wildcard in wikibase:label service

2019-08-01 Thread Smalyshev
Smalyshev added a comment. @Esc3300 that would be a nice heuristic, except WDQS unfortunately does not have this information - labels do not carry dates attached to them, they are just simple triples. TASK DETAIL https://phabricator.wikimedia.org/T154260 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] [Updated] T209020: "scanned from multiple locations" errors when launching Blazegraph

2019-08-01 Thread Smalyshev
Smalyshev added a project: patch-welcome. TASK DETAIL https://phabricator.wikimedia.org/T209020 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Gehel, Smalyshev, darthmon_wmde, Dinadineke, DannyS712, Nandana, tabish.shaikh91

[Wikidata-bugs] [Maniphest] [Updated] T228709: Make statistics of throttled/denied WDQS clients

2019-08-01 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T228709 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Lea_Lacroix_WMDE, Lydia_Pintscher, Gehel, Smalyshev

[Wikidata-bugs] [Maniphest] [Created] T229544: Create RDF diff for WDQS updating

2019-08-01 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION Currently, when an item is updated, we download the whole RDF export representation and load

[Wikidata-bugs] [Maniphest] [Commented On] T228503: vagrant wikibase cirrus role not working

2019-07-31 Thread Smalyshev
Smalyshev added a comment. I tried to install wikibasecirrussearch with vagrant and it seems to work for me, after manually enabling `$wgWBCSUseCirrus = true;` (that part is not automatic yet). Maybe some other configurations are interfering? Are there any local configs and where do you

[Wikidata-bugs] [Maniphest] [Triaged] T228503: vagrant wikibase cirrus role not working

2019-07-31 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. Smalyshev added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T228503 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Tgr, Smalyshev

[Wikidata-bugs] [Maniphest] [Commented On] T229460: Support standard MediaWiki API continuation in wbsearchentities module / wbsearch list/generator

2019-07-31 Thread Smalyshev
Smalyshev added a comment. I think we should make use of ElasticSearch and DB capabilities for handling offsets... Though I am not sure it would not do the same thing underneath, at least we won't be loading extra results we don't need. TASK DETAIL https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] [Closed] T175840: Using label service twice in one query results in obscure error message

2019-07-30 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T175840 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Igorkim78, Smalyshev Cc: Smalyshev, Lucas_Werkmeister_WMDE, Aklapper, darthmon_wmde, ET4Eva,

[Wikidata-bugs] [Maniphest] [Updated] T212826: Create dedicated Updater service in Blazegraph

2019-07-30 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T212826 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Abbe98, EgonWillighagen, Fnielsen, Daniel_Mietchen, Aklapper

[Wikidata-bugs] [Maniphest] [Closed] T212550: Implement support for ChronologyProtection in events sent when editing Mediawiki/Wikidata

2019-07-30 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T212550 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: elukey, Ottomata, Aklapper, Smalyshev, aaron, darthmon_wmde, DannyS712, Nandana

[Wikidata-bugs] [Maniphest] [Commented On] T229377: Make WDQS deploy not require chrome tests

2019-07-30 Thread Smalyshev
Smalyshev added a comment. @dcausse I wonder if you know an easy way to do this. TASK DETAIL https://phabricator.wikimedia.org/T229377 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: dcausse, Aklapper, Smalyshev, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Created] T229377: Make WDQS deploy not require chrome tests

2019-07-30 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION Right now, when we deploy WDQS, it runs GUI tests (which is in general a good thing

[Wikidata-bugs] [Maniphest] [Triaged] T229291: Add support to more continuation modes for WDQS MWAPI

2019-07-30 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T229291 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, darthmon_wmde, DannyS712

[Wikidata-bugs] [Maniphest] [Commented On] T229291: Add support to more continuation modes for WDQS MWAPI

2019-07-30 Thread Smalyshev
Smalyshev added a comment. > Alternatively, perhaps wbsearchentities should be changed to do continuation the usual way? Would be fine with this too. Probably would have to support both elements, otherwise scripts that use current one would break? TASK DETAIL ht

[Wikidata-bugs] [Maniphest] [Triaged] T229329: WDQS Updater: java.lang.StringIndexOutOfBoundsException: String index out of range: -8

2019-07-30 Thread Smalyshev
Smalyshev triaged this task as "Lowest" priority. Smalyshev added a comment. This seems to be a problem particular to tests we're doing on wdq9 database. I'll still dig around about what was causing it (seems like there are some duplicate TermIDs there which should never happen) b

[Wikidata-bugs] [Maniphest] [Commented On] T229236: Investigate if the code of Graphoid uses a proper user agent header

2019-07-30 Thread Smalyshev
Smalyshev added a comment. > So the current user agent of graphoid service is graphoid (yurik at wikimedia) That should work though. In fact, it's better user agent than many others, even though inaccurate :) > couldn't find any request having graphoid mentioned in th

[Wikidata-bugs] [Maniphest] [Commented On] T228645: Create normalization between Q11229 (percentage) and Q181011 (per mille)

2019-07-29 Thread Smalyshev
Smalyshev added a comment. > Shouldn’t both be normalized to the “1” unit (25‰ = 2.5% = 0.025)? Well, not exactly since "1" unit means "no unit" in Wikidata right now. So I'm not sure this is right. Maybe it is... I wasn't a big fan of using "percentage"

[Wikidata-bugs] [Maniphest] [Created] T229291: Add support to more continuation modes for WDQS MWAPI

2019-07-29 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION For this user query: SELECT distinct ?ordinal ?item ?itemLabel ?itemDescription ?image

[Wikidata-bugs] [Maniphest] [Edited] T222404: Tasks requiring Blazegraph reload

2019-07-29 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T222404 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, darthmon_wmde, DannyS712, Nickleh, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Commented On] T195332: Allow alternative pagination options for LDF endpoint

2019-07-29 Thread Smalyshev
Smalyshev added a comment. > Currently one page requires 27 seconds to load That's the problem that needs to be fixed. TASK DETAIL https://phabricator.wikimedia.org/T195332 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev

[Wikidata-bugs] [Maniphest] [Edited] T222306: RDF export generates wrong IDs for federated entities

2019-07-29 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T222306 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: WMDE-leszek, Lucas_Werkmeister_WMDE, Addshore, Ramsey-WMF, Lydia_Pintscher, Aklapper

[Wikidata-bugs] [Maniphest] [Commented On] T221917: Create RDF dump of structured data on Commons

2019-07-29 Thread Smalyshev
Smalyshev added a comment. @ArielGlenn: sounds great! TASK DETAIL https://phabricator.wikimedia.org/T221917 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: hoo, ArielGlenn, WMDE-leszek, Poyekhali, Steinsplitter, Aklapper

[Wikidata-bugs] [Maniphest] [Commented On] T211130: Permanent link to a Wikidata query result

2019-07-28 Thread Smalyshev
Smalyshev added a comment. You may run the query and then store it on wiki as tabular data <https://www.mediawiki.org/wiki/Help:Tabular_Data>. TASK DETAIL https://phabricator.wikimedia.org/T211130 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailprefe

[Wikidata-bugs] [Maniphest] [Updated] T223773: MWAPI requests for external links return fewer than expected

2019-07-28 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T223773 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Esc3300, Lucas_Werkmeister_WMDE, Smalyshev, Aklapper

[Wikidata-bugs] [Maniphest] [Triaged] T228709: Make statistics of throttled/denied WDQS clients

2019-07-28 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T228709 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Lea_Lacroix_WMDE, Lydia_Pintscher, Gehel, Smalyshev, dar

[Wikidata-bugs] [Maniphest] [Commented On] T228640: WDQS missing some particular data (property P6885)

2019-07-28 Thread Smalyshev
Smalyshev added a comment. Looks like all affected items were updated on July 3, the same time where dump was generated, so I think we have some kind of timing issue between dump, updating and loading that affects some items that were updated while dump is being generated. I'll look

[Wikidata-bugs] [Maniphest] [Commented On] T213210: WDQS is hitting allocator limit on Blazegraph

2019-07-26 Thread Smalyshev
Smalyshev added a comment. Currently, the dashboard <https://grafana.wikimedia.org/d/00489/wikidata-query-service?orgId=1=now-7d=now=32> shows 246K+ allocators, and we are using up under 30 per day, so at this rate it should last us decades :) I think the problem is solved f

[Wikidata-bugs] [Maniphest] [Commented On] T228640: WDQS missing some particular data (property P6885)

2019-07-26 Thread Smalyshev
Smalyshev added a comment. @AMDmi3 I see the query returning three results, as requested. Can you please provide a query that is still wrong? TASK DETAIL https://phabricator.wikimedia.org/T228640 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Commented On] T209034: Incomplete continuation in MWAPI

2019-07-25 Thread Smalyshev
Smalyshev added a comment. See also: https://www.wikidata.org/wiki/Wikidata:Contact_the_development_team#Search_for_multiple_%28specific%29_types_via_wikibase%3Aapi_%22EntitySearch%22_running_into_50_record_limit%3F TASK DETAIL https://phabricator.wikimedia.org/T209034 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] [Commented On] T223773: MWAPI requests for external links return fewer than expected

2019-07-23 Thread Smalyshev
Smalyshev added a comment. > What is needed to run the generator just once, at least once for a given variable? If I understand right what you mean, then from https://www.mediawiki.org/wiki/Wikidata_Query_Service/User_Manual/MWAPI bd:serviceParam wikibase:limit "once&

[Wikidata-bugs] [Maniphest] [Updated] T228640: WDQS missing some particular data (property P6885)

2019-07-23 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T228640 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Mormegil, Aklapper, Vojtech.dostal, Cyberpower678

[Wikidata-bugs] [Maniphest] [Updated] T209020: "scanned from multiple locations" errors when launching Blazegraph

2019-07-23 Thread Smalyshev
Smalyshev removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T209020 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Gehel, Smalyshev, darthmon_wmde, Nandana, Sario528, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Updated] T228348: Category graph includes deleted categories

2019-07-23 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T228348 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Bugreporter, darthmon_wmde, Nandana, Sario528, Lahi

[Wikidata-bugs] [Maniphest] [Commented On] T223792: Extend mw.wikibase.getEntity lua function to allow accessing Structured Data on Commons items

2019-07-23 Thread Smalyshev
Smalyshev added a comment. > would an index of some sort be needed in order to support something like mw.wikibase.getEntity( 'File:Blah.png' ) You'd have to just access page table to look up page by title, then go to the appropriate revision & slot (AFAIR there are services

[Wikidata-bugs] [Maniphest] [Closed] T228777: EntityData of some entities is outdated

2019-07-23 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. Smalyshev added a comment. I see the data has been updated on July 3, so probably the same issue as T228640 <https://phabricator.wikimedia.org/T228640>. I manually updated affected entities and the qu

[Wikidata-bugs] [Maniphest] [Commented On] T228777: EntityData of some entities is outdated

2019-07-23 Thread Smalyshev
Smalyshev added a comment. I cannot access the first link unfortunately - archive.is giving me a timeout. Could you please list the entities you have problems with here or on some other resource that I could access? TASK DETAIL https://phabricator.wikimedia.org/T228777 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] [Created] T228709: Make statistics of throttled/denied WDQS clients

2019-07-22 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION We'd like to produce some statistics about which clients are frequently throttled/banned

[Wikidata-bugs] [Maniphest] [Commented On] T209034: Incomplete continuation in MWAPI

2019-07-22 Thread Smalyshev
Smalyshev added a comment. The code has been deployed, but I'm not sure whether it works properly as the original query still returns few results. @Lucas_Werkmeister_WMDE could you check? TASK DETAIL https://phabricator.wikimedia.org/T209034 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] [Closed] T205777: Unknown prefix wdtn: on Wikidata SPARQL

2019-07-22 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T205777 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lydia_Pintscher, Smalyshev, Aklapper, Multichill, darthmon_wmde, Nandana, Sari

[Wikidata-bugs] [Maniphest] [Edited] T205777: Unknown prefix wdtn: on Wikidata SPARQL

2019-07-22 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T205777 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lydia_Pintscher, Smalyshev, Aklapper, Multichill, darthmon_wmde, Nandana, Sario528, Lahi

<    1   2   3   4   5   6   7   8   9   10   >