[Wikidata-bugs] [Maniphest] [Unassigned] T238153: puppet breakage in the wikidata-query VPS project

2020-03-11 Thread Smalyshev
Smalyshev removed Smalyshev as the assignee of this task. TASK DETAIL https://phabricator.wikimedia.org/T238153 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Addshore, Gehel, Mathew.onipe, Aklapper, Andrew, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Commented On] T239414: Investigate how blank nodes are used and synced between wikibase and wdqs

2019-11-29 Thread Smalyshev
Smalyshev added a comment. Blanks are used as representation of "unknown value" in Wikibase. Also, they are used (completely unrelatedly) in implementation of OWL class that describes "no value" properties (as "no value" is not a value, it is implemented w

[Wikidata-bugs] [Maniphest] [Commented On] T238002: WDQS Munger should be multi threaded

2019-11-11 Thread Smalyshev
Smalyshev added a comment. Per-item data are mostly independent, so different items can be easily processable in parallel, however that would require splitting the incoming data per item (note that item data not necessarily have item URI as subject - there are statements, references, values

[Wikidata-bugs] [Maniphest] [Commented On] T237502: Provide public "reload entity to WDQS" API

2019-11-06 Thread Smalyshev
Smalyshev added a comment. > Actually these WDQS servers are merely reading RCStream Or rather, Kafka topics that feed into RCStream. Adding a message there would probably be the easiest way to trigger the update. Also, note that Updater reads multiple topics, so you can make separ

[Wikidata-bugs] [Maniphest] [Commented On] T197658: Provide easy script to reset Blazegraph

2019-10-31 Thread Smalyshev
Smalyshev added a comment. In T197658#5619433 <https://phabricator.wikimedia.org/T197658#5619433>, @Lucas_Werkmeister_WMDE wrote: > I believe `munge.sh` applies the WDQS data differences <https://www.mediawiki.org/wiki/Wikibase/Indexing/RDF_Dump_Format#WDQS_data_differences&

[Wikidata-bugs] [Maniphest] [Commented On] T235540: SPARQL query causes StackOverflowError and fails to execute

2019-10-15 Thread Smalyshev
Smalyshev added a comment. Our fork is in https://github.com/wikimedia/wikidata-query-blazegraph TASK DETAIL https://phabricator.wikimedia.org/T235540 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] [Commented On] T233204: Mixup of unicode characters in Query Service

2019-09-30 Thread Smalyshev
Smalyshev added a comment. The issue is that by default Blazegraph uses tertiary <http://userguide.icu-project.org/collation/concepts> ICU collation level IIRC (I can check specific one) so it ignores some differences like that one - generating same term key for both. It can be sw

[Wikidata-bugs] [Maniphest] [Commented On] T232984: WDQS returns reduced precision for coordinate values

2019-09-26 Thread Smalyshev
Smalyshev added a comment. @seav Please explain the case for millimeter-precision coordinates. Which objects in Wikidata have locations known with millimeter precision? TASK DETAIL https://phabricator.wikimedia.org/T232984 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] [Commented On] T232984: WDQS returns reduced precision for coordinate values

2019-09-26 Thread Smalyshev
Smalyshev added a comment. 4 digits is 11m precision, 5 digits is 1m precisions. We could bump the max to 5 digits I presume, but I am not sure which coordinates really have that many significant digits and whether these coordinates indeed are precise within meter or just claim to be so

[Wikidata-bugs] [Maniphest] [Commented On] T233204: Mixup of unicode characters in Query Service

2019-09-18 Thread Smalyshev
Smalyshev added a comment. Probably related to other issues about Unicode and to ICU collation level. I presume collation level enabled now at Blazegraph confuses these two. TASK DETAIL https://phabricator.wikimedia.org/T233204 EMAIL PREFERENCES https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] [Commented On] T232212: QuantityValue quantityUnit contains both Q and P value in Wikidata Query Service - P value is wrong

2019-09-09 Thread Smalyshev
Smalyshev added a comment. I don't think it's worth bothering with depooling, unless the number of affected items is very large, it should be quick enough so nobody should really notice. TASK DETAIL https://phabricator.wikimedia.org/T232212 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] [Commented On] T232212: QuantityValue quantityUnit contains both Q and P value in Wikidata Query Service - P value is wrong

2019-09-06 Thread Smalyshev
Smalyshev added a comment. This may happen because value nodes are not updated when data is updated (since they are supposed to be immutable). So if some bad data sneaked in when the problem was there, the bad value (and possibly reference since they behave the same way) nodes are still

[Wikidata-bugs] [Maniphest] [Unassigned] T221917: Create RDF dump of structured data on Commons

2019-09-03 Thread Smalyshev
Smalyshev removed Smalyshev as the assignee of this task. TASK DETAIL https://phabricator.wikimedia.org/T221917 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: jleedev, hoo, ArielGlenn, WMDE-leszek, Poyekhali, Steinsplitter, Aklapper

[Wikidata-bugs] [Maniphest] [Commented On] T221631: Dedicated servers on WMCS to test WDQS scalability strategy

2019-09-03 Thread Smalyshev
Smalyshev added a comment. Both evaluating Virtuoso and other solutions (like JanusGraph) would require that. @Gehel should know the details. TASK DETAIL https://phabricator.wikimedia.org/T221631 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Updated] T168876: MWAPI service throws “could not find binding for parameter” if optimizer is not disabled

2019-08-29 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T168876 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: robbi5, Smalyshev, Lucas_Werkmeister_WMDE, Aklapper, Hook696

[Wikidata-bugs] [Maniphest] [Updated] T168876: MWAPI service throws “could not find binding for parameter” if optimizer is not disabled

2019-08-29 Thread Smalyshev
Smalyshev removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T168876 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: robbi5, Smalyshev, Lucas_Werkmeister_WMDE, Aklapper, darthmon_wmde, ET4Eva, DannyS712

[Wikidata-bugs] [Maniphest] [Updated] T170704: NME when using label service and rdfs:label predicate with the same variable

2019-08-29 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T170704 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lucas_Werkmeister_WMDE, PokestarFan, Mbch331, Smalyshev, Jonas

[Wikidata-bugs] [Maniphest] [Unassigned] T228348: Category graph includes deleted categories

2019-08-29 Thread Smalyshev
Smalyshev removed Smalyshev as the assignee of this task. TASK DETAIL https://phabricator.wikimedia.org/T228348 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Mathew.onipe, Gehel, Aklapper, Bugreporter, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Commented On] T231515: Duplicate wdno: clauses on edited properties

2019-08-29 Thread Smalyshev
Smalyshev added a comment. Looks like new updater actually handles it better, but we need to verify that. TASK DETAIL https://phabricator.wikimedia.org/T231515 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Igorkim78, Gehel

[Wikidata-bugs] [Maniphest] [Created] T231515: Duplicate wdno: clauses on edited properties

2019-08-29 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION Part of property description is a clause that looks like this: wdno:P3418 a owl:Class

[Wikidata-bugs] [Maniphest] [Triaged] T231411: Test new Updater service

2019-08-29 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T231411 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel, Igorkim78, Aklapper, Daniel_Mietchen, Fnielsen, EgonWillighage

[Wikidata-bugs] [Maniphest] [Commented On] T231411: Test new Updater service

2019-08-29 Thread Smalyshev
Smalyshev added a comment. Loading 1 hour 25 mins of updates from 20190801 under both updaters shows no differences except ones that can be attributed to edits (since we always load the latest version on old changes). So this first test seems to be a success. TASK DETAIL https

[Wikidata-bugs] [Maniphest] [Edited] T231411: Test new Updater service

2019-08-29 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T231411 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel, Igorkim78, Aklapper, Daniel_Mietchen, Fnielsen, EgonWillighagen, Abbe98, Smalyshev

[Wikidata-bugs] [Maniphest] [Commented On] T231411: Test new Updater service

2019-08-28 Thread Smalyshev
Smalyshev added a comment. Procedure for comparing journals: Given two journals `wikidata.jnl.1` and `wikidata.jnl.2` and accompanying properties files, dump triples: # dump jnl1 java -Dlogback.configurationFile=./logback.xml -cp warlib/*:warlib/*.jar

[Wikidata-bugs] [Maniphest] [Edited] T168876: MWAPI service throws “could not find binding for parameter” if optimizer is not disabled

2019-08-28 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T168876 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: robbi5, Smalyshev, Lucas_Werkmeister_WMDE, Aklapper, Hook696, Daryl-TTMG, RomaAmorRoma

[Wikidata-bugs] [Maniphest] [Updated] T159723: NotMaterializedException when one branch of UNION binds ?variable and other branch binds ?variableLabel and label service is used

2019-08-28 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T159723 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Aklapper, WikidataFacts, Hook696, Daryl-TTMG

[Wikidata-bugs] [Maniphest] [Updated] T172113: ConcurrentModificationException on non-grouping query with aggregates in SELECT

2019-08-28 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T172113 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: WikidataFacts, Esc3300, Aklapper, Smalyshev

[Wikidata-bugs] [Maniphest] [Updated] T168741: SELECT * on query with no variables and property path results in NotMaterializedException

2019-08-28 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T168741 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Aklapper, WikidataFacts, Hook696, Daryl-TTMG

[Wikidata-bugs] [Maniphest] [Updated] T173243: UnsupportedOperationException on property path in EXISTS

2019-08-28 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T173243 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, PokestarFan

[Wikidata-bugs] [Maniphest] [Updated] T165559: HAVING in named subquery results in “non-aggregate variable in select expression” error

2019-08-28 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T165559 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG

[Wikidata-bugs] [Maniphest] [Commented On] T212826: Create dedicated Updater service in Blazegraph

2019-08-28 Thread Smalyshev
Smalyshev added a comment. Testing on wdqs-test shows new Updater is 2x faster than old one. Didn't verify validity yet but speed looks good :) TASK DETAIL https://phabricator.wikimedia.org/T212826 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Created] T231411: Test new Updater service

2019-08-28 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata, Wikidata-Query-Service, Performance, Discovery-Wikidata-Query-Service-Sprint. TASK DESCRIPTION Before we deploy new Updater service into production, we want to test it thoroughly, since problems in the updater would lead

[Wikidata-bugs] [Maniphest] [Triaged] T230175: Provide search functionality to find all files that have at least 1 structured data statement

2019-08-28 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T230175 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson, Smalyshev Cc: simon04, Bugreporter, Ramsey-WMF, Aklapper, darthmon_wmde,

[Wikidata-bugs] [Maniphest] [Closed] T222306: RDF export generates wrong IDs for federated entities

2019-08-28 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T222306 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: WMDE-leszek, Lucas_Werkmeister_WMDE, Addshore,

[Wikidata-bugs] [Maniphest] [Unblock] T221916: Create RDF export for structured data stored for files

2019-08-28 Thread Smalyshev
Smalyshev closed subtask T222306: RDF export generates wrong IDs for federated entities as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T221916 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: WMDE-leszek, Poyekhali

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T228348: Category graph includes deleted categories

2019-08-27 Thread Smalyshev
Smalyshev added subscribers: Gehel, Mathew.onipe. Smalyshev added a comment. After the patch is merged and deployed, categories DB needs to be re-loaded according to procedure here: https://wikitech.wikimedia.org/wiki/Wikidata_query_service#Categories_reload_procedure I recommend doing

[Wikidata-bugs] [Maniphest] [Commented On] T228348: Category graph includes deleted categories

2019-08-27 Thread Smalyshev
Smalyshev added a comment. Looks like DELETE SPARQL clauses that the daily dump is generating are wrong... Weird I haven't noticed it. TASK DETAIL https://phabricator.wikimedia.org/T228348 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Commented On] T228348: Category graph includes deleted categories

2019-08-27 Thread Smalyshev
Smalyshev added a comment. Looks like there's some problem with deletion handling. E.g. https://en.wikipedia.org/wiki/Category:Delaware_elections,_2006 has been deleted and is listed in enwiki-20190826-daily.sparql.gz dump as deleted, but still present in the database. Strangely enough

[Wikidata-bugs] [Maniphest] [Updated] T231390: MWAPI can only match one result per page

2019-08-27 Thread Smalyshev
Smalyshev merged a task: T223773: MWAPI requests for external links return fewer than expected. Smalyshev added subscribers: MartinPoulter, Esc3300, Lucas_Werkmeister_WMDE. TASK DETAIL https://phabricator.wikimedia.org/T231390 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] [Merged] T223773: MWAPI requests for external links return fewer than expected

2019-08-27 Thread Smalyshev
Smalyshev closed this task as a duplicate of T231390: MWAPI can only match one result per page. TASK DETAIL https://phabricator.wikimedia.org/T223773 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Esc3300, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] [Updated] T223773: MWAPI requests for external links return fewer than expected

2019-08-27 Thread Smalyshev
Smalyshev added a comment. I've created T231390: MWAPI can only match one result per page <https://phabricator.wikimedia.org/T231390> for handling the multiple values in one result issue. TASK DETAIL https://phabricator.wikimedia.org/T223773 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] [Created] T231390: MWAPI can only match one result per page

2019-08-27 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION When doing MWAPI query <https://www.mediawiki.org/wiki/Wikidata_Query_Service/User_Man

[Wikidata-bugs] [Maniphest] [Triaged] T230862: Create a way to filter only WB-related changes from Commons recentchanges

2019-08-27 Thread Smalyshev
Smalyshev triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T230862 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Anomie, daniel, Aklapper, Lydia_Pintscher, Tgr, Ramsey-WMF, Add

[Wikidata-bugs] [Maniphest] [Edited] T222321: Make /entity/ alias work for Commons

2019-08-27 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T222321 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Smalyshev Cc: Abbe98, Lucas_Werkmeister_WMDE, Tpt, Addshore, Ramsey-WMF, Lydia_Pintscher, Aklapper

[Wikidata-bugs] [Maniphest] [Reassigned] T222321: Make /entity/ alias work for Commons

2019-08-27 Thread Smalyshev
Smalyshev reassigned this task from Smalyshev to Gehel. TASK DETAIL https://phabricator.wikimedia.org/T222321 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Smalyshev Cc: Abbe98, Lucas_Werkmeister_WMDE, Tpt, Addshore, Ramsey-WMF

[Wikidata-bugs] [Maniphest] [Commented On] T230862: Create a way to filter only WB-related changes from Commons recentchanges

2019-08-27 Thread Smalyshev
Smalyshev added a comment. RecentChanges has many flaws (for example, it is not a reliable stream as timestamps are not sequential and it can't be queried by RC ID - see https://gerrit.wikimedia.org/r/c/mediawiki/core/+/302368) but it is the only way to get change stream for a wiki without

[Wikidata-bugs] [Maniphest] [Commented On] T230288: Allow CHUNK value to be passed in as an option for munge.sh

2019-08-27 Thread Smalyshev
Smalyshev added a comment. @Addshore 0.3.2 should be up already. TASK DETAIL https://phabricator.wikimedia.org/T230288 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Denny, Addshore, Aklapper, darthmon_wmde, DannyS712

[Wikidata-bugs] [Maniphest] [Claimed] T228348: Category graph includes deleted categories

2019-08-27 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T228348 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Bugreporter, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] [Triaged] T231264: Lexeme tests produce errors on merge

2019-08-26 Thread Smalyshev
Smalyshev triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T231264 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, darthmon_wmde, DannyS712, Nandana, Mringgaard,

[Wikidata-bugs] [Maniphest] [Created] T231264: Lexeme tests produce errors on merge

2019-08-26 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Lexicographical data, Wikimedia-production-error (Shared Build Failure). Restricted Application added a project: Wikidata. TASK DESCRIPTION When trying to merge Wikibase patches ([[ 04:44:23 There were 3 errors: 04:44:23 04:44:23 1

[Wikidata-bugs] [Maniphest] [Closed] T229377: Make WDQS deploy not require chrome tests

2019-08-26 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev removed a project: Patch-For-Review. Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T229377 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehe

[Wikidata-bugs] [Maniphest] [Commented On] T221917: Create RDF dump of structured data on Commons

2019-08-26 Thread Smalyshev
Smalyshev added a comment. I tried to manually dump the mediainfo entries over the weekend, it took 376 minutes for 4 shards (a lot, but less than I expected) and produces 1724656 items. Does not seem to produce significant load on DB so far - but it gives about 20 items/second, which seems

[Wikidata-bugs] [Maniphest] [Closed] T230288: Allow CHUNK value to be passed in as an option for munge.sh

2019-08-26 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T230288 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Denny, Addshore, Aklapper, darthmon_wmde, DannyS712, Nandana,

[Wikidata-bugs] [Maniphest] [Commented On] T229608: Support SDC URIs in WDQS URI schemes

2019-08-25 Thread Smalyshev
Smalyshev added a comment. @Multichill eventually yes, but since they are not being used anywhere yet it's too early to document them. Once RDF export is properly set up to use these prefixes then we can document them officially. TASK DETAIL https://phabricator.wikimedia.org/T229608

[Wikidata-bugs] [Maniphest] [Closed] T230244: Restore wdqs1009 to its role as auto-deploy testing

2019-08-23 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230244 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel, Aklapper, Smalyshev, darthmon_wmde,

[Wikidata-bugs] [Maniphest] [Triaged] T230244: Restore wdqs1009 to its role as auto-deploy testing

2019-08-23 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T230244 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel, Aklapper, Smalyshev, darthmon_wmde, DannyS712, Nandana,

[Wikidata-bugs] [Maniphest] [Unblock] T141602: [Story] Provide a SPARQL query service for structured data on Commons

2019-08-22 Thread Smalyshev
Smalyshev closed subtask T229608: Support SDC URIs in WDQS URI schemes as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T141602 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Nemo_bis, Husky, jleedev, Silverfish, Ainali

[Wikidata-bugs] [Maniphest] [Closed] T229608: Support SDC URIs in WDQS URI schemes

2019-08-22 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T229608 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, E.

[Wikidata-bugs] [Maniphest] [Closed] T230974: New lexemes missing in Wikidata Query Service

2019-08-22 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. Smalyshev added a comment. All should be updated now. TASK DETAIL https://phabricator.wikimedia.org/T230974 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Sm

[Wikidata-bugs] [Maniphest] [Lowered Priority] T230974: New lexemes missing in Wikidata Query Service

2019-08-22 Thread Smalyshev
Smalyshev lowered the priority of this task from "Unbreak Now!" to "Normal". Smalyshev added a comment. Immediate RDF breakage fixed, now I'll have to update lexemes that were affected. TASK DETAIL https://phabricator.wikimedia.org/T230974 EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T230244: Restore wdqs1009 to its role as auto-deploy testing

2019-08-22 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T230244 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel, Aklapper, Smalyshev, darthmon_wmde, DannyS712, Nandana

[Wikidata-bugs] [Maniphest] [Edited] T230244: Restore wdqs1009 to its role as auto-deploy testing

2019-08-22 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230244 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel, Aklapper, Smalyshev, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Triaged] T230974: New lexemes missing in Wikidata Query Service

2019-08-22 Thread Smalyshev
Smalyshev triaged this task as "Unbreak Now!" priority. Restricted Application added a subscriber: Liuxinyu970226. TASK DETAIL https://phabricator.wikimedia.org/T230974 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Liux

[Wikidata-bugs] [Maniphest] [Commented On] T230974: New lexemes missing in Wikidata Query Service

2019-08-22 Thread Smalyshev
Smalyshev added a comment. RDF generated is: :L60296 a ontolex:LexicalEntry ; rdfs:label "zimangiran"@ku ; wikibase:lemma "zimangiran"@ku ; dct:language :Q36368 ; wikibase:lexicalCategory :Q34698 ; ontolex:le

[Wikidata-bugs] [Maniphest] [Commented On] T230974: New lexemes missing in Wikidata Query Service

2019-08-22 Thread Smalyshev
Smalyshev added a comment. We're getting: wdq6: 17:16:23.890 [update 0] WARN org.wikidata.query.rdf.tool.Updater - Contained error syncing. Giving up on L60296 org.wikidata.query.rdf.tool.exception.ContainedException: RDF parsing error for https://www.wikidata.org/wiki

[Wikidata-bugs] [Maniphest] [Commented On] T230862: Create a way to filter only WB-related changes from Commons recentchanges

2019-08-21 Thread Smalyshev
Smalyshev added a comment. Tags should work, at least for now, I think, if I can filter by tag efficiently. There's not a lot of data edits so far, compared to overall Commons edit volume. Eventually, I'd like to be able to select all edits that touch particular slot (even if it also

[Wikidata-bugs] [Maniphest] [Updated] T228348: Category graph includes deleted categories

2019-08-21 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T228348 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Bugreporter, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Retitled] T229608: Support SDC URIs in WDQS URI schemes

2019-08-21 Thread Smalyshev
Smalyshev renamed this task from "Allow WDQS default prefixes to work with federated data" to "Support SDC URIs in WDQS URI schemes". Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T229608 EMAIL PREFERENCES https://phabricator.wi

[Wikidata-bugs] [Maniphest] [Closed] T230410: wdqs updater processing events but not finding anything useful

2019-08-21 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T230410 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Addshore, jijiki, Aklapper, Mathew.onipe, Smalys

[Wikidata-bugs] [Maniphest] [Created] T230862: Create a way to filter only WB-related changes from Commons recentchanges

2019-08-21 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata, Commons, SDC General, Wikidata-Query-Service, MediaWiki-API. Restricted Application added a project: Core Platform Team. TASK DESCRIPTION Right now one of the ways we fetch change data - and only one available outside WMF

[Wikidata-bugs] [Maniphest] [Commented On] T230856: RDF dump performance for SDC

2019-08-20 Thread Smalyshev
Smalyshev added a comment. Probably not a lot. Search for English labels returns <https://commons.wikimedia.beta.wmflabs.org/w/index.php?sort=relevance=haslabel%3Aen=Special%3ASearch=advanced=1=%7B%7D=1=1=1=1=1=1> 188 results, unfortunately search for statements and every label doesn'

[Wikidata-bugs] [Maniphest] [Created] T230856: RDF dump performance for SDC

2019-08-20 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata, Commons, SDC General, Wikidata-Query-Service, WikibaseMediaInfo, Dumps-Generation. TASK DESCRIPTION I did a small test of RDF dump generation for SDC/mediainfo. Elasticsearch data shows that there are about 500k files on Commons

[Wikidata-bugs] [Maniphest] [Triaged] T230840: Set up proper prefix configuration for RDF export on Commons

2019-08-20 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T230840 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lucas_Werkmeister_WMDE, Tpt, Addshore, Jarekt, Ramsey-WMF, Lydia

[Wikidata-bugs] [Maniphest] [Retitled] T230840: Set up proper prefix configuration for RDF export on Commons

2019-08-20 Thread Smalyshev
Smalyshev renamed this task from "Set up proper configuration for RDF export on Commons" to "Set up proper prefix configuration for RDF export on Commons". TASK DETAIL https://phabricator.wikimedia.org/T230840 EMAIL PREFERENCES https://phabricator.wikimedi

[Wikidata-bugs] [Maniphest] [Created] T230840: Set up proper configuration for RDF export on Commons

2019-08-20 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata, Commons, SDC General, Wikidata-Query-Service, WikibaseMediaInfo. TASK DESCRIPTION Right now Commons are able to produce RDF, but prefixes are all wrong: wdata:M40538870 a schema:Dataset ; schema:about wd:M40538870

[Wikidata-bugs] [Maniphest] [Assigned] T212826: Create dedicated Updater service in Blazegraph

2019-08-20 Thread Smalyshev
Smalyshev assigned this task to Igorkim78. TASK DETAIL https://phabricator.wikimedia.org/T212826 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Igorkim78, Smalyshev Cc: Abbe98, EgonWillighagen, Fnielsen, Daniel_Mietchen, Aklapper, Smalyshev

[Wikidata-bugs] [Maniphest] [Commented On] T230288: Allow CHUNK value to be passed in as an option for munge.sh

2019-08-19 Thread Smalyshev
Smalyshev added a comment. @Addshore I was planning to do 0.3.2 pretty soon, if that is easier for you you could use that. TASK DETAIL https://phabricator.wikimedia.org/T230288 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc

[Wikidata-bugs] [Maniphest] [Updated] T230759: Create a service to query Common-hosted tabular data

2019-08-19 Thread Smalyshev
Smalyshev closed this task as a duplicate of T181319: Support external tabular datasets in WDQS. TASK DETAIL https://phabricator.wikimedia.org/T230759 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Bugreporter, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Merged] T181319: Support external tabular datasets in WDQS

2019-08-19 Thread Smalyshev
Smalyshev merged a task: T230759: Create a service to query Common-hosted tabular data. Smalyshev added a subscriber: Bugreporter. TASK DETAIL https://phabricator.wikimedia.org/T181319 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc

[Wikidata-bugs] [Maniphest] [Commented On] T230755: WDQS labs role role::wdqs::labs creates /srv/wdqs/blazegraph with wrong permissions

2019-08-19 Thread Smalyshev
Smalyshev added a comment. Though maybe creating empty wikidata.jnl under blazegraph user is ok... Not sure. TASK DETAIL https://phabricator.wikimedia.org/T230755 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel, Aklapper

[Wikidata-bugs] [Maniphest] [Created] T230755: WDQS labs role role::wdqs::labs creates /srv/wdqs/blazegraph with wrong permissions

2019-08-19 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION `role::wdqs::labs` creates `/srv/wdqs/blazegraph` owned by `deploy-service:deploy-service

[Wikidata-bugs] [Maniphest] [Retitled] T230754: WDQS labs role role::wdqs::labs fails when not finding /srv/wdqs

2019-08-19 Thread Smalyshev
Smalyshev renamed this task from "WDQS labs role role::wdqs::labs role fails when not finding /srv/wdqs" to "WDQS labs role role::wdqs::labs fails when not finding /srv/wdqs". TASK DETAIL https://phabricator.wikimedia.org/T230754 EMAIL PREFERENCES https://phabricator.wi

[Wikidata-bugs] [Maniphest] [Created] T230754: WDQS labs role role::wdqs::labs role fails when not finding /srv/wdqs

2019-08-19 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION When trying to install new host for role::wdqs::labs role it fails to deploy because it looks

[Wikidata-bugs] [Maniphest] [Updated] T230750: dpkg error when using role::wdqs::labs role

2019-08-19 Thread Smalyshev
Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a project: Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T230750 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel, Aklapper, Smalyshev

[Wikidata-bugs] [Maniphest] [Closed] T221916: Create RDF export for structured data stored for files

2019-08-19 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev added a comment. I think this is done since the export now exists and is enabled, we can tweak the specifics in follow-up tasks. TASK DETAIL https://phabricator.wikimedia.org/T221916 EMAIL PREFERENCES https://phabricator.wik

[Wikidata-bugs] [Maniphest] [Unblock] T141602: [Story] Provide a SPARQL query service for structured data on Commons

2019-08-19 Thread Smalyshev
Smalyshev closed subtask T221916: Create RDF export for structured data stored for files as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T141602 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Husky, jleedev, Silverfish

[Wikidata-bugs] [Maniphest] [Commented On] T222306: RDF export generates wrong IDs for federated entities

2019-08-19 Thread Smalyshev
Smalyshev added a comment. https://federated-commons.wmflabs.org/wiki/Special:EntityData/M10694.ttl?flavor=dump looks good to me now. Anything else missing? TASK DETAIL https://phabricator.wikimedia.org/T222306 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Unblock] T221917: Create RDF dump of structured data on Commons

2019-08-19 Thread Smalyshev
Smalyshev closed subtask T221916: Create RDF export for structured data stored for files as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T221917 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: jleedev, hoo, ArielGlenn, WMDE

[Wikidata-bugs] [Maniphest] [Commented On] T230588: Wikidata Query Service is swapping items and properties

2019-08-19 Thread Smalyshev
Smalyshev added a comment. Hmm looks like I updated all Qs but forgot about some Ps... These should be fine now. TASK DETAIL https://phabricator.wikimedia.org/T230588 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: bennofs, Magnus

[Wikidata-bugs] [Maniphest] [Closed] T230588: Wikidata Query Service is swapping items and properties

2019-08-18 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev added a comment. Should be back to normal now. TASK DETAIL https://phabricator.wikimedia.org/T230588 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Magnus, Robby, Mmar

[Wikidata-bugs] [Maniphest] [Closed] T228297: Re-evaluate supporting dcatap namespace

2019-08-18 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T228297 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lokal_Profil, Bugreporter, Salgo60, WMDE-leszek, nichtich, Gehel, Lydia

[Wikidata-bugs] [Maniphest] [Claimed] T230588: Wikidata Query Service is swapping items and properties

2019-08-15 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T230588 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Manu1400, Lucas_Werkmeister_WMDE, Smalyshev, Moebeus, Aklapper, Fnielsen, darthmon_wmde, DannyS712

[Wikidata-bugs] [Maniphest] [Commented On] T230588: Wikidata Query Service is swapping items and properties

2019-08-15 Thread Smalyshev
Smalyshev added a comment. > Furthermore, https://query.wikidata.org/css/embed.style.min.fa3ff6a142279256ede4.css gives 404 Works fine for me. TASK DETAIL https://phabricator.wikimedia.org/T230588 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferen

[Wikidata-bugs] [Maniphest] [Commented On] T230588: Wikidata Query Service is swapping items and properties

2019-08-15 Thread Smalyshev
Smalyshev added a comment. Looks like Belgium is back to Q31 and cats are cats again. I will investigate what happened to the URIs (most likely the order in the dictionary switched somehow because of changing of underlying storage class but I have missed it since the content

[Wikidata-bugs] [Maniphest] [Commented On] T230588: Wikidata Query Service is swapping items and properties

2019-08-15 Thread Smalyshev
Smalyshev added a comment. Probably my fault, I've deployed new WDQS with some URL refactoring, but looks like something went wrong with URI scheme. I will be rolling it back. TASK DETAIL https://phabricator.wikimedia.org/T230588 EMAIL PREFERENCES https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] [Closed] T229876: blazegraph journal on wdqs1005 has doubled in space

2019-08-15 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T229876 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Smalyshev Cc: Addshore, Smalyshev, Igorkim78, Gehel, Aklapper, darthmon_wmde, Lega

[Wikidata-bugs] [Maniphest] [Triaged] T230288: Allow CHUNK value to be passed in as an option for munge.sh

2019-08-15 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. Smalyshev added a comment. This should not be hard to do. TASK DETAIL https://phabricator.wikimedia.org/T230288 EMAIL PREFERENCES https://phabricator.wik

[Wikidata-bugs] [Maniphest] [Edited] T230244: Restore wdqs1009 to its role as auto-deploy testing

2019-08-14 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T230244 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel, Aklapper, Smalyshev, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild

[Wikidata-bugs] [Maniphest] [Closed] T174504: Coordinates are exported into RDF with excessive precision

2019-08-14 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T174504 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: thiemowmde, daniel, Aklapper, Smalyshev, darthmon_wmde, ET4Eva, DannyS712, Nan

[Wikidata-bugs] [Maniphest] [Closed] T161991: Whether a data type should be treated as a reference type in RDF should be defined in WikibaseRepo.datatypes.php

2019-08-14 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T161991 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Aklapper, daniel, darthmon_wmde, ET4Eva, DannyS712, Nandana,

  1   2   3   4   5   6   7   8   9   10   >