[Wikidata-bugs] [Maniphest] T304365: Add property predicates to WCQS

[dcausse]

dcausse moved this task from Incoming to Scaling on the Wikidata-Query-Service 
board.
dcausse added a comment.


  I agree that federation is adding a lot of //boiler plate// and inspecting 
the shape of the IRIs is very fragile. But merging multiple graphs into the 
same store for ease of use is going against the recent discussions we had 
around the future of the WDQS architecture, it is also a bit more complex than 
it seems within the current data flows. Nevertheless I think the concern you 
raise is very valid and should be taken into account while we figure out if 
splitting the graph and building on top SPARQL federation is something we have 
to pursue and/or if some sub-graph are very central that they'd better be 
replicated to all sub-graphs.

TASK DETAIL
  https://phabricator.wikimedia.org/T304365

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: dcausse, WikidataFacts, Aklapper, Dominicbm, Astuthiodit_1, karapayneWMDE, 
Invadibot, GFontenelle_WMF, MPhamWMF, maantietaja, FRomeo_WMF, CBogen, 
ItamarWMDE, Nintendofan885, Akuckartz, Nandana, JKSTNK, Namenlos314, Lahi, 
Gq86, E1presidente, Ramsey-WMF, Cparle, SandraF_WMF, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, 
Salgo60, Silverfish, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Susannaanas, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, matthiasmullie, 
aude, Tobias1984, Manybubbles, Ricordisamoa, Wesalius, Lydia_Pintscher, 
Raymond, Steinsplitter, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T304365: Add property predicates to WCQS

[MPhamWMF]

MPhamWMF triaged this task as "Medium" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T304365

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: WikidataFacts, Aklapper, Dominicbm, Astuthiodit_1, karapayneWMDE, 
Invadibot, GFontenelle_WMF, MPhamWMF, maantietaja, FRomeo_WMF, CBogen, 
ItamarWMDE, Nintendofan885, Akuckartz, Nandana, JKSTNK, Namenlos314, Lahi, 
Gq86, E1presidente, Ramsey-WMF, Cparle, SandraF_WMF, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, 
Salgo60, Silverfish, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Susannaanas, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, matthiasmullie, 
aude, Tobias1984, Manybubbles, Ricordisamoa, Wesalius, Lydia_Pintscher, 
Raymond, Steinsplitter, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T304365: Add property predicates to WCQS

[Maintenance_bot]

Maintenance_bot added a project: Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T304365

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: WikidataFacts, Aklapper, Dominicbm, Astuthiodit_1, karapayneWMDE, 
Invadibot, GFontenelle_WMF, MPhamWMF, maantietaja, FRomeo_WMF, CBogen, 
Nintendofan885, Akuckartz, Nandana, JKSTNK, Namenlos314, Lahi, Gq86, 
E1presidente, Ramsey-WMF, Cparle, SandraF_WMF, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, 
Salgo60, Silverfish, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Susannaanas, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, matthiasmullie, 
aude, Tobias1984, Manybubbles, Ricordisamoa, Wesalius, Lydia_Pintscher, 
Raymond, Steinsplitter, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T304365: Add property predicates to WCQS

[WikidataFacts]

WikidataFacts created this task.
WikidataFacts added projects: SDC General, Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  **Feature summary** (what you would like to be able to do and where):
  I would like to be able to write queries for WCQS that abstract over the 
predicates of a property: not only hard-code `wdt:P123`, but use the `wdt:` 
predicate associated with a given `?property`, for example.
  
  On WDQS, this is easily possible through predicates like `wikibase:claim` 
(links `wd:P123` to `p:P123`), `wikibase:directClaim` (`wdt:`),  
`wikibase:statementProperty` (`ps:`), etc. – see RDF Dump Format § Properties 
 
for a partial list. (It’s missing the normalized predicates, actually. Someone™ 
should fix that.)
  
  On WCQS, these triples are not available, since properties aren’t part of 
Commons’ data. You can get them via SPARQL federation to WDQS, or you can hack 
around their absence in other ways.
  
  Note: I am //not// asking for the full data of properties – their labels, 
statements, etc. I only propose adding the connections between a property and 
its predicates, and perhaps the `wikibase:propertyType` as well. Neither of 
these changes often, so this hopefully shouldn’t require to run a full updater 
feeding Wikidata property changes into WCQS – only some process adding a 
handful of triples for new properties as they are created. (The property type 
of a property can under rare circumstances be changed, via a maintenance 
script, but I rather suspect that we don’t even handle this in WDQS. It’s 
probably fine to leave that for the periodic full reloads.) This also further 
reduces the amount of data this adds to WCQS (though even the full data of all 
properties wouldn’t be that much data in the grand scheme of things, we haven’t 
even reached 10k properties yet.)
  
  **Use case(s)** (list the steps that you performed to discover that problem, 
and describe the actual underlying problem which you want to solve. Do not 
describe only a solution):
  
  - some unreferenced statements on entities with a DPLA ID 
,
 requested by @Dominicbm – uses federation to connect `?p` and `?ps` to the 
same property
  - some time qualifiers on MediaInfo entities 
,
 to find a test case for Module:Statement – uses `FILTER()` to limit `?pq` to a 
`pq:` predicate of a time-type property (ugly, but seemed easier than 
federation at the time)
  
  **Benefits** (why should this be implemented?):
  With this, it is easier to write queries like on WDQS. They should also 
perform faster, since plain triples (like `wikibase:claim` and friends) are, as 
far as I’m aware, more efficient to evaluate than either federation or 
`FILTER(CONTAINS(STR(?pq), "qual"))` hacks.

TASK DETAIL
  https://phabricator.wikimedia.org/T304365

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: WikidataFacts
Cc: WikidataFacts, Aklapper, Dominicbm, GFontenelle_WMF, MPhamWMF, FRomeo_WMF, 
CBogen, Nintendofan885, JKSTNK, Namenlos314, Lahi, Gq86, E1presidente, 
Ramsey-WMF, Cparle, SandraF_WMF, Lucas_Werkmeister_WMDE, EBjune, Tramullas, 
Acer, merbst, Salgo60, Silverfish, Jonas, Xmlizer, Susannaanas, Jane023, 
jkroll, Wikidata-bugs, Jdouglas, Base, matthiasmullie, aude, Tobias1984, 
Manybubbles, Ricordisamoa, Wesalius, Lydia_Pintscher, Raymond, Steinsplitter
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org