[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

MPhamWMF lowered the priority of this task from "Medium" to "Low". TASK DETAIL https://phabricator.wikimedia.org/T290240 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: MPhamWMF Cc: AWesterinen, nguyenm9, AndySeaborne, Justin0x2004, Lydia_Pintscher,

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

AWesterinen added a comment. Since updates are not part of the WDQS feature set (no SPARQL INSERT/DELETE), the issues are whether 1) RDF-Delta has value for users with local installs and/or 2) improves the new stream updater. TASK DETAIL https://phabricator.wikimedia.org/T290240 EMAIL PRE

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

So9q added a comment. In T290240#7686978 , @AWesterinen wrote: > RDF-Delta can be used with Jena-Fuseki to replicate Jena DBs across servers for HA. I will be investigating it as part of the Blazegraph Alternatives analysis. I foun

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

So9q added a comment. In T290240#7328112 , @So9q wrote: > In T290240#7328110 , @Lydia_Pintscher wrote: > >> We should probably start with a problem we're be trying to solve. What wo

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

AndySeaborne added a comment. Zookeeper keeps the index, the HA storage is usually in something with an S3 interface to use as a blob store. TASK DETAIL https://phabricator.wikimedia.org/T290240 EMAIL PREFERENCES https://phabricator.wikimedia.org/se

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

nguyenm9 added a comment. @AWesterinen I suppose the concern would be if a machine were taken out of rotation for maintenance, but in the mean time there were lots of updates, can Zookeeper reliably store all the updates? Again, if I u/d RDF-Delta correctly, it's journaling all the updates

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

AndySeaborne added a comment. @nguyenm9 - RDF Delta adds the replication of updates across a number of stores (Apache jena Fuseki). TASK DETAIL https://phabricator.wikimedia.org/T290240 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndySeaborne

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

AWesterinen added a comment. I do not believe so, but will investigate it further. You CAN use Zookeeper to also create a high availability RDF-Delta service. TASK DETAIL https://phabricator.wikimedia.org/T290240 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpre

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

nguyenm9 added a comment. If I understand it correctly, RDF-Delta itself requires a replicable store for HA? TASK DETAIL https://phabricator.wikimedia.org/T290240 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: nguyenm9 Cc: AWesterinen, nguyenm9,

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

AWesterinen added a comment. RDF-Delta can be used with Jena-Fuseki to replicate Jena DBs across servers for HA. TASK DETAIL https://phabricator.wikimedia.org/T290240 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AWesterinen Cc: AWesterinen, ng

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

Gehel moved this task from All WDQS-related tasks to Scaling on the Wikidata-Query-Service board. Gehel triaged this task as "Medium" priority. TASK DETAIL https://phabricator.wikimedia.org/T290240 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES https://ph

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

Gehel added a parent task: T206560: [Epic] Evaluate alternatives to Blazegraph. TASK DETAIL https://phabricator.wikimedia.org/T290240 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Lydia_Pintscher, MPhamWMF, So9q, Aklapper, Invadibot, maant

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

So9q added a comment. In T290240#7328110 , @Lydia_Pintscher wrote: > We should probably start with a problem we're be trying to solve. What would this be for this one? Good idea. So as a data consumer I want to know which tripl

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

Lydia_Pintscher added a comment. We should probably start with a problem we're be trying to solve. What would this be for this one? TASK DETAIL https://phabricator.wikimedia.org/T290240 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lydia_Pintsc

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

Maintenance_bot added a project: Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T290240 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Maintenance_bot Cc: MPhamWMF, So9q, Aklapper, Invadibot, maantietaja, CBogen, Akuckartz, Nandana, Namenlo

[Wikidata-bugs] [Maniphest] T290240: Evaluate whether RDF Delta is a good idea to have in the backend

So9q created this task. So9q added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION https://afs.github.io/rdf-delta/ TASK DETAIL https://phabricator.wikimedia.org/T290240 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/pa