erik_s_paulson created this task. erik_s_paulson added a project: Wikidata. Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION Hello, I would like to understand if it is possible to export data from a Wikibase instance and import it into another Wikibase instance without loss of fidelity. Let’s say that I have a simple wikibase instance with three entities P1 <https://phabricator.wikimedia.org/P1> locatedIn Q1 State of Wisconsin Q2 City of Madison And there’s a statement on Q2 Q2 P1 <https://phabricator.wikimedia.org/P1> Q1 (Madison is locatedIn Wisconsin) The specific scenario I am considering is if my dataset lives in a hosted wikibase provider like WBStack, and if WBStack decides to shutdown, I would like to be able to migrate the content of my WBstack instance to another wikibase instance, but I would like all of the identifiers on the entities to remain consistent when I import them into the new wikibase, e.g. I want my new Wikibase to have the P1 <https://phabricator.wikimedia.org/P1>, Q1, and Q2 with the same meanings. This is important because I want queries like ?city P1 <https://phabricator.wikimedia.org/P1> Q1 to work without having to be updated for new P and Q numbers, since queries will be part of my scripts and applications - all external to my Wikibase and won’t be updated as part of any automated import tools. I am not excited about MySQL dumps as the interchange format, because I worry that it ties the dump to a specific version of Wikibase - say I have a dump of my wikibase from running 1.34, but WBStack is running Wikibase 1.36 - will I be able to import my backup into WBstack? Does a hosted provider really want to import sites using MySQL dumps? To further clarify: I am specifically focused on getting data into Wikibase, and not just using the contents of a Wikibase in a triplestore like BlazeGraph/WDQS. If there is a clear path to import an RDF export of a Wikibase back into Wikibase itself, I would be happy to go that route, but I don’t believe that is possible today. Note that I am also not (necessarily) asking for a Wikidata dump to be produced in this format, though I could imagine that many people would find that useful to create a local mirror of Wikidata in their own Wikibase. I do think that in the end what I would like to be able to do is create entities in Wikibase with specific identifiers, e.g. I want to be able to start a blank wikibase and create a new entity with Q43788 without having to create 43,777 empty items first (Q43788 is Madison, WI on Wikidata.) But to be clear, I am not asking for any sort of guaranteed identifier sync with Wikidata. Even if I create Q43788 as ‘Madison WI’ in my local, non-Wikidata instance of Wikibase, I do not expect Wikidata would in any way try to respect any P or Q numbers I might create in my local wikibase, and I would take responsibility for conflict management in my own wikibase, e.g. it is my problem if I try to merge two wikibase instances that have different ideas of what Q42 should represent. My ask might be as simple as “I want to be able create wikibase entities by supplying my own IDs, instead of Wikibase issuing the IDs”, but I am still exploring Wikibase and I suspect the full story is more involved. Thank you for all of your work on wikibase and wikidata! TASK DETAIL https://phabricator.wikimedia.org/T247220 WORKBOARD https://phabricator.wikimedia.org/project/board/71/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: erik_s_paulson Cc: Samantha_Alipio_WMDE, erik_s_paulson, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
