daniel moved this task from Inbox to Backlog on the TechCom-RFC board. daniel added a subscriber: mobrovac. daniel added a comment.
Moved to the RFC backlog for improvement after discussion at the TechCom meeting. The proposed functionality seems sensible enough, but this ticket is lacking information about system design that is needed to make this viable as an RFC. Most importantly, the proposal assumes the existence of a "more permanent storage solution" which is not readily available. This would have to be created. Which raises a number of questions, like: - what volume of data do you expect that store to hold? - should data ever be evicted? Does it *have* to be evicted? - how bad is it if we lose some data unexpectedly? How bad is it for all the data to become unavailable? - what's the read/write load? - what are the requirements for cross-DC replication? - what transactional consistency requirements exist? - what's the access pattern? Is a plain K/V store sufficient, or are other kinds of indexes/queries needed? Also, so you have a specific storage technology in mind? In discussions about this, Cassandra seems to regularly pop up, but it's not in the proposal. As far as I know, there is currently no good way to access Cassandra directly from MW core (not abstraction layer, but apparently also no decent PHP driver at all, and IIRC there are also issues with network topology). I was hoping for @Joe and @mobrovac to ask more specific questions, but they are both on vacation right now. Perhaps get together with them to hash out a proposal when they are back. TASK DETAIL https://phabricator.wikimedia.org/T214362 WORKBOARD https://phabricator.wikimedia.org/project/board/52/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: daniel Cc: mobrovac, abian, Lydia_Pintscher, Lucas_Werkmeister_WMDE, Marostegui, Joe, daniel, Agabi10, Aklapper, Addshore, darthmon_wmde, holger.knust, Nandana, kostajh, Lahi, Gq86, GoranSMilovanovic, QZanden, merbst, LawExplorer, _jensen, rosalieper, D3r1ck01, Pchelolo, SBisson, Eevans, Hardikj, Wikidata-bugs, aude, GWicke, jayvdb, fbstj, santhosh, Jdforrester-WMF, Ladsgroup, Mbch331, Rxy, Jay8g, Ltrlg, bd808, Legoktm
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
