| MZMcBride added a comment. |
I'm a little lost here. Is the idea that only data that can be structured as rows and columns ("fit" into a table) will be supported? Will nested key/value pairs be supported as the contents of an individual table cell?
I'm not sure a .tab file extension is needed. I actually thought T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML) was about storing XML, CSV, TSV, JSON, etc. in wiki pages, but looking at http://data.wmflabs.org/w/index.php?title=Data:Sample.tab&action=""> I'm a lot less sure now.
The discussion about data types and constraints in this task makes me worry that we're slowly inventing yet another database engine when we already have options such as SQLite.
I'm a big advocate for using wiki pages for many things. I think ContentHandler is a big step forward. But using wiki pages as mini databases still seems more novel and cute than practical and sustainable. A few years ago, Wiktionary was quick to adopt Scribunto/Lua in order to create mini-databases of large dictionaries/arrays in wiki pages.
What are the storage considerations/implications for Wikimedia wikis here? Every time an edit is made to a table cell, we'd then be saving a full copy of the page? Will users download and manipulate up to 2 MB of text in a textarea, or even heavier, an enhanced textarea featuring syntax highlighting?
There are very valid and important reasons that we have pagination, offsets, and limits with data sets. Will these three features be supported with wiki pages?
There's also a real concern that we'll be immediately setting ourselves up for medium-term future problems (e.g., storing more than 2 MB) as we scale up and expand this type of wiki page-based data storage implementation.
Cc: pwalsh, rufuspollock, RobLa-WMF, Danny_B, DannyH, StudiesWorld, Steinsplitter, Aklapper, Lydia_Pintscher, ekkis, Matanya, MarkTraceur, JEumerus, Thryduulf, Milimetric, MZMcBride, Bawolff, -jem-, gerritbot, Pokefan95, TerraCodes, intracer, ThurnerRupert, brion, Jdforrester-WMF, Eloy, TheDJ, Yurik, Zppix, Riley_Huntley, D3r1ck01, Izno, Luke081515, JAllemandou, Wikidata-bugs, aude, El_Grafo, jayvdb, Ricordisamoa, Shizhao, fbstj, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
