[Wikidata-bugs] [Maniphest] [Changed Subscribers] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)

2016-04-22 Thread Yurik 
Yurik added a subscriber: Eloy.
Yurik added a comment.


  @brion, the pretty printing is for diffs - makes them much easier to digest. 
A while ago I also tried to make the actual storage use a non-pretty-printed 
version, but I guess I never finished that part.
  
  @brion, re spaces in headers - I want header names to be identifiers - after 
all, the target audience is Lua scripts and Graphs - both are programming 
languages. It makes it much easier to use, because i can simply say 
`datum.buildingHeight` instead of `datum["building height"]` in vega or in Lua. 
@Eloy has made some suggestions  
on how to localize them, and I think we should go with the second option - 
"headers.i18n": [ { "en":"blah", "fr": "blah", ...}, ...] for header 
localization.
  
  @matmarex, exactly - the page-size limitation restricts how these datasets 
are used. In a way, this is a much easier to implement and more flexible 
"multi-stream" proposal, that will allow editors to create shared lists and 
tables.  The giant dataset storage with the proper query interface is a 
separate task all together. We want to have it, but it is a much bigger target 
with a much bigger resource requirements.
  
  P.S. For some reason I don't get email notifications from phab anymore :(

TASK DETAIL
  https://phabricator.wikimedia.org/T120452

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Yurik
Cc: Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, 
Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Alkamid, Milimetric, 
Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, 
Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, 
D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, 
Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)

2016-04-21 Thread Jdforrester-WMF 
Jdforrester-WMF removed a subscriber: Jdforrester-PERSONAL.

TASK DETAIL
  https://phabricator.wikimedia.org/T120452

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Yurik, Jdforrester-WMF
Cc: Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, 
gerritbot, -jem-, Bawolff, MZMcBride, Alkamid, Milimetric, Thryduulf, JEumerus, 
MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, 
Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, 
JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, 
Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)

2016-04-20 Thread Yurik 
Yurik added subscribers: Jdforrester-WMF, Jdforrester-PERSONAL.
Yurik added a comment.


  Juts wrote in-depth implementation details at 
https://www.mediawiki.org/wiki/Extension:JsonConfig/Tabular

TASK DETAIL
  https://phabricator.wikimedia.org/T120452

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Yurik
Cc: Jdforrester-PERSONAL, Jdforrester-WMF, brion, ThurnerRupert, intracer, 
TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Alkamid, 
Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, 
Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, 
D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, 
Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)

2016-04-19 Thread gerritbot 
gerritbot added a comment.
Herald added a subscriber: TerraCodes.


  Change 281331 merged by jenkins-bot:
  Implement tabular content support
  
  https://gerrit.wikimedia.org/r/281331

TASK DETAIL
  https://phabricator.wikimedia.org/T120452

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Milimetric, gerritbot
Cc: TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Alkamid, 
Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, 
Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Lewizho99, 
Maathavan, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, 
El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, 
jeremyb



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)

2016-03-05 Thread Yurik 
Yurik added a subscriber: Milimetric.
Yurik added a comment.


  Some of this functionality is already supported by JsonConfig extension, and 
I will be happy to guide that approach.  Also, I would advise against too many 
data formats - we got burnt by it with the API. TSV/CSV are great for 
representing tables, but their storage format is poorly defined when it comes 
to escaping.  So I would suggest TSV stored as JSON, e.g.
  
col1,col2,col3
10,20,30
50,60,70
  
  to be stored as
  
{
  "columns": ["col1", "col2", "col3"],
  "data": [
[10, 20, 30],
[50, 60, 70]
  ]
}
  
  There can be an api that handles this specific format and returns it as a TSV 
for easier processing by graphs.

TASK DETAIL
  https://phabricator.wikimedia.org/T120452

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Yurik
Cc: Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, 
matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, 
D3r1ck01, Izno, Wikidata-bugs, aude, Bawolff, El_Grafo, Ricordisamoa, 
Fabrice_Florin, Mbch331, Jay8g, Krenair



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)

2016-02-17 Thread Thryduulf 
Thryduulf added a subscriber: Thryduulf.

TASK DETAIL
  https://phabricator.wikimedia.org/T120452

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Thryduulf
Cc: Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, 
Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Izno, 
Wikidata-bugs, aude, Bawolff, El_Grafo, Ricordisamoa, Fabrice_Florin, Mbch331, 
Jay8g, Krenair



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)

2016-01-21 Thread Aklapper 
Aklapper added a comment.
Herald added a subscriber: JEumerus.

IMPORTANT: **If you are a community developer interested in working on this 
task:** The Wikimedia Hackathon 2016 
 (Jerusalem, March 31 
- April 3) focuses on 
https://phabricator.wikimedia.org/tag/community-wishlist-survey/ projects. 
There is some budget for sponsoring volunteer developers. THE DEADLINE TO 
REQUEST TRAVEL SPONSORSHIP IS TODAY, JANUARY 21. Exceptions can be made for 
developers focusing on Community Wishlist projects until the end of Sunday 24, 
but not beyond. If you or someone you know is interested, please REGISTER NOW 
.


TASK DETAIL
  https://phabricator.wikimedia.org/T120452

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Aklapper
Cc: JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, 
Aklapper, Steinsplitter, StudiesWorld, DannyH, Wikidata-bugs, aude, Bawolff, 
El_Grafo, Ricordisamoa, Fabrice_Florin, Mbch331, Jay8g, Krenair



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)

2015-12-23 Thread matmarex 
matmarex added a subscriber: ekkis.
matmarex merged 1 task(s): T122358: CSV file downloads.

TASK DETAIL
  https://phabricator.wikimedia.org/T120452

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: matmarex
Cc: ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, 
DannyH, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Mbch331, Jay8g, Krenair



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs