Re: [Server-devel] [XSCE] sugarstats and xovis
On Thu, Jul 3, 2014 at 2:26 AM, Martin Dluhos mar...@gnu.org wrote: On 06/27/2014 02:10 PM, Martin Abente wrote: Hello Martin! Do you have documentation on how XOvis pipeline works? I would like to see how it works after the data is store and the visualization is generated. Here is a simple graphic that illustrates the workflow: http://i.imgur.com/Xhy1Vx3.jpg XOvis is a Couch application, which means that it's also stored in the db along with the journal metadata. It queries the db using map-reduce queries, which you can see here: https://github.com/martasd/xovis/blob/master/lib/views.js Writing a tool to export the metadata from Harvest-server to a compatible subset in the visualization-ready format of XOvis, would be cheaper in development cost, but more expensive in running time (with large datasets). The other way around, would be to allow XOvis read directly from Harvest-server MySQL format. CouchDB has two distinct advantages for XOVis. 1) It allows for eventual consistency which helps in syncing data from the school to a central location using XS or XSCE. I believe this isn't relevant for AU/Harvest because they don't use a school server, and the XOs send metadata directly. 2) CouchDB does the aggregation through mapreduce. This is powerful, and withour couchDB (or mongodb etc) you'll have to write the aggregation yourself and/or get MySQL to do it. The visualization may or may not be stored in the DB. It just happens to be one more convenience of CouchDB. cheers, Sameer Since transferring metadata into the db needs to be done only once, running time has never been a major concern. How large are the datasets you've collected on the Harvest-server? Cheers, Martin ___ Server-devel mailing list Server-devel@lists.laptop.org http://lists.laptop.org/listinfo/server-devel
Re: [Server-devel] [XSCE] xovis on the XSCE 5.0
On Thu, Jul 3, 2014 at 7:45 AM, Martin Dluhos mar...@gnu.org wrote: On 06/24/2014 07:47 PM, Sameer Verma wrote: So, here are some observations: Thanks for the feedback, Sameer! Tim already addressed many of the things you point out in the latest xovis pull request, which has been merged into master (https://github.com/XSCE/xsce/pull/145). My comments follow inline. XSCE should pull to get the latest from xovis (Tim Moody has already written about this). I don't see the add deployment [+] button and spider charts on the XSCE version. Fixed in #145. I'll pull and take a look. Add methods to pull from sugar-stats (currently stores data in RRD format, but rrdtool does the export in versions 1.4.6 and above) and harvest (already has serialized json). Yes, that would be very useful. Anish Mangal and I have some data from Bhagmalpur, India is a RRD format. We'll try to fiddle with it and see how the RRD to json goes. Also add methods to read from Sugar backups done using the Backup activity. Many smaller projects have backups done by hand. Are you talking about projects, which do not use a server at all? If there is a server, one can always run a ds-backup. True, but there are several projects that don't have a XS or XSCE, and have collected backups via the Backup activity. I have some samples if you want to take a peek. Resolve the userid:password for couchdb (instead of admin:admin) in ansible, so it installs with an account other than admin. A way to edit out the OLENepal header from all charts. Both handled in #145. Great! Maybe we spin a VM with CentOS and xovis (call it the visualizer!) where you can plug in a USB stick or external drive with backups, and visualize. I've just added the backup directory as an ansible variable. Some basic documentation on the use of xovis and interpretation of data for teachers, principals, etc. Perhaps a 'help' page? +1 Something that's quite popular with many similar projects (deployment of several mobile computers) is How many laptops showed up at school today?. There are a few different ways this can be done (dhcp log, Journal data), but I'd like to discuss this a bit more. Since we already store Journal data, this wouldn't be too difficult to add. Good idea! Thanks for the feedback, Sameer! Cheers, Martin ___ Server-devel mailing list Server-devel@lists.laptop.org http://lists.laptop.org/listinfo/server-devel cheers, Sameer ___ Server-devel mailing list Server-devel@lists.laptop.org http://lists.laptop.org/listinfo/server-devel
Re: [Server-devel] [XSCE] Internet-in-a-Box special guests (10AM NYC Time, Thursday July 10)
I can't make that unholy time, sorry. You haven't mentioned, but you probably should, that OLPC has released 13.2.1 with improved wireless drivers, and improved support for Internet-in-a-Box and other collections such as the Khan Academy on Raspberry Pi (KA-Pi). http://wiki.laptop.org/go/Release_notes/13.2.1 On Wed, Jul 09, 2014 at 11:04:55PM -0400, Adam Holt wrote: Special thanks to Braddock Gaskill Curt Thompson who will join our weekly Thurs call to review the latest IIAB, how it can work with the imminent XSCE 5.1 (http://schoolserver.org) and similar open edutech platforms/collections. OpenStreetMap is celebrating its 10-year anniversary this year; likewise many want to understand IIAB's advances over the past year, and how deployments (e.g. in Haiti, Ghana, Lesotho, Rwanda, Zambia, Malaysia) can better make use of May 2014's recent IIAB release/snapshot now being tested in Haiti. Enhancing digital library training also means, like with any great library, understanding what gems we truly have to offer --- thanks to librarians of all kind promoting these, with scintillating tours to patrons of all ages --- Let's Do It :) Others like Tim Moody and Tony Anderson (just to mention a few) have equally concrete but future-oriented questions, working to understand IIAB's architecture, customizing IIAB for different regions/languages/schools, trimming it down for solid-state / portable offline uses soon? Perhaps even later merging parts of IIAB with XSCE, RACHEL, Project BERNIE, eGranary and Libraries Without Borders' IdeasBox? Among others: http://wiki.laptop.org/go/XS_Community_Edition#Our_Ecosystem But please add your own questions to the agenda here first, Thanks! https://docs.google.com/document/d/1o6QtzLb6e58YKWqMf_junux2XyBRLFm31un8YLcYslg See you on Skype Thursday morning 10AM NYC Time (7AM California Time) exactly 11 hours from now! And/or please say hi on backchannel #schoolserver at http:/ /webchat.freenode.net absolutely anytime- -- Unsung Heroes of OLPC, interviewed live @ http://unleashkids.org ! -- James Cameron http://quozl.linux.org.au/ ___ Server-devel mailing list Server-devel@lists.laptop.org http://lists.laptop.org/listinfo/server-devel
