Re: [Xmldatadumps-l] WP-MIRROR 0.6 Released

2013-06-03 Thread wp mirror
Dear Ariel, 1) Profiling WP-MIRROR 0.6 saw the introduction of a `--profile' command-line option. Which provides a detailed breakdown of where time is spent during a mirror build. Unfortunately, WP-MIRROR 0.5 did not have this feature, so only aggregate comparisons are possible. 2) Performance

Re: [Xmldatadumps-l] WP-MIRROR 0.6 Released

2013-06-03 Thread Ariel T. Glenn
Στις 03-06-2013, ημέρα Δευ, και ώρα 10:22 -0400, ο/η wp mirror έγραψε: > Dear list members, > > I am pleased to announce the release of WP-MIRROR 0.6. > > The main design objective was this: PERFORMANCE. WP-MIRROR 0.6 now > builds the `enwiki' (which is the most demanding case) with 80% less >

[Xmldatadumps-l] WP-MIRROR 0.6 Released

2013-06-03 Thread wp mirror
Dear list members, I am pleased to announce the release of WP-MIRROR 0.6. The main design objective was this: PERFORMANCE. WP-MIRROR 0.6 now builds the `enwiki' (which is the most demanding case) with 80% less time and 75% less memory than v0.5. Feature: One new feature was added. WP-MIRROR

Re: [Xmldatadumps-l] [Pkg-mediawiki-devel] Name for DEB package

2013-06-03 Thread Thorsten Glaser
On Mon, 3 Jun 2013, Ariel T. Glenn wrote: > The main utility is designed to read XML dumps that conform to the > Mediawiki export schema [1] and write sql for importing into three MW > tables. If that should be treated as separate from MediaWiki for .deb > purposes, that's fine The rule of separ

Re: [Xmldatadumps-l] [Pkg-mediawiki-devel] Name for DEB package

2013-06-03 Thread Thorsten Glaser
On Wed, 29 May 2013, wp mirror wrote: > Dear list members, For what’s it worth, I ACK’d your mails, but if you’re going to write here more often you should maybe subscribe to the list. And use a realname ☺ > I would like some advise on how to submit a mediawiki related DEB > package. Jeremy Bar

Re: [Xmldatadumps-l] [Pkg-mediawiki-devel] Name for DEB package

2013-06-03 Thread Ariel T. Glenn
Στις 03-06-2013, ημέρα Δευ, και ώρα 11:39 +0200, ο/η Thorsten Glaser έγραψε: > > … this. Indeed, as this package does not have anything to do > with MediaWiki AFAICT from a quick glance, not being an extension > or somesuch, just submit it using the normal Debian ways. The main utility is desig

Re: [Xmldatadumps-l] Help needed for Volunteer Uganda project - Importing enwiki-20130403-pages-articles-multistream.xml.bz2

2013-06-03 Thread Federico Leva (Nemo)
Richard Ive, 03/06/2013 12:06: In all honesty, I didn't know about it until now. Everything else we are using is web biased (Khan Academy lite, ebooks and emedia), so for our model the Wikipedia website works best. I would guess it is cheaper to buy a £300 desktop with 2TB for the wiki Mysql dat

Re: [Xmldatadumps-l] Help needed for Volunteer Uganda project - Importing enwiki-20130403-pages-articles-multistream.xml.bz2

2013-06-03 Thread Richard Ive
In all honesty, I didn't know about it until now. Everything else we are using is web biased (Khan Academy lite, ebooks and emedia), so for our model the Wikipedia website works best. I would guess it is cheaper to buy a £300 desktop with 2TB for the wiki Mysql database, than getting 15 SD cards >

Re: [Xmldatadumps-l] Help needed for Volunteer Uganda project - Importing enwiki-20130403-pages-articles-multistream.xml.bz2

2013-06-03 Thread Federico Leva (Nemo)
Richard Ive, 02/06/2013 12:38: Hi all, I am helping the charity Volunteer Uganda set up an offline eLearning computer system with 15 Raspberry Pi's and cheap desktop computer for a server. Why aren't you using Kiwix? Reportedly, it even runs standalone on a Raspberry Pi without problems. Ne

Re: [Xmldatadumps-l] Help needed for Volunteer Uganda project - Importing enwiki-20130403-pages-articles-multistream.xml.bz2

2013-06-03 Thread Richard Ive
Thanks for confirming 13mil is enough. I didn't have the extension installed. It looks a lot better now. Thank you! There are still a few weird looking things around templates, but I'm importing enwiki-20130403-templatelinks.sql now so hopefully that should fix things. Thanks again. On 3 June

Re: [Xmldatadumps-l] Help needed for Volunteer Uganda project - Importing enwiki-20130403-pages-articles-multistream.xml.bz2

2013-06-03 Thread Ariel T. Glenn
Στις 02-06-2013, ημέρα Κυρ, και ώρα 11:38 +0100, ο/η Richard Ive έγραψε: ... > 1. I was originally using a GUI version of mwdumper-1.16.jar, but > that errored out a few time with duplicate pages so I decided > to use the pre-built one recommended on the media wiki page. >