[tw] Re: Importing Wikipedia Dumps

2015-01-08 Thread RichShumaker
I agree with Tobias on why repeat the repeating if something exists already and can work. I can also say that on more than one occasion when asked why did you do that? My response has been 'because I can.' I have worked with HTML TW5 dealing with larger data sets and have not enjoyed it. So fro

[tw] Re: Importing Wikipedia Dumps

2015-01-08 Thread Richard Smith
> > > The first response that pops off my synapses reading such a proposal is: > *Why?* and again: *Why?* > > Hi Tobias, My goal is to package information to be accessible completely offline (in an environment where there is no possibility of an internet connection). I would like to curate a co

Re: [tw] Re: Importing Wikipedia Dumps

2015-01-07 Thread Tobias Beer
For a simple offline Wikipedia, perhaps use: http://www.kiwix.org To take ownership of the information you need. (i.e. have them on YOUR > computer where they belong to YOU, this is a core idea behind TW) I wouldn't think of it as ownership. More like a copy, perhaps an offline backup. To ha

Re: [tw] Re: Importing Wikipedia Dumps

2015-01-07 Thread Andreas Hahn
Am 07.01.2015 um 10:18 schrieb Tobias Beer: So, what's the actual incentive / goal you have in mind other than "because it would be cool" for TiddlyWiki? What do you want to do with all this "stuff" in TiddlyWiki? Well, I can think of several reasons: - To take ownership of the information yo

[tw] Re: Importing Wikipedia Dumps

2015-01-07 Thread Tobias Beer
Hi Richard, > importing (largish amounts of) wikipedia data into TiddlyWiki > The first response that pops off my synapses reading such a proposal is: *Why?* and again: *Why?* As Mario hints, you will need... - field mapping - for importing - content conversion - formatting

[tw] Re: Importing Wikipedia Dumps

2015-01-07 Thread PMario
tiddlers.csv -- You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+unsubscr...@googlegroups.com. To post to this group, send email to tiddlywiki@googlegroups.

[tw] Re: Importing Wikipedia Dumps

2015-01-07 Thread PMario
tiddlers.json I can't uplaod tiddlers.csv :/ -m -- You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+unsubscr...@googlegroups.com. To post to this group, sen

[tw] Re: Importing Wikipedia Dumps

2015-01-07 Thread PMario
There is a possibility to download Wikipedia databases [1] in XML format, which needs some post processing, to be used with TW. ... BUT the problem here is size: These files expand to multiple terabytes of text. Please only download these if you know you can cope with this quantity of data. Go

[tw] Re: Importing Wikipedia Dumps

2015-01-06 Thread Richard Smith
OK. That was a bit lazy. I searched after I posted and found a similar recent thread. https://groups.google.com/forum/#!searchin/tiddlywiki/wikipedia/tiddlywiki/BefZrA4BpqQ/-XLsXOaav5wJ I'll contextualise my question a little better. I have recently been corresponding with someone who works for