Re: [OSM-talk] Wiki Offline Copy?
Alexander Menk wrote: Hi! maybe a good intermediate solution would be to provide zipped wget -r copies of the wiki? Of course not everybody shall do wget -r wiki.openstreetmap.org because this would cause to much load, but I could offer some webspace and do weekly snapshots or s.th. like this? Dude! No no no. ~23100 pages x multiple page views x all history x special page links = big scary number. Do not do it. Bots are causing most of the load problems on the wiki, do not start another one. Unfortunately wget is excluded by robots.txt, that's why I ask before I do so.. Yes, wget is blocked for good reason. Wikipedia blocks it too. The server which runs the wiki will be upgraded soon. If the community then agrees, we could setup a weekly data dump. Something like: http://meta.wikimedia.org/wiki/Data_dumps / Grant ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
I think putting a wiki on a CD is not a smart idea at all. Some reformatting will have to be done. Else a lot of links won't work (just take the login stuff). But good to hear we might get a dump every X days soon :) --Roeland On Monday 10 November 2008 16:20:57 Alexander Menk wrote: Hi! Grant Slater wrote: maybe a good intermediate solution would be to provide zipped wget -r copies of the wiki? Of course not everybody shall do wget -r wiki.openstreetmap.org because this would cause to much load, but I could offer some webspace and do weekly snapshots or s.th. like this? Dude! No no no. sorry, did not want to scare you - I just asked... ~23100 pages x multiple page views x all history x special page links = big scary number. Do not do it. I would have excluded the same stuff that is excluded in the robots.txt (history, special pages etc.) Bots are causing most of the load problems on the wiki, do not start another one. but I want the bot ... ;-( (Over the hedge / Hammy - but I want the cookie) Unfortunately wget is excluded by robots.txt, that's why I ask before I do so.. Yes, wget is blocked for good reason. Wikipedia blocks it too. The server which runs the wiki will be upgraded soon. If the community then agrees, we could setup a weekly data dump. Something like: http://meta.wikimedia.org/wiki/Data_dumps [x] agree Unfortunately a data dump is not as handy as a ZIP file with many HTML files you can just pass around on some CDs to people with modems who are interested in OSM. But with the Data Dump I could set up a mediawiki on my own and do the wget there .. of course. But it's not very trivial to do so, especially including all the images. That's why I came up with the wget suggestion. Of course only ONE should do such a wget during a timeframe with a low load on the wiki (but I guess such a timeframe is just not existing...) Alex ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
On Mon, Nov 10, 2008 at 4:36 PM, Alexander Menk [EMAIL PROTECTED] wrote: Hi! Roeland Douma wrote: I think putting a wiki on a CD is not a smart idea at all. Some reformatting will have to be done. Else a lot of links won't work (just take the login stuff). I'm open for any input on smarter ideas ;-) Is there a nice way for transforming a wiki dump to let's say a huge PDF ? Maybe using LaTeX ? It's about making the information, especially about tagging and mapping available in a comprehensive way for dial up users. I think the would guess, that they cannot login ;-) But of course, a reformating would be good. Bad ugly information (a CD were you get an error when clicking the Login button) is better than no information at all.. http://users.softlab.ece.ntua.gr/~ttsiod/buildWikipediaOffline.html There are lots of attempts of making wikipedia offline, non of them are simple solution, and they almost never have images. -- /emj ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
Hi! Roeland Douma wrote: I think putting a wiki on a CD is not a smart idea at all. Some reformatting will have to be done. Else a lot of links won't work (just take the login stuff). I'm open for any input on smarter ideas ;-) Is there a nice way for transforming a wiki dump to let's say a huge PDF ? Maybe using LaTeX ? It's about making the information, especially about tagging and mapping available in a comprehensive way for dial up users. I think the would guess, that they cannot login ;-) But of course, a reformating would be good. Bad ugly information (a CD were you get an error when clicking the Login button) is better than no information at all.. Alex ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
There are lots of attempts of making wikipedia offline, non of them are simple solution, and they almost never have images. And what about just doing a basic and simple HTML copy ? ( if the goal is to be rendered loacaly with a borwser) Download httrack, get fun with parameters, get a local copy of the wiki without strugling it, and off you are ! -- Sylvain Letuffe [EMAIL PROTECTED] qui suis-je : http://slyserv.dyndns.org ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
On 10 Nov 2008, at 16:31, sylvain letuffe wrote: There are lots of attempts of making wikipedia offline, non of them are simple solution, and they almost never have images. And what about just doing a basic and simple HTML copy ? ( if the goal is to be rendered loacaly with a borwser) Download httrack, get fun with parameters, get a local copy of the wiki without strugling it, and off you are ! That is effectively the same as using wget -r, which as Grant Slater mentioned earlier in the thread, is something that we don't want happening as it causes too much load on the server. Shaun smime.p7s Description: S/MIME cryptographic signature ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
Am Montag 10 November 2008 17:44:00 schrieb Shaun McDonald: On 10 Nov 2008, at 16:31, sylvain letuffe wrote: There are lots of attempts of making wikipedia offline, non of them are simple solution, and they almost never have images. And what about just doing a basic and simple HTML copy ? ( if the goal is to be rendered loacaly with a borwser) Download httrack, get fun with parameters, get a local copy of the wiki without strugling it, and off you are ! That is effectively the same as using wget -r, which as Grant Slater mentioned earlier in the thread, is something that we don't want happening as it causes too much load on the server. He wrote get a local copy of the wiki. Shaun Regards, Marc signature.asc Description: This is a digitally signed message part. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
I would like this as well. A daily dump or something would be great to provide a read-only mirror. --Roeland On Sunday 09 November 2008 12:44:43 Alexander Menk wrote: Hi! is it possible to download a dump of the openstreetmap wiki (media wiki tables and pictures, if possible) for offline use? I think this would be good for countries with poor internet connection.. Thanks to JOSM, mapping already can be done offline - but then the important info from the Wiki is missing ;-( Regards, Alex ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
[OSM-talk] Wiki Offline Copy?
Hi! is it possible to download a dump of the openstreetmap wiki (media wiki tables and pictures, if possible) for offline use? I think this would be good for countries with poor internet connection.. Thanks to JOSM, mapping already can be done offline - but then the important info from the Wiki is missing ;-( Regards, Alex ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
