Re: [OSM-talk] Wiki Offline Copy?
Am Montag 10 November 2008 17:44:00 schrieb Shaun McDonald: > On 10 Nov 2008, at 16:31, sylvain letuffe wrote: > >> There are lots of attempts of making wikipedia offline, non of them > >> are simple solution, and they almost never have images. > > > > And what about just doing a basic and simple HTML copy ? > > ( if the goal is to be rendered loacaly with a borwser) > > > > Download httrack, get fun with parameters, get a local copy of the > > wiki > > without strugling it, and off you are ! > > That is effectively the same as using wget -r, which as Grant Slater > mentioned earlier in the thread, is something that we don't want > happening as it causes too much load on the server. > He wrote "get a local copy of the wiki". > Shaun Regards, Marc signature.asc Description: This is a digitally signed message part. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
On 10 Nov 2008, at 16:31, sylvain letuffe wrote: There are lots of attempts of making wikipedia offline, non of them are simple solution, and they almost never have images. And what about just doing a basic and simple HTML copy ? ( if the goal is to be rendered loacaly with a borwser) Download httrack, get fun with parameters, get a local copy of the wiki without strugling it, and off you are ! That is effectively the same as using wget -r, which as Grant Slater mentioned earlier in the thread, is something that we don't want happening as it causes too much load on the server. Shaun smime.p7s Description: S/MIME cryptographic signature ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
> There are lots of attempts of making wikipedia offline, non of them > are simple solution, and they almost never have images. And what about just doing a basic and simple HTML copy ? ( if the goal is to be rendered loacaly with a borwser) Download httrack, get fun with parameters, get a local copy of the wiki without strugling it, and off you are ! -- Sylvain Letuffe [EMAIL PROTECTED] qui suis-je : http://slyserv.dyndns.org ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
Hi! Roeland Douma wrote: > I think putting a wiki on a CD is not a smart idea at all. Some >reformatting will have to be done. Else a lot of links won't work >(just take the login stuff). I'm open for any input on smarter ideas ;-) Is there a nice way for transforming a wiki dump to let's say a huge PDF ? Maybe using LaTeX ? It's about making the information, especially about tagging and mapping available in a comprehensive way for dial up users. I think the would guess, that they cannot login ;-) But of course, a reformating would be good. Bad "ugly" information (a CD were you get an error when clicking the Login button) is better than no information at all.. Alex ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
On Mon, Nov 10, 2008 at 4:36 PM, Alexander Menk <[EMAIL PROTECTED]> wrote: > Hi! > > Roeland Douma wrote: > > I think putting a wiki on a CD is not a smart idea at all. Some > >reformatting will have to be done. Else a lot of links won't work > >(just take the login stuff). > > I'm open for any input on smarter ideas ;-) > Is there a nice way for transforming a wiki dump to let's say a huge PDF > ? Maybe using LaTeX ? > > It's about making the information, especially about tagging and mapping > available in a comprehensive way for dial up users. I think the would > guess, that they cannot login ;-) > But of course, a reformating would be good. Bad "ugly" information (a CD > were you get an error when clicking the Login button) is better than no > information at all.. http://users.softlab.ece.ntua.gr/~ttsiod/buildWikipediaOffline.html There are lots of attempts of making wikipedia offline, non of them are simple solution, and they almost never have images. -- /emj ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
I think putting a wiki on a CD is not a smart idea at all. Some reformatting
will have to be done. Else a lot of links won't work (just take the login
stuff).
But good to hear we might get a dump every X days soon :)
--Roeland
On Monday 10 November 2008 16:20:57 Alexander Menk wrote:
> Hi!
>
> Grant Slater wrote:
> >> maybe a good intermediate solution would be to provide zipped "wget -r"
> >> copies of the wiki? Of course not everybody shall do "wget -r
> >> wiki.openstreetmap.org" because this would cause to much load, but I
> >> could offer some webspace and do weekly snapshots or s.th. like this?
> >>
> >
> > Dude! No no no.
> sorry, did not want to scare you - I just asked...
>
> > ~23100 pages x multiple page views x all history x special page links =
> > big scary number. Do not do it.
> I would have excluded the same stuff that is excluded in the robots.txt
> (history, special pages etc.)
>
> > Bots are causing most of the load problems on the wiki, do not start
> > another one.
> "but I want the bot ... ;-(" (Over the hedge / Hammy - "but I want the
> cookie")
>
> >> Unfortunately wget is excluded by robots.txt, that's why I ask before I
> >> do so..
> >>
> >
> > Yes, wget is blocked for good reason. Wikipedia blocks it too.
> >
> > The server which runs the wiki will be upgraded soon. If the community
> > then agrees, we could setup a weekly data dump. Something like:
> > http://meta.wikimedia.org/wiki/Data_dumps
>
> [x] agree
>
> Unfortunately a data dump is not as handy as a ZIP file with many HTML
> files you can just pass around on some CDs to people with modems who are
> interested in OSM. But with the Data Dump I could set up a mediawiki on
> my own and do the wget there .. of course. But it's not very trivial to
> do so, especially including all the images.
>
> That's why I came up with the wget suggestion. Of course only ONE should
> do such a wget during a timeframe with a low load on the wiki (but I
> guess such a timeframe is just not existing...)
>
> Alex
>
>
> ___
> talk mailing list
> talk@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/talk
>
___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
Hi!
Grant Slater wrote:
>> maybe a good intermediate solution would be to provide zipped "wget -r"
>> copies of the wiki? Of course not everybody shall do "wget -r
>> wiki.openstreetmap.org" because this would cause to much load, but I
>> could offer some webspace and do weekly snapshots or s.th. like this?
>>
>
> Dude! No no no.
sorry, did not want to scare you - I just asked...
> ~23100 pages x multiple page views x all history x special page links =
> big scary number. Do not do it.
I would have excluded the same stuff that is excluded in the robots.txt
(history, special pages etc.)
> Bots are causing most of the load problems on the wiki, do not start
> another one.
"but I want the bot ... ;-(" (Over the hedge / Hammy - "but I want the
cookie")
>> Unfortunately wget is excluded by robots.txt, that's why I ask before I
>> do so..
>>
>
> Yes, wget is blocked for good reason. Wikipedia blocks it too.
>
> The server which runs the wiki will be upgraded soon. If the community
> then agrees, we could setup a weekly data dump. Something like:
> http://meta.wikimedia.org/wiki/Data_dumps
[x] agree
Unfortunately a data dump is not as handy as a ZIP file with many HTML
files you can just pass around on some CDs to people with modems who are
interested in OSM. But with the Data Dump I could set up a mediawiki on
my own and do the wget there .. of course. But it's not very trivial to
do so, especially including all the images.
That's why I came up with the wget suggestion. Of course only ONE should
do such a wget during a timeframe with a low load on the wiki (but I
guess such a timeframe is just not existing...)
Alex
___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
Alexander Menk wrote: > Hi! > > maybe a good intermediate solution would be to provide zipped "wget -r" > copies of the wiki? Of course not everybody shall do "wget -r > wiki.openstreetmap.org" because this would cause to much load, but I > could offer some webspace and do weekly snapshots or s.th. like this? > Dude! No no no. ~23100 pages x multiple page views x all history x special page links = big scary number. Do not do it. Bots are causing most of the load problems on the wiki, do not start another one. > Unfortunately wget is excluded by robots.txt, that's why I ask before I > do so.. > Yes, wget is blocked for good reason. Wikipedia blocks it too. The server which runs the wiki will be upgraded soon. If the community then agrees, we could setup a weekly data dump. Something like: http://meta.wikimedia.org/wiki/Data_dumps / Grant ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
Hi! maybe a good intermediate solution would be to provide zipped "wget -r" copies of the wiki? Of course not everybody shall do "wget -r wiki.openstreetmap.org" because this would cause to much load, but I could offer some webspace and do weekly snapshots or s.th. like this? Unfortunately wget is excluded by robots.txt, that's why I ask before I do so.. Alex Roeland Douma wrote: > I would like this as well. A daily dump or something would be great to > provide > a read-only mirror. > > --Roeland > > On Sunday 09 November 2008 12:44:43 Alexander Menk wrote: >> Hi! >> >> is it possible to download a dump of the openstreetmap wiki (media wiki >> tables and pictures, if possible) for offline use? >> >> I think this would be good for countries with poor internet connection.. >> >> Thanks to JOSM, mapping already can be done offline - but then the >> important info from the Wiki is missing ;-( >> ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Wiki Offline Copy?
I would like this as well. A daily dump or something would be great to provide a read-only mirror. --Roeland On Sunday 09 November 2008 12:44:43 Alexander Menk wrote: > Hi! > > is it possible to download a dump of the openstreetmap wiki (media wiki > tables and pictures, if possible) for offline use? > > I think this would be good for countries with poor internet connection.. > > Thanks to JOSM, mapping already can be done offline - but then the > important info from the Wiki is missing ;-( > > Regards, >Alex > > > ___ > talk mailing list > talk@openstreetmap.org > http://lists.openstreetmap.org/listinfo/talk > ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
[OSM-talk] Wiki Offline Copy?
Hi! is it possible to download a dump of the openstreetmap wiki (media wiki tables and pictures, if possible) for offline use? I think this would be good for countries with poor internet connection.. Thanks to JOSM, mapping already can be done offline - but then the important info from the Wiki is missing ;-( Regards, Alex ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
