Re: [OSM-dev] Set up your personal tile server for experiments - what machine / installation suitable?
Hi, Ulf Lamping wrote: For the rendering and as a first step it would be enough to do this europe wide (and e.g. use the geofabrik excerpts), but maybe it's even easier in the long run to use (and especially update) the planet once it's imported into the DB?!? If you do not need diff updates *and* have enough RAM then it makes sense to do full imports without --slim. That gives you a significant speedup on import, and the database will use less disk space (but only a few GB if we're talking a small extract). Also, since you say you want to play with rendering, it is not unlikely that you will modify your osm2pgsql style file (which determines the tags that are imported), and even if you run in update mode with --slim you will have to rebuild your database every time you do that. If it's obvious, that this machine can't deal with the task, what's the weak spot? Will it be a good idea to add some more RAM, or is the CPU too slow ... CPU is not the problem. If you go without --slim then RAM will be a problem; even for a Germany import you'll probably need 2 or 4 GB. If you use --slim then it will basically work with 1 GB, however imports and updates will be slow. A second hard disk and RAID-0 setup would probably halp to speed up things. Bye Frederik ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Killing osm2pgsql application while updating PostGIS. What happens?
On Sun, Jan 24, 2010 at 12:10 PM, Giuseppe Castagno giuseppe.casta...@acca-esse.eu wrote: Though I didn'd find anything managing the SIGKILL event. Because you can't catch SIGKILL. If you meant SIGINT or SIGHUP then I suppose the reason is it doesn't matter. exit_nicely() is primarily good at reducing the number of spurious messages in the postgresql logs. You don't *have* to close the database connections, the OS and the DB will handle it just fine, albeit with some messages. osm2pgsql does use transactions (for performance primarily) so just killing it will not break anything it's not all *one* transaction however so if you're exceedingly unlucky and kill it just as it's trying to commit everything you can get a partially commit change. Just redoing the changeset will fix everything though. Have a nice day, -- Martijn van Oosterhout klep...@gmail.com http://svana.org/kleptog/ ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Set up your personal tile server for experiments - what machine / installation suitable?
Hi, I set up a 'home-brew' small server to do what I think you have in mind. Rest of answer follows. Ulf Lamping wrote: Hi! I'm pretty much aware, that the responses to the following questions will be subjective. However, I'm seeking for some advice to get a feeling what could work for me (and probably others). I'm currently thinking to set up my own personal tile server, basically to experiment with rendering. My thoughts are: - postgis/postgres DB I used postgis 1.4 home build and postgres 8.4, this last one from Ubuntu 9.10 I'm using as a OS. Ubuntu version is amd64 server. - mapnik rendering I used mapnik too, svn release 1303. - tile server (apache / lighthttpd?) I used apache2 from the distro plus the mod_tile set up you can find in osm svn repository ... I have a currently unused (somewhat older) machine: - CPU 3 GHZ (single core) - 1 GB RAM - 1 TB disk space (total) my hardware setup is as follow: The motherboard is old compared to current ones: Abit AB9. CPU Intel Quad Core 2.4 GHz; 8 MB Ram; 4 HDU 1TB, 2 RAID1 for OS and 2 RAID1 for osm stuff. RAID1 is Linux software type (mdadm). The quad core didn't really matter, the import used one cpu mainly sitting there waiting for I/O. and I wonder if this would do the job. I mean I don't care if it's once running 24h to import the planet or 38h. However, if it turns out that later on applying the weekly changes takes longer than a week this configuration is becoming a bit pointless ;-) may be a good idea to start with would be to begin with small extract import. For example with the above setup, importing Europe took 11h, importing Italy took 20m. Whereas importing the whole planet took around 85h. Planet date was 20100113. If it's obvious, that this machine can't deal with the task, what's the weak spot? Will it be a good idea to add some more RAM, or is the CPU too slow ... As I'm going to install the machine from scratch anyway. What OS to use? I would prefer Ubuntu here - but what version/edition? see my points above. BeppeC56 -- Kind Regards, Giuseppe Castagno Acca Esse http://www.acca-esse.eu giuseppe.castagno at acca-esse.eu beppec56 at openoffice.org ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Killing osm2pgsql application while updating PostGIS. What happens?
Martijn van Oosterhout wrote: On Sun, Jan 24, 2010 at 12:10 PM, Giuseppe Castagno giuseppe.casta...@acca-esse.eu wrote: Though I didn'd find anything managing the SIGKILL event. Because you can't catch SIGKILL. If you meant SIGINT or SIGHUP then I suppose the reason is it doesn't matter. exit_nicely() is primarily ouch, I meant SIGINT here. I forgot SIGKILL cannot be masked out. good at reducing the number of spurious messages in the postgresql logs. You don't *have* to close the database connections, the OS and the DB will handle it just fine, albeit with some messages. osm2pgsql does use transactions (for performance primarily) so just killing it will not break anything it's not all *one* transaction however so if you're exceedingly unlucky and kill it just as it's trying to commit everything you can get a partially commit change. Just redoing the changeset will fix everything though. I'm already replaying the same changeset, if it's not properly finished (e.g. osm2pgsql not returning 0 at the end of the job). So I think it's safe for me to just kill it, and replaying the last bunch of changesets applied. Thanks, BeppeC56 -- Kind Regards, Giuseppe Castagno Acca Esse http://www.acca-esse.eu giuseppe.castagno at acca-esse.eu beppec56 at openoffice.org ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] phonetic gazateer, would be cool feature for nominatim
On Fri, Jan 15, 2010 at 2:09 AM, Brian Quinion openstreet...@brian.quinion.co.uk wrote: Lucene uses Double Metaphone[1] (amongst others) and it works really nice across multiple languages. Certainly the best I've seen so far and the one OSMdoc is using in the next version. A bit of experimenting later I've made this live: http://nominatim.openstreetmap.org/?q=sheffeild however it is far from fool proof both because double metaphone isn't great with typos - only with phonetic spelling - and because the size of the database makes for a very large number of potential hits. -- Brian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] phonetic gazateer, would be cool feature for nominatim
On Tue, 2010-01-26 at 14:49 +, Brian Quinion wrote: On Fri, Jan 15, 2010 at 2:09 AM, Brian Quinion openstreet...@brian.quinion.co.uk wrote: Lucene uses Double Metaphone[1] (amongst others) and it works really nice across multiple languages. Certainly the best I've seen so far and the one OSMdoc is using in the next version. A bit of experimenting later I've made this live: http://nominatim.openstreetmap.org/?q=sheffeild however it is far from fool proof both because double metaphone isn't great with typos - only with phonetic spelling - and because the size of the database makes for a very large number of potential hits. this is usually handled by using a specific language spelling = phonemes translator. so that would need a setting for 'language of the destination' which can be found automatically if a country name can be found in the text -- Brian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] South Pole at 0,0 ?
The Mapnik layer shows the South Pole at 0°, 0°. Unless my geography knowledge betrays me this is slightly off. There is nothing in the data in this location (after I deleted a couple of nodes there, but nothing that had anything to do with South Pole). I am wondering how Mapnik is dreaming that up. I have the suspicion that osm2pgsql (which is doing the conversation to Mercator, right?) somehow falls back to 0,0 when it can not deal with an indefinite northing value. Matthias ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Obtain SLD style for osm
Hallo list 1- We are developing a GIS application using osm maps and a geoserver. My problem is that there's no reliable sld style for the osm maps. Is there a way to convert the mapnik style to SLD or does any of you know such a resource? Although the assignment states that we use geoserver as our wms map server and maps from osm, but I feel that its not a very smart idea to mix the two, what do you think? Best regards, Moataz ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] phonetic gazateer, would be cool feature for nominatim
this is usually handled by using a specific language spelling = phonemes translator. so that would need a setting for 'language of the destination' which can be found automatically if a country name can be found in the text Language of the destination is indeterminate because they could be searching for the place name as expressed in another language i.e. Llundain (welsh version of London) so even if you can determine the country it doesn't work. And the similar in reverse for the browser language - they could be searching for London even though they are a native German speaker. Also it isn't the phonetic spelling that is really the problem - the problem is that a lot of the time mistakes are typos not miss-spellings i.e. Lonon which is phonetically completely different to London despite being obvious that someone just missed the 'd' when they were typing. -- Brian ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Obtain SLD style for osm
On Jan 26, 2010, at 8:05 AM, moataz Elmasry wrote: Hallo list 1- We are developing a GIS application using osm maps and a geoserver. My problem is that there's no reliable sld style for the osm maps. Right, because it takes a serious amount of effort, care, and commitment to create and maintain styles as sophisticated as those behind many of the well know maps from OSM that use Mapnik. Is there a way to convert the mapnik style to SLD or does any of you know such a resource? I've done this in the past with simple Mapnik XML (and also converted SLD to Mapnik XML) and it's not too difficult with a bit of XML work. I did it with python scripting but likely a better route would be XSLT transforms. But, I would not recommend this route for the osm.xml unless you have a very keen attention to detail as many of the subtle styling parameters that make OSM maps look good are custom to Mapnik (and would also likely be custom VendorOptions in GeoServer). There would be great value to creating a mapping between these, but its not going to be an easy thing. Although the assignment states that we use geoserver as our wms map server and maps from osm, but I feel that its not a very smart idea to mix the two, what do you think? Mixing WMS and OSM data in general when using complex styles is usually not the right approach, no matter what library you use to do the rendering because the size of the data and time it takes to render the styles is much better done using TMS (Tiled Map Service). This is the way that tile.openstreetmap.org works (using mod_tile), serving tiles that get cached for speed once they are rendered. I would recommend using the existing OSM styles + Mapnik + mod_tile. Dane ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] South Pole at 0,0 ?
2010/1/26 Matthias Julius li...@julius-net.net: I have the suspicion that osm2pgsql (which is doing the conversation to Mercator, right?) somehow falls back to 0,0 when it can not deal with an indefinite northing value. I also came across this issue, but AFAIK mercator is not suitable for north- and southpole: it is not defined in these regions (don't remember exactly but it was like bigger/smaller than 85 Deg. North/South). For further reading look for Mercator-projection in the Web. cheers, Martin ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] phonetic gazateer, would be cool feature for nominatim
Also it isn't the phonetic spelling that is really the problem - the problem is that a lot of the time mistakes are typos not miss-spellings i.e. Lonon which is phonetically completely different to London despite being obvious that someone just missed the 'd' when they were typing. In that case you might want to have a look at the RefinedSoundex[1] which claims to be suitable for spell checking (I haven't tried it). The other option of course being a full blown spell checking program with stemming/dictionary/word distances etc. Lars [1] http://commons.apache.org/codec/apidocs/org/apache/commons/codec/language/RefinedSoundex.html ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] phonetic gazateer, would be cool feature for nominatim
If you set up a phonetic search, make sure to take care of http://wiki.openstreetmap.org/wiki/Phonetics There are streets called John-F.-Kennedy-Chaussee (English and French pronounciation in sorbian speaking areas of Germany...! I invented this to enable screen readers for the blind to find the right pronounciation, but obviously a phonetic search is a nice feature that fits aswell for this tag. Regards Lulu-Ann ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] South Pole at 0,0 ?
Martin Koppenhoefer dieterdre...@gmail.com writes: 2010/1/26 Matthias Julius li...@julius-net.net: I have the suspicion that osm2pgsql (which is doing the conversation to Mercator, right?) somehow falls back to 0,0 when it can not deal with an indefinite northing value. I also came across this issue, but AFAIK mercator is not suitable for north- and southpole: it is not defined in these regions (don't remember exactly but it was like bigger/smaller than 85 Deg. North/South). For further reading look for Mercator-projection in the Web. Of course, Mercator is not suitable for for the polar regions. The poles are in the infinite. That's why I would expect Mapnik not to put the South Pole on a Mercator map. And now look at our Mapnik layer: http://www.openstreetmap.org/?lat=0lon=0zoom=18layers=B000FTF Mercator is defined right up to the poles - the scale just grows larger and larger and at the poles it is infinite. Our limit of about 85° comes from us wanting a square map. Matthias ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [josm-dev] location of elemstyles.xml and Eclipse
On Tue, Jan 26, 2010 at 7:11 AM, Matthias Julius li...@julius-net.netwrote: I think you have to add the /data in your eclipse project classpath (included path). Is it not already done in the commited .classpath ? Pieren ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
Re: [josm-dev] location of elemstyles.xml and Eclipse
Pieren pier...@gmail.com writes: On Tue, Jan 26, 2010 at 7:11 AM, Matthias Julius li...@julius-net.netwrote: I think you have to add the /data in your eclipse project classpath (included path). Is it not already done in the commited .classpath ? /data is in there. But, elemstyles.xml is not in /data - it is copied to /build/data at build time. Of course, the obvious workaround is to copy the file manually into /data. But then I would have to remember to do that every time elemstyles.xml changes. Matthias ___ josm-dev mailing list josm-dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/josm-dev
