Re: [OSM-dev-fr] Tunning de postgresql pour des bases osmosis et/ou osm2pgsql
sly (sylvain letuffe) a écrit on 05/12/2011 15:19: autovacuum = off D'où vient ce autovacuum = off ? C'est déconseillé dans les documentations récentes de postgresql. Qu'est-ce-qui le justifie ? Justification : pour aller encore plus vite Contraintes : l'espace disque augmente encore plus vite que la taille OSM à cause des trous dans la structure de fichier postgresql lors des suppressions. Je viens de le remettre chez moi pour voir si c'est pénalisant, sinon, il y'a la solution de lancer un VACUUM manuel de temps en temps (au moment où la machine est plus tranquille) pour purger ces trous A propos de VACUMM le vacuum full est désormais déconseillé à partir de le 9.0 http://wiki.postgresql.org/wiki/VACUUM_FULL A++ -- Rodolphe Quiédeville http://cartosm.eu - Intégration de carte libre sur site web Blog : http://blog.rodolphe.quiedeville.org/ SIP/XMPP : rodol...@quiedeville.org ___ dev-fr mailing list dev-fr@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev-fr
Re: [OSM-dev] New transport render (and bugs on ÁÉÍÓÚÑ)
It seems that everything renders as it should now - so thanks to everyone involved! :-) -- -- Iván Sánchez Ortega i...@sanchezortega.es i...@geonerd.org ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Overpass API and JOSM
Hi all, I'm trying to download a chunk of data via the Overpass API, load it into JOSM, so I can change some stuff and upload it back. The problem is that JOSM will nag about the data not having the version number, with a message like missing attribute 'version' in OSM primitive with ID 123457, in line bleh. The overpass query I'm using is: wget --timeout 0 http://www.overpass-api.de/api/xapi?*[shop=supermarket] [bbox=-4.43,41.42,-2.41,43.23] -O supermarkets_burgos.osm Things I'm not capable of doing: modifying the overpass API so it includes the latest known version number, or modifying JOSM to query the version number of the object IDs in a file without version numbers. Any insights? -- -- Iván Sánchez Ortega i...@sanchezortega.es i...@geonerd.org ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] New transport render (and bugs on ÁÉÍÓÚÑ)
Hi, Jet another problem: we have some trolley-busses in Germany, which won't get rendered, for example this relation: http://www.openstreetmap.org/api/0.6/relation/1731914 I wouldn't mind if you render it as a normal bus. Greetings, andré Joost ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] New transport layer
Hi Andy, thanks for your work, it's good to have a transport layer in official OSM map now. :-) I'm still not sure what you want to display on the map. Is it the Hardware (e.g. rails, streets) or is it the Software (transport lines, etc.)? An example: For buses you show the bus LINES, for railways you show the RAILS. There are tons of railways which aren't really in use (some of them temporary for goods, some of them never). Please compare the transport maps (example region Upstate, NY): Official transport layer: http://www.openstreetmap.org/?lat=41.96lon=-75.82zoom=8layers=T openbusmap.org: http://www.openbusmap.org/?lat=41.96lon=-75.82zoom=8layers=B openptmap.org: http://www.openptmap.org/?lat=41.96lon=-75.82zoom=8layers=B trolleybuses, trams, ferries, aerialways, etc.: I'll be happy to help with the openptmap's Mapnik style file if you like. Examples: Arealways: http://openptmap.org/?zoom=15lat=46.21553lon=7.82773layers=BTFT Trolleybuses (dark red): http://openptmap.org/?zoom=14lat=47.37499lon=8.53419layers=0B000TFT Regards Markus ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] New transport layer
On Lunes, 5 de Diciembre de 2011 11:05:34 Andy Allan escribió: Ah yes - I forgot to report back that I had fixed it. Thanks to Laurence for some off-list help with this - I've switched to a different font now that isn't so messed up. Oh sucks. The old font was cooler. Any chance it can be fixed? On Lunes, 5 de Diciembre de 2011 15:51:24 mar...@gmx.eu escribió: I'm still not sure what you want to display on the map. Is it the Hardware (e.g. rails, streets) or is it the Software (transport lines, etc.)? two_centsIMHO Bus routes are too prominent - I would expect a finer line, and maybe some transparency. Plus, one-way arrows, öpvnkarte-style. Besides, I encourage you to have a peek into my hometown's transport maps: http://www.madrid.org/cs/Satellite?c=CM_InfPractica_FAcid=1142558832294pagename=ComunidadMadrid%2FEstructura Particularly, the series-3 25MB monster, or some of the smaller Series-5. Note the different color for the regular(red), intercity(green) and night(black- yellow) buses, how the subway/light-rail lines/routes are even more prominent than bus routes, the one-way shields, the line numbers on subway stations, and whatnot. They're worth a look, really. Anyway, back to the point: note how the bus route lines are thinner than the road itself. The current equal-width transport map can be confusing (Is that a road, or is it something else?) /IMHO/two_cents Cheers, -- -- Iván Sánchez Ortega i...@sanchezortega.es i...@geonerd.org Yo soy capaz de reconocer los aspectos positivos de la influencia de las religiones a lo largo de la historia. Por ejemplo, les debemos la creación de calendarios racionales que tan útiles han sido, aunque sinceramente, soy incapaz de recordar alguno más. -- Isaac Asimov. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] idea: before-after map
Hi, Now that we have the history files and a history renderer in the making [1] it would be possible to create a Before / After service: user would select one or a few concurrent changesets comprising an edit session, and the service would churn out a pretty HTML page with a static map of the area just prior to the changesets affecting the area and just after the last ones were closed. I was just wondering how difficult / feasible this would be to implement. Do we even need Peter's renderer for it? [1] https://github.com/MaZderMind/osm-history-renderer -- martijn van exel geospatial omnivore 1109 1st ave #2 salt lake city, ut 84103 801-550-5815 http://oegeo.wordpress.com ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] idea: before-after map
Am 05.12.2011 18:08, schrieb Martijn van Exel: Hi, Now that we have the history files and a history renderer in the making [1] it would be possible to create a Before / After service: user would select one or a few concurrent changesets comprising an edit session, and the service would churn out a pretty HTML page with a static map of the area just prior to the changesets affecting the area and just after the last ones were closed. I was just wondering how difficult / feasible this would be to implement. Do we even need Peter's renderer for it? You could use the database and the valid_from / valid_to processing used in the views to get the before/after state and do whatever you want (ie compare version minor version to find affected items). Just use this clause in your where-statement to get all items at this point in time: '2010-01-01' BETWEEN valid_from AND COALESCE(valid_to, '-12-31') Take a look at render.py to see how it's used. [1] https://github.com/MaZderMind/osm-history-renderer Peter ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] idea: before-after map
Thanks, For it to work (for current changesets) though, we would need a continuously updated full history database.. On Mon, Dec 5, 2011 at 10:46 AM, Peter Körner osm-li...@mazdermind.de wrote: Am 05.12.2011 18:08, schrieb Martijn van Exel: Hi, Now that we have the history files and a history renderer in the making [1] it would be possible to create a Before / After service: user would select one or a few concurrent changesets comprising an edit session, and the service would churn out a pretty HTML page with a static map of the area just prior to the changesets affecting the area and just after the last ones were closed. I was just wondering how difficult / feasible this would be to implement. Do we even need Peter's renderer for it? You could use the database and the valid_from / valid_to processing used in the views to get the before/after state and do whatever you want (ie compare version minor version to find affected items). Just use this clause in your where-statement to get all items at this point in time: '2010-01-01' BETWEEN valid_from AND COALESCE(valid_to, '-12-31') Take a look at render.py to see how it's used. [1] https://github.com/MaZderMind/osm-history-renderer Peter ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev -- martijn van exel geospatial omnivore 1109 1st ave #2 salt lake city, ut 84103 801-550-5815 http://oegeo.wordpress.com ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] ogr2poly.py with buffering and simplifying
I created a Python script to convert OGR supported files (Shapefile and many others) to the polygon filter file format used by Osmosis and other tools. It will optionally buffer and simplify polygons for you. You can buffer point and line features to create polys as well. My motivation was for extracting OSM data for county political and school districts, the boundaries of which are provided as Shapefiles. I could have assembled ogr2osm, polyconvert, polybuffer, and simplify-poly, but writing this seemed easier. Take a look here, and please provide any comments. I can put it on the OSM SVN later: https://gist.github.com/1434632 -Josh ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] ogr2poly.py with buffering and simplifying
Josh, On 12/05/2011 07:29 PM, Josh Doe wrote: I created a Python script to convert OGR supported files (Shapefile and many others) to the polygon filter file format used by Osmosis and other tools. It will optionally buffer and simplify polygons for you. You can buffer point and line features to create polys as well. I have something similar done in C but always found it too fragile to share: http://www.remote.org/frederik/tmp/clipgen.cc It takes a relation/xxx/full OSM as input, and writes out an OSM file again (which you can view/modify in JOSM then convert to poly). The clou with this one is that it will buffer and simplify but it will guarantee that the original polygon is always fully contained in the result - i.e. it will never cut off an edge through over-eager simplification. This is done not by clever algorithms but by simply grinding through a number of buffer and simplification parameters until the desired result is found. I have found this to work well for polygon generation, except the glitch explained here http://www.osgeo.org/pipermail/geos-devel/2011-May/005208.html. If you can solve *that* problem then I'll even consider installing Python. Bye Frederik -- Frederik Ramm ## eMail frede...@remote.org ## N49°00'09 E008°23'33 ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] idea: before-after map
Hi Am 05.12.2011 19:11, schrieb Martijn van Exel: For it to work (for current changesets) though, we would need a continuously updated full history database.. Doing the import is one thing, doing the update is a whle different thing. Both being mixed up into the same application results in a lot of not-so-nice and not-so-well-optimized code (see osm2pgsql). For updates you'll need a different cache strategy, a different level of access to the database and different algorithms. For me, cleaning up the importer, adding multipolygon and route-support as well as optimizing the importer to be able to handle full-planet-full-history imports is higher on the priority list then an updater, and you'll, have to live with that ;) I'd love to see those tools sketched out on the data we have already. Developing a nice before/after/diff app is a really complex task and maybe if the app is finished, the updater is, too. Don't wait for other tasks beeing completed if you could work with the things that are in place already. Peter ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Script to merge ways with identical tags
I'm trying to convert a Shapefile of my county's streets to OSM (not for mass imports, trust me), but every street is broken at intersections so there are often dozens or more segments that should be joined. Anyone have scripts or code to perform this sort of way-merging? I did come across Frederik's merge-ways.pl script, but I didn't have much luck with it and it seems to be designed for rendering purposes. Thanks, -Josh ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Script to merge ways with identical tags
I have some code in shp-to-osm that does glomming, but it's really not any smarter than storing all node locations in memory and check for overlaps. I think ogr2osm does something similar. Neither are in a good position to help with an existing OSM file, though. On Mon, Dec 5, 2011 at 7:13 PM, Josh Doe j...@joshdoe.com wrote: I'm trying to convert a Shapefile of my county's streets to OSM (not for mass imports, trust me), but every street is broken at intersections so there are often dozens or more segments that should be joined. Anyone have scripts or code to perform this sort of way-merging? I did come across Frederik's merge-ways.pl script, but I didn't have much luck with it and it seems to be designed for ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Script to merge ways with identical tags
On Martes, 6 de Diciembre de 2011 02:21:13 Ian Dees escribió: I have some code in shp-to-osm that does glomming, but it's really not any smarter than storing all node locations in memory and check for overlaps. I think ogr2osm does something similar. Yeah, ogr2osm splits linestrings into tagged segments, then loops through segment endpoints, checking if any segments have the same tags, etc etc etc. (Still got to work in a new version of ogr2osm, though) -- -- Iván Sánchez Ortega i...@sanchezortega.es i...@geonerd.org Aviso: Este e-mail es confidencial y no debería ser usado por nadie que no sea el destinatario original. No se permite la reproducción mediante fotocopia, walkie-talkie, emisora de radioaficionado, satélite, televisión por cable, proyector, señales de humo, código morse, braille, lenguaje de signos, taquigrafía o cualquier otro medio. Bajo ningún concepto debe traducirse al francés este e-mail. Este e-mail no puede ser ridiculizado, parodiado, juzgado en una competición, o leído en voz alta con un acento gracioso llevando un bigote falso y/o cualquier tipo de sombrero, incluyendo pero no limitándose a pañuelos. No inciten ni provoquen a este e-mail. Si está medicándose, puede experimentar nauseas, desorientación, histeria, vómitos, pérdida temporal de la memoria a corto plazo y malestar general al leer este e-mail. Consulte a su médico o farmacéutico antes de leer este e-mail. Todas las modelos descritas en este e-mail son mayores de 18 años. Este e-mail se reserva el derecho de admisión. Si ha recibido este e-mail por error es probablemente porque estaba borracho cuando escribí la dirección del destinatario. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Script to merge ways with identical tags
On 12/5/2011 8:13 PM, Josh Doe wrote: I'm trying to convert a Shapefile of my county's streets to OSM (not for mass imports, trust me), but every street is broken at intersections so there are often dozens or more segments that should be joined. Anyone have scripts or code to perform this sort of way-merging? I did come across Frederik's merge-ways.pl script, but I didn't have much luck with it and it seems to be designed for rendering purposes. I wrote a general purpose Glommer last year in C# / .NET Visual Studio 2010 that operates on OSM files and does just what you are looking for - it combines ways which have identical tags. Let me know if you're interested and I'll arrange to send it. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] osm2pgsql not appending changeset?
Hi, I'm trying to append a changeset to an existing OSM database using osm2pgsql, but it seems nothing is appended. I have a database which just had planet-09.osm.bz2 imported. I'm trying to apply changesets-16.osm.bz2 using the command: $ osm2pgsql -d osm -S /usr/share/osm2pgsql/default.style --append -G -v -m -K changesets-16.osm.bz2 and this is what I get: $ osm2pgsql -d osm -S /usr/share/osm2pgsql/default.style --append -G -v -m -K changesets-16.osm.bz2 osm2pgsql SVN version 0.70.5 Using projection SRS 900913 (Spherical Mercator) Setting up table: planet_osm_point NOTICE: table planet_osm_point_tmp does not exist, skipping Setting up table: planet_osm_line NOTICE: table planet_osm_line_tmp does not exist, skipping Setting up table: planet_osm_polygon NOTICE: table planet_osm_polygon_tmp does not exist, skipping Setting up table: planet_osm_roads NOTICE: table planet_osm_roads_tmp does not exist, skipping Mid: Ram, scale=100 Reading in file: changesets-16.osm.bz2 Unknown node type 8 Processing: Node(0k) Way(0k) Relation(0) parse time: 149s Writing way (0k) Writing relation (0) Committing transaction for planet_osm_point Committing transaction for planet_osm_polygon Committing transaction for planet_osm_line Completed planet_osm_point Committing transaction for planet_osm_roads Completed planet_osm_line Completed planet_osm_polygon Completed planet_osm_roads so it seems no nodes, ways, relations, nothing were added. what could be wrong? Akos PS: information about the changeset file: $ md5sum changesets-16.osm.bz2 d21edb7ad9c44ea6d0faddf864487405 changesets-16.osm.bz2 which matches the md5sum found on the osm download server ftp://ftp.spline.de/pub/openstreetmap/ ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev