Re: [OSM-dev-fr] Tunning de postgresql pour des bases osmosis et/ou osm2pgsql

2011-12-05 Thread Rodolphe Quiedeville

sly (sylvain letuffe) a écrit on 05/12/2011 15:19:

autovacuum = off

D'où vient ce autovacuum = off ?
C'est déconseillé dans les documentations récentes de postgresql.
Qu'est-ce-qui le justifie ?


Justification : pour aller encore plus vite
Contraintes : l'espace disque augmente encore plus vite que la taille OSM à
cause des trous dans la structure de fichier postgresql lors des
suppressions.

Je viens de le remettre chez moi pour voir si c'est pénalisant, sinon, il y'a
la solution de lancer un VACUUM manuel de temps en temps (au moment où la
machine est plus tranquille) pour purger ces trous


A propos de VACUMM le vacuum full est désormais déconseillé à partir de 
le 9.0


http://wiki.postgresql.org/wiki/VACUUM_FULL

A++

--
Rodolphe Quiédeville
http://cartosm.eu - Intégration de carte libre sur site web
Blog : http://blog.rodolphe.quiedeville.org/
SIP/XMPP : rodol...@quiedeville.org

___
dev-fr mailing list
dev-fr@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev-fr


Re: [OSM-dev] New transport render (and bugs on ÁÉÍÓÚÑ)

2011-12-05 Thread Iván Sánchez Ortega
It seems that everything renders as it should now - so thanks to everyone 
involved! :-)

-- 
--
Iván Sánchez Ortega i...@sanchezortega.es i...@geonerd.org


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Overpass API and JOSM

2011-12-05 Thread Iván Sánchez Ortega
Hi all,

I'm trying to download a chunk of data via the Overpass API, load it into 
JOSM, so I can change some stuff and upload it back.

The problem is that JOSM will nag about the data not having the version 
number, with a message like missing attribute 'version' in OSM primitive with 
ID 123457, in line bleh.


The overpass query I'm using is:

wget --timeout 0 http://www.overpass-api.de/api/xapi?*[shop=supermarket]
[bbox=-4.43,41.42,-2.41,43.23] -O supermarkets_burgos.osm



Things I'm not capable of doing: modifying the overpass API so it includes the 
latest known version number, or modifying JOSM to query the version number of 
the object IDs in a file without version numbers.

Any insights?

-- 
--
Iván Sánchez Ortega i...@sanchezortega.es i...@geonerd.org


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] New transport render (and bugs on ÁÉÍÓÚÑ)

2011-12-05 Thread Andre Joost

Hi,

Jet another problem: we have some trolley-busses in Germany, which won't 
get rendered, for example this relation:


http://www.openstreetmap.org/api/0.6/relation/1731914

I wouldn't mind if you render it as a normal bus.

Greetings,
andré Joost


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] New transport layer

2011-12-05 Thread marqqs
Hi Andy,

thanks for your work, it's good to have a transport layer in official OSM map 
now. :-)

I'm still not sure what you want to display on the map. Is it the Hardware 
(e.g. rails, streets) or is it the Software (transport lines, etc.)?

An example:
For buses you show the bus LINES, for railways you show the RAILS. There are 
tons of railways which aren't really in use (some of them temporary for goods, 
some of them never). Please compare the transport maps (example region Upstate, 
NY):

Official transport layer:
http://www.openstreetmap.org/?lat=41.96lon=-75.82zoom=8layers=T
openbusmap.org:
http://www.openbusmap.org/?lat=41.96lon=-75.82zoom=8layers=B
openptmap.org:
http://www.openptmap.org/?lat=41.96lon=-75.82zoom=8layers=B

trolleybuses, trams, ferries, aerialways, etc.:
I'll be happy to help with the openptmap's Mapnik style file if you like. 
Examples:

Arealways: 
http://openptmap.org/?zoom=15lat=46.21553lon=7.82773layers=BTFT
Trolleybuses (dark red): 
http://openptmap.org/?zoom=14lat=47.37499lon=8.53419layers=0B000TFT

Regards
Markus

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] New transport layer

2011-12-05 Thread Iván Sánchez Ortega
On Lunes, 5 de Diciembre de 2011 11:05:34 Andy Allan escribió:
 Ah yes - I forgot to report back that I had fixed it. Thanks to
 Laurence for some off-list help with this - I've switched to a
 different font now that isn't so messed up.

Oh sucks. The old font was cooler. Any chance it can be fixed?



On Lunes, 5 de Diciembre de 2011 15:51:24 mar...@gmx.eu escribió:
 I'm still not sure what you want to display on the map. Is it the Hardware
 (e.g. rails, streets) or is it the Software (transport lines, etc.)?

two_centsIMHO

Bus routes are too prominent - I would expect a finer line, and maybe some 
transparency.

Plus, one-way arrows, öpvnkarte-style.

Besides, I encourage you to have a peek into my hometown's transport maps:

http://www.madrid.org/cs/Satellite?c=CM_InfPractica_FAcid=1142558832294pagename=ComunidadMadrid%2FEstructura

Particularly, the series-3 25MB monster, or some of the smaller Series-5. Note 
the different color for the regular(red), intercity(green) and night(black-
yellow) buses, how the subway/light-rail lines/routes are even more prominent 
than bus routes, the one-way shields, the line numbers on subway stations, and 
whatnot. They're worth a look, really.

Anyway, back to the point: note how the bus route lines are thinner than the 
road itself. The current equal-width transport map can be confusing (Is that a 
road, or is it something else?)

/IMHO/two_cents


Cheers,
-- 
--
Iván Sánchez Ortega i...@sanchezortega.es i...@geonerd.org

Yo soy capaz de reconocer los aspectos positivos de la influencia de las 
religiones a lo largo de la historia. Por ejemplo, les debemos la creación de 
calendarios racionales que tan útiles han sido, aunque sinceramente, soy 
incapaz de recordar alguno más.
  -- Isaac Asimov.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] idea: before-after map

2011-12-05 Thread Martijn van Exel
Hi,

Now that we have the history files and a history renderer in the
making [1] it would be possible to create a Before / After service:
user would select one or a few concurrent changesets comprising an
edit session, and the service would churn out a pretty HTML page with
a static map of the area just prior to the changesets affecting the
area and just after the last ones were closed.

I was just wondering how difficult / feasible this would be to
implement. Do we even need Peter's renderer for it?

[1] https://github.com/MaZderMind/osm-history-renderer

-- 
martijn van exel
geospatial omnivore
1109 1st ave #2
salt lake city, ut 84103
801-550-5815
http://oegeo.wordpress.com

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] idea: before-after map

2011-12-05 Thread Peter Körner

Am 05.12.2011 18:08, schrieb Martijn van Exel:

Hi,

Now that we have the history files and a history renderer in the
making [1] it would be possible to create a Before / After service:
user would select one or a few concurrent changesets comprising an
edit session, and the service would churn out a pretty HTML page with
a static map of the area just prior to the changesets affecting the
area and just after the last ones were closed.

I was just wondering how difficult / feasible this would be to
implement. Do we even need Peter's renderer for it?


You could use the database and the valid_from / valid_to processing used 
in the views to get the before/after state and do whatever you want (ie 
compare version  minor version to find affected items).


Just use this clause in your where-statement to get all items at this 
point in time:

'2010-01-01' BETWEEN valid_from AND COALESCE(valid_to, '-12-31')

Take a look at render.py to see how it's used.


[1] https://github.com/MaZderMind/osm-history-renderer


Peter

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] idea: before-after map

2011-12-05 Thread Martijn van Exel
Thanks,

For it to work (for current changesets) though, we would need a
continuously updated full history database..

On Mon, Dec 5, 2011 at 10:46 AM, Peter Körner osm-li...@mazdermind.de wrote:
 Am 05.12.2011 18:08, schrieb Martijn van Exel:

 Hi,

 Now that we have the history files and a history renderer in the
 making [1] it would be possible to create a Before / After service:
 user would select one or a few concurrent changesets comprising an
 edit session, and the service would churn out a pretty HTML page with
 a static map of the area just prior to the changesets affecting the
 area and just after the last ones were closed.

 I was just wondering how difficult / feasible this would be to
 implement. Do we even need Peter's renderer for it?


 You could use the database and the valid_from / valid_to processing used in
 the views to get the before/after state and do whatever you want (ie compare
 version  minor version to find affected items).

 Just use this clause in your where-statement to get all items at this point
 in time:
 '2010-01-01' BETWEEN valid_from AND COALESCE(valid_to, '-12-31')

 Take a look at render.py to see how it's used.

 [1] https://github.com/MaZderMind/osm-history-renderer


 Peter

 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev



-- 
martijn van exel
geospatial omnivore
1109 1st ave #2
salt lake city, ut 84103
801-550-5815
http://oegeo.wordpress.com

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] ogr2poly.py with buffering and simplifying

2011-12-05 Thread Josh Doe
I created a Python script to convert OGR supported files (Shapefile
and many others) to the polygon filter file format used by Osmosis and
other tools. It will optionally buffer and simplify polygons for you.
You can buffer point and line features to create polys as well.

My motivation was for extracting OSM data for county political and
school districts, the boundaries of which are provided as Shapefiles.
I could have assembled ogr2osm, polyconvert, polybuffer, and
simplify-poly, but writing this seemed easier.

Take a look here, and please provide any comments. I can put it on the
OSM SVN later:
https://gist.github.com/1434632

-Josh

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] ogr2poly.py with buffering and simplifying

2011-12-05 Thread Frederik Ramm

Josh,

On 12/05/2011 07:29 PM, Josh Doe wrote:

I created a Python script to convert OGR supported files (Shapefile
and many others) to the polygon filter file format used by Osmosis and
other tools. It will optionally buffer and simplify polygons for you.
You can buffer point and line features to create polys as well.


I have something similar done in C but always found it too fragile to share:

http://www.remote.org/frederik/tmp/clipgen.cc

It takes a relation/xxx/full OSM as input, and writes out an OSM file 
again (which you can view/modify in JOSM then convert to poly).


The clou with this one is that it will buffer and simplify but it will 
guarantee that the original polygon is always fully contained in the 
result - i.e. it will never cut off an edge through over-eager 
simplification. This is done not by clever algorithms but by simply 
grinding through a number of buffer and simplification parameters until 
the desired result is found.


I have found this to work well for polygon generation, except the glitch 
explained here 
http://www.osgeo.org/pipermail/geos-devel/2011-May/005208.html. If you 
can solve *that* problem then I'll even consider installing Python.


Bye
Frederik

--
Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09 E008°23'33

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] idea: before-after map

2011-12-05 Thread Peter Körner

Hi

Am 05.12.2011 19:11, schrieb Martijn van Exel:

For it to work (for current changesets) though, we would need a
continuously updated full history database..


Doing the import is one thing, doing the update is a whle different thing. Both 
being mixed up into the same application results in a lot of not-so-nice and 
not-so-well-optimized code (see osm2pgsql). For updates you'll need a different 
cache strategy, a different level of access to the database and different 
algorithms.

For me, cleaning up the importer, adding multipolygon and route-support as well 
as optimizing the importer to be able to handle full-planet-full-history 
imports is higher on the priority list then an updater, and you'll, have to 
live with that ;)

I'd love to see those tools sketched out on the data we have already. 
Developing a nice before/after/diff app is a really complex task and maybe if 
the app is finished, the updater is, too. Don't wait for other tasks beeing 
completed if you could work with the things that are in place already.

Peter

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] Script to merge ways with identical tags

2011-12-05 Thread Josh Doe
I'm trying to convert a Shapefile of my county's streets to OSM (not
for mass imports, trust me), but every street is broken at
intersections so there are often dozens or more segments that should
be joined. Anyone have scripts or code to perform this sort of
way-merging? I did come across Frederik's merge-ways.pl script, but I
didn't have much luck with it and it seems to be designed for
rendering purposes.

Thanks,
-Josh

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Script to merge ways with identical tags

2011-12-05 Thread Ian Dees
I have some code in shp-to-osm that does glomming, but it's really not
any smarter than storing all node locations in memory and check for
overlaps. I think ogr2osm does something similar. Neither are in a good
position to help with an existing OSM file, though.

On Mon, Dec 5, 2011 at 7:13 PM, Josh Doe j...@joshdoe.com wrote:

 I'm trying to convert a Shapefile of my county's streets to OSM (not
 for mass imports, trust me), but every street is broken at
 intersections so there are often dozens or more segments that should
 be joined. Anyone have scripts or code to perform this sort of
 way-merging? I did come across Frederik's merge-ways.pl script, but I
 didn't have much luck with it and it seems to be designed for
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Script to merge ways with identical tags

2011-12-05 Thread Iván Sánchez Ortega
On Martes, 6 de Diciembre de 2011 02:21:13 Ian Dees escribió:
 I have some code in shp-to-osm that does glomming, but it's really not
 any smarter than storing all node locations in memory and check for
 overlaps. I think ogr2osm does something similar.

Yeah, ogr2osm splits linestrings into tagged segments, then loops through 
segment endpoints, checking if any segments have the same tags, etc etc etc.

(Still got to work in a new version of ogr2osm, though)

-- 
--
Iván Sánchez Ortega i...@sanchezortega.es i...@geonerd.org

Aviso: Este e-mail es confidencial y no debería ser usado por nadie que no sea 
el destinatario original. No se permite la reproducción mediante fotocopia, 
walkie-talkie, emisora de radioaficionado, satélite, televisión por cable, 
proyector, señales de humo, código morse, braille, lenguaje de signos, 
taquigrafía o cualquier otro medio. Bajo ningún concepto debe traducirse al 
francés este e-mail. Este e-mail no puede ser ridiculizado, parodiado, juzgado 
en una competición, o leído en voz alta con un acento gracioso llevando un 
bigote falso y/o cualquier tipo de sombrero, incluyendo pero no limitándose a 
pañuelos. No inciten ni provoquen a este e-mail. Si está medicándose, puede 
experimentar nauseas, desorientación, histeria, vómitos, pérdida temporal de 
la memoria a corto plazo y malestar general al leer este e-mail. Consulte a su 
médico o farmacéutico antes de leer este e-mail. Todas las modelos descritas 
en este e-mail son mayores de 18 años. Este e-mail se reserva el derecho de 
admisión. Si ha recibido este e-mail por error es probablemente porque estaba 
borracho cuando escribí la dirección del destinatario.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Script to merge ways with identical tags

2011-12-05 Thread Mike N

On 12/5/2011 8:13 PM, Josh Doe wrote:

I'm trying to convert a Shapefile of my county's streets to OSM (not
for mass imports, trust me), but every street is broken at
intersections so there are often dozens or more segments that should
be joined. Anyone have scripts or code to perform this sort of
way-merging? I did come across Frederik's merge-ways.pl script, but I
didn't have much luck with it and it seems to be designed for
rendering purposes.


  I wrote a general purpose Glommer last year in C# / .NET Visual 
Studio 2010 that operates on OSM files and does just what you are 
looking for - it combines ways which have identical tags.   Let me know 
if you're interested and I'll arrange to send it.



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] osm2pgsql not appending changeset?

2011-12-05 Thread Ákos Maróy
Hi,

I'm trying to append a changeset to an existing OSM database using
osm2pgsql, but it seems nothing is appended.

I have a database which just had planet-09.osm.bz2 imported. I'm
trying to apply changesets-16.osm.bz2 using the command:

$ osm2pgsql -d osm -S /usr/share/osm2pgsql/default.style --append -G -v
-m -K changesets-16.osm.bz2

and this is what I get:

$ osm2pgsql -d osm -S /usr/share/osm2pgsql/default.style --append -G -v
-m -K changesets-16.osm.bz2
osm2pgsql SVN version 0.70.5

Using projection SRS 900913 (Spherical Mercator)
Setting up table: planet_osm_point
NOTICE:  table planet_osm_point_tmp does not exist, skipping
Setting up table: planet_osm_line
NOTICE:  table planet_osm_line_tmp does not exist, skipping
Setting up table: planet_osm_polygon
NOTICE:  table planet_osm_polygon_tmp does not exist, skipping
Setting up table: planet_osm_roads
NOTICE:  table planet_osm_roads_tmp does not exist, skipping
Mid: Ram, scale=100

Reading in file: changesets-16.osm.bz2
Unknown node type 8
Processing: Node(0k) Way(0k) Relation(0)  parse time: 149s

Writing way (0k)

Writing relation (0)
Committing transaction for planet_osm_point
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_line
Completed planet_osm_point
Committing transaction for planet_osm_roads
Completed planet_osm_line
Completed planet_osm_polygon
Completed planet_osm_roads



so it seems no nodes, ways, relations, nothing were added.

what could be wrong?


Akos

PS: information about the changeset file:

$ md5sum changesets-16.osm.bz2
d21edb7ad9c44ea6d0faddf864487405  changesets-16.osm.bz2

which matches the md5sum found on the osm download server
ftp://ftp.spline.de/pub/openstreetmap/

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev