Re: [OSM-dev] Osm2pgsql and failed planet import

2011-09-11 Thread Martijn van O
On 30 August 2011 20:47, Frederik Ramm wrote: > I guess this needs some thorough investigation and I always hoped that > someone more familar with that part of the code (hint, hint) would find the > time to have a look ;) I guess it would be helpful if someone with this error could actually look

Re: [OSM-dev] Osm2pgsql and failed planet import

2011-08-31 Thread Hartmut Holzgraefe
On 08/30/2011 11:50 AM, John Smith wrote: > osm2pgsql doesn't have any code to check for memory allocation > failures and to deal with it in a sane way, it just assumes all > allocations are fine until it checks the nodes when going over pending > ways etc. Anthony posted a patch a couple of month

Re: [OSM-dev] Osm2pgsql and failed planet import

2011-08-30 Thread John Smith
On 31 August 2011 02:44, Hartmut Holzgraefe wrote: > i'm not aware of any other patch, but i changed the cache allocation http://lists.openstreetmap.org/pipermail/dev/2011-June/023002.html ___ dev mailing list dev@openstreetmap.org http://lists.openstr

Re: [OSM-dev] Osm2pgsql and failed planet import

2011-08-30 Thread Frederik Ramm
Hi, On 08/30/2011 07:43 PM, Martijn van O wrote: The error message discussed here is not a segfault, but an out of memory condition reported by the PostgreSQL client library. It has nothing to do with osm2pgsql's own memory allocation. This indicates the code should be changed to retrieve the

Re: [OSM-dev] Osm2pgsql and failed planet import

2011-08-30 Thread Francisco.Matamala
I will look into the code that pre-allocates memory, this definitely sounds like a good idea. Out of curiosity, has anyone else reported problems with full planet imports lately? Thank you to everyone for their input and time. -- View this message in context: http://gis.638310.n2.nabble.com/Osm

Re: [OSM-dev] Osm2pgsql and failed planet import

2011-08-30 Thread Martijn van O
On 30 August 2011 12:07, Frederik Ramm wrote: > Hi, > > On 08/30/11 11:50, John Smith wrote: >> >> osm2pgsql doesn't have any code to check for memory allocation >> failures and to deal with it in a sane way > > The error message discussed here is not a segfault, but an out of memory > condition r

Re: [OSM-dev] Osm2pgsql and failed planet import

2011-08-30 Thread Frederik Ramm
Hi, On 08/30/11 11:50, John Smith wrote: osm2pgsql doesn't have any code to check for memory allocation failures and to deal with it in a sane way The error message discussed here is not a segfault, but an out of memory condition reported by the PostgreSQL client library. It has nothing to d

Re: [OSM-dev] Osm2pgsql and failed planet import

2011-08-30 Thread John Smith
On 27 August 2011 03:18, Francisco.Matamala wrote: > Hi everyone, > > I've been attempting to perform a planet import for mapnik rendering for > the past few weeks without success. I've setup my PostGreSQL database with > PostGis correctly, including the various parameter tweaks. I setup > Post

[OSM-dev] Osm2pgsql and failed planet import

2011-08-30 Thread Francisco.Matamala
Hi everyone, I've been attempting to perform a planet import for mapnik rendering for the past few weeks without success. I've setup my PostGreSQL database with PostGis correctly, including the various parameter tweaks. I setup PostGreSQL on a separate Windows Server 2008 box with 8GB RAM, in