Re: [OSM-dev] osmium trouble

2011-11-21 Thread Jochen Topf
On Sun, Nov 20, 2011 at 03:34:27PM -0700, Martijn van Exel wrote: I also ran into trouble with files of around 40MB or larger. I still get the same errors though, either using array or sparsetable for node storage. I'm on Ubuntu 10.04 64 bit with 16GB RAM. Can you post the script you are

Re: [OSM-dev] osmium trouble

2011-11-21 Thread Hermann Peifer
On 21/11/2011 08:13, Jochen Topf wrote: On Sun, Nov 20, 2011 at 03:34:27PM -0700, Martijn van Exel wrote: I also ran into trouble with files of around 40MB or larger. I still get the same errors though, either using array or sparsetable for node storage. I'm on Ubuntu 10.04 64 bit with 16GB

[OSM-dev] Memory-Leak in osmium

2011-11-21 Thread Peter Körner
Hi I found a memory-leak in osmium-master. I compiled the osmium_progress example and fed germany.osh.pbf http://ftp5.gwdg.de/pub/misc/openstreetmap/osm-full-history-extracts/110919/pbf/europe/germany.osh.pbf into it. During the nodes processing the program takes 70 MB of RAM. When it

Re: [OSM-dev] Memory-Leak in osmium

2011-11-21 Thread Peter Körner
Hi Am 21.11.2011 12:07, schrieb Peter Körner: I found a memory-leak in osmium-master. Digging into it, it seems that the pbf reader is leaking memory. I attached valgrind-massif output for running osmium_progess against mainz.osh.pbf and mainz.osh. The pbf-run took nearly 44x the memory of

Re: [OSM-dev] Memory-Leak in osmium

2011-11-21 Thread Jochen Topf
On Mon, Nov 21, 2011 at 12:07:42PM +0100, Peter Körner wrote: I found a memory-leak in osmium-master. I compiled the osmium_progress example and fed germany.osh.pbf http://ftp5.gwdg.de/pub/misc/openstreetmap/osm-full-history-extracts/110919/pbf/europe/germany.osh.pbf into it. During the

Re: [OSM-dev] osmium trouble

2011-11-21 Thread Jochen Topf
On Mon, Nov 21, 2011 at 10:33:40AM +0100, Hermann Peifer wrote: On 21/11/2011 08:13, Jochen Topf wrote: On Sun, Nov 20, 2011 at 03:34:27PM -0700, Martijn van Exel wrote: I also ran into trouble with files of around 40MB or larger. I still get the same errors though, either using array or

Re: [OSM-dev] Memory-Leak in osmium

2011-11-21 Thread Peter Körner
Am 21.11.2011 15:36, schrieb Jochen Topf: I don't think that there is a memory leak. Valgrind tells me that all is ok. A program can leak memory without valgrind showing it. I already guessed that this data is not completely useless. The behaviour you see comes from the PBF reader and

Re: [OSM-dev] osmium trouble

2011-11-21 Thread Martijn van Exel
Sure, it's on github -- https://github.com/mvexel/OSMQualityMetrics FYI I did compile against the latest v8 from svn. Martijn On Mon, Nov 21, 2011 at 12:13 AM, Jochen Topf joc...@remote.org wrote: On Sun, Nov 20, 2011 at 03:34:27PM -0700, Martijn van Exel wrote: I also ran into trouble with

Re: [OSM-dev] osmium trouble

2011-11-21 Thread Jochen Topf
Hi! You are keeping a lot of data around (users and ages array, nodes hash). Are you sure thats not the problem? There are about 50 user IDs now, so if a user with id 50 comes along the users array is expanded to that size. I have no idea how much memory Javascript will need for an empty

[OSM-dev] Overpass API: new big server, IPv6

2011-11-21 Thread Roland Olbricht
Hello everybody, there are two new amazing news around Overpass API: I'm happy to announce a much more powerful (8-core, 64 GB RAM) machine, hosted voluntarily by Rambler. It offers the full interface of currently Overpass API 0.6.94, including meta data. Please have a try at

[Potlatch-dev] [OpenStreetMap] #4098: Wireframe style to show licence status

2011-11-21 Thread OpenStreetMap
#4098: Wireframe style to show licence status -+-- Reporter: Socks| Owner: potlatch-dev@… Type: enhancement | Status: new Priority: minor|