Hello, it took ~20GB of RAM to import an OSM file of 5GB size (even if the resulting net was only 1GB in size). Either do this with more RAM or prune the OSM file in advance (there seem to be plenty of tools for that). regards, Jakob
2014-03-24 10:37 GMT+01:00 Pieter Loof <[email protected]>: > Hi, > > My system is 64 bit and I use sumo 0.20.0 in 64 bit mode too I guess. Since > when I close all my programs except the task manager and run netconvert > from command line, then netconvert builds up to a memory of about 6.5 GB, > then the command stops with message "killed". I tried it with > "--no-internal-links" this time, but this did not help. Since I actually > only want to have the node and edge file, I even tried removing the output > option for writing the .net.xml file, but this also does not work. I do > want some processing options like ramp guessing, so I do need netconvert at > this point. The input osm file is a bit larger than I originally expected: > 8.8 GB. > > Best regards, > Pieter > > > > ------------------------------ > > > > Message: 5 > > Date: Fri, 21 Mar 2014 18:24:26 +0100 > > From: Pieter Loof <[email protected]> > > Subject: [sumo-user] Import large networks > > To: sumo-user <[email protected]> > > Message-ID: > > <CANjCX0fuGaf== > > [email protected]> > > Content-Type: text/plain; charset=ISO-8859-1 > > > > Hi, > > > > I just tried to import a network from osm data that is rather large, > using > > netconvert. However, after a few minutes netconvert stops with an error > > (137). Using the task manager I found out that the memory usage of > > netconvert keeps increasing during those minutes, until some swap process > > starts and then netconvert exits without having written anything to its > log > > file. > > > > I already preprocessed the osm input file using Osmosis, so the correct > > area is filtered and all irrelevant osm data, including most low-priority > > roads, is filtered out. However, after this process, the final file is > > still a few gigabyte. > > > > Is there any way to run netconvert with less memory (which may take > longer > > of course)? I could not find such an option in the documentation so far. > Is > > there some other workaround possible? > > > > Best regards, > > Pieter > > > > > > ------------------------------ > > > > Message: 6 > > Date: Fri, 21 Mar 2014 21:39:58 +0100 > > From: Michael Behrisch <[email protected]> > > Subject: Re: [sumo-user] Import large networks > > To: [email protected] > > Message-ID: <[email protected]> > > Content-Type: text/plain; charset=ISO-8859-1 > > > > Am 21.03.2014 18:24, schrieb Pieter Loof: > > > Hi, > > > > > > I just tried to import a network from osm data that is rather large, > > using > > > netconvert. However, after a few minutes netconvert stops with an error > > > (137). Using the task manager I found out that the memory usage of > > > netconvert keeps increasing during those minutes, until some swap > process > > > starts and then netconvert exits without having written anything to its > > log > > > file. > > > > Probably it ran out of memory. If you are hitting the 2GB barrier, you > > should try a 64bit system and the 64bit build. If you do not need > > precise driving over the junction you can use "--no-internal-links" > > which reduces network size considerably. > > > > Best regards, > > Michael > > > > ------------------------------------------------------------------------------ > Learn Graph Databases - Download FREE O'Reilly Book > "Graph Databases" is the definitive new guide to graph databases and their > applications. Written by three acclaimed leaders in the field, > this first edition is now available. Download your free book today! > http://p.sf.net/sfu/13534_NeoTech > _______________________________________________ > sumo-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/sumo-user > ------------------------------------------------------------------------------ Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/13534_NeoTech _______________________________________________ sumo-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/sumo-user
