Re: [GraphHopper] Running out of heap space when starting webapp with large .osm.pbf

Fri, 10 Oct 2014 06:22:01 -0700 

Hi Nate, I assume that the issue is that the java virtual machine is
running out of memory.
So you can modify the maximum Java heap size with the parameter
-Xmx
For instance
java -Xmx1024m -jar graphhopper-web-0.3-with-dep.jar -Xmx7g jetty.resourcebase=webapp config=config-example.properties osmreader.osm=./north-america-latest.osm.pbf 


So you are giving to the java virtual machine 1024MB (maximum) for 
memory, if you run out of memory again

you can increase.

Well, best regards
Álvaro Monares G.

El 10-10-2014 10:10, Nate Atkinson escribió:

Hi Muhammad,

I'd be happy to give this a try. I'm not so familiar with java, and
internet searching for application tag / manifest / "largeHeap = true"
seems to lead me to Android resources. In this case, I'm trying to use
the web application linked from the quickstart guide on a server running
Linux. Is this setting still relevant for non-Android systems? If so,
which config file should I change?

Best Regards,

Nate Atkinson

On 10/10/2014 07:47 AM, Muhammad Babar wrote:

Have you tried to set largeHeap = true in application tag (manifest)?

On Fri, Oct 10, 2014 at 5:29 PM, Nate Atkinson <[email protected]
<mailto:[email protected]>> wrote:

     Hi,

     I'm evaluating GraphHopper for integration with some software at work--
     specifically quickly generating geojson path for routes with up to 40
     stops. Using a small .osm.pbf file downloaded from geofabrik, it looks
     like GraphHopper will fit our needs well, and I'm excited to use it.

     When I try to use a larger .osm.pbf file, like the 6.2 GB file for North
     America, I get an error when trying to start.

     Here's what happens:

     nate@NateTestEnv:~/graphhopper$ java -jar
     graphhopper-web-0.3-with-dep.jar -Xmx7g jetty.resourcebase=webapp
     config=config-example.properties
     osmreader.osm=./north-america-latest.osm.pbf

     2014-10-09 13:02:38,259 [main] INFO  com.graphhopper.GraphHopper -
     version 0.3|2014-05-13T11:36:30+0200 (3,5,3,2,2)
     2014-10-09 13:02:38,275 [main] INFO  com.graphhopper.GraphHopper - graph
     LevelGraphStorage|car|MMAP_STORE_SYNC|2D|,,,,, details:edges:0(0),
     nodes:0(0), name: - (0), geo:0(0),
     
bounds:1.7976931348623157E308,-1.7976931348623157E308,1.7976931348623157E308,-1.7976931348623157E308
     2014-10-09 13:02:38,300 [main] INFO  com.graphhopper.GraphHopper - start
     creating graph from ./north-america-latest.osm.pbf
     2014-10-09 13:02:38,300 [main] INFO  com.graphhopper.GraphHopper - using
     LevelGraphStorage|car|MMAP_STORE_SYNC|2D|,,,,, memory:totalMB:120,
     usedMB:8
     2014-10-09 13:10:22,788 [main] INFO  graphhopper.reader.OSMReader -
     500 000 (preprocess), osmIdMap:6 959 244 (86MB) totalMB:723, usedMB:297

     ....

     2014-10-09 13:13:01,288 [main] INFO  graphhopper.reader.OSMReader -
     10 000 000 (preprocess), osmIdMap:137 558 252 (1630MB) totalMB:1895,
     usedMB:1726
     Exception in thread "pool-1-thread-2" java.lang.OutOfMemoryError: GC
     overhead limit exceeded
             at
     gnu.trove.list.array.TLongArrayList.ensureCapacity(TLongArrayList.java:186)
             at
     gnu.trove.list.array.TLongArrayList.add(TLongArrayList.java:221)
             at
     
com.graphhopper.reader.pbf.PbfBlobDecoder.processWays(PbfBlobDecoder.java:286)
             at
     
com.graphhopper.reader.pbf.PbfBlobDecoder.processOsmPrimitives(PbfBlobDecoder.java:372)
             at
     
com.graphhopper.reader.pbf.PbfBlobDecoder.runAndTrapExceptions(PbfBlobDecoder.java:388)
             at
     com.graphhopper.reader.pbf.PbfBlobDecoder.run(PbfBlobDecoder.java:406)
     ....


     I get a similar message for a second thread. The process stays running,
     but I see no CPU activity in top.

     The system is running Debian wheezy. I tested with openjdk 1.6 and 1.7.

     So, how can I get this running with a large network? I'm sure there's a
     command line switch or config setting somewhere that I've missed due to
     my inexperience with java.

     Best regards,

     Nate Atkinson

     _______________________________________________
     GraphHopper mailing list
     [email protected] <mailto:[email protected]>
     https://lists.openstreetmap.org/listinfo/graphhopper




_______________________________________________
GraphHopper mailing list
[email protected]
https://lists.openstreetmap.org/listinfo/graphhopper


_______________________________________________
GraphHopper mailing list
[email protected]
https://lists.openstreetmap.org/listinfo/graphhopper



_______________________________________________
GraphHopper mailing list
[email protected]
https://lists.openstreetmap.org/listinfo/graphhopper






















					Reply via email to