Re: [OSRM-talk] osrm-extract hangs on osmosis updated germany file
Hi Patrick, On Tue, Jun 30, 2015 at 08:47:00AM +0200, Florian Lohoff wrote: Hi, On Tue, Jun 30, 2015 at 12:33:20AM +0200, Patrick Niklaus wrote: Seems like you have some ways in your data that reference non-existing nodes (otherwise the bug would not have hit). That can happen if changesets are accidentally skipped. Jochen Topf just a few days ago noted on talk we have those kinds of referential integrity problems in the main Database due to API bugs. Other people have since then spoken up and saw similar issues. Mail attached - So it might even be that the osm.pbf file is a real replica of the database If you can upload your extract somewhere I can try to replicate the crash. When at work i put it up somewhere .. http://osm.zz.de/germany.osm.pbf - Thats 2.4GByte germany.osm.pbf - extract - prepare - segfault with current osrm develop git. Alternatively here the already prepare osrm files 331MByte http://osm.zz.de/germany-osrm-extract-segfaults-on-prepare.tgz germany-osrm-extract-segfaults-on-prepare.tgz Containing -rw-r--r-- 1 flo flo 815984288 Jun 30 09:34 germany.osrm -rw-r--r-- 1 flo flo 8188054 Jun 30 09:34 germany.osrm.names -rw-r--r-- 1 flo flo 1322928 Jun 30 09:34 germany.osrm.restrictions -rw-r--r-- 1 flo flo20 Jun 30 09:22 germany.osrm.timestamp Flo -- Florian Lohoff f...@zz.de We need to self-defense - GnuPG/PGP enable your email today! signature.asc Description: Digital signature ___ OSRM-talk mailing list OSRM-talk@openstreetmap.org https://lists.openstreetmap.org/listinfo/osrm-talk
Re: [OSRM-talk] osrm-extract hangs on osmosis updated germany file
Hi, On Tue, Jun 30, 2015 at 12:33:20AM +0200, Patrick Niklaus wrote: Seems like you have some ways in your data that reference non-existing nodes (otherwise the bug would not have hit). That can happen if changesets are accidentally skipped. Jochen Topf just a few days ago noted on talk we have those kinds of referential integrity problems in the main Database due to API bugs. Other people have since then spoken up and saw similar issues. Mail attached - So it might even be that the osm.pbf file is a real replica of the database If you can upload your extract somewhere I can try to replicate the crash. When at work i put it up somewhere .. Flo -- Florian Lohoff f...@zz.de We need to self-defense - GnuPG/PGP enable your email today! ---BeginMessage--- Hi! I found two problems with the last planet file: 1. http://www.openstreetmap.org/relation/4695424 contains the deleted way http://www.openstreetmap.org/way/173633422 2. http://www.openstreetmap.org/way/57766265 is in the planet file in version=2, but it has been deleted long ago (version=3). These should, of course, never happen, and we have to find the bugs which caused this. Nobody seems to have noticed for months, so maybe they are not such big problems. :-) Jochen -- Jochen Topf joc...@remote.org http://www.jochentopf.com/ +49-351-31778688 ___ dev mailing list d...@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev ---End Message--- signature.asc Description: Digital signature ___ OSRM-talk mailing list OSRM-talk@openstreetmap.org https://lists.openstreetmap.org/listinfo/osrm-talk
Re: [OSRM-talk] osrm-extract hangs on osmosis updated germany file
On Mon, Jun 29, 2015 at 07:15:21PM +0200, Florian Lohoff wrote:
On Fri, Jun 26, 2015 at 07:31:39PM +0200, Florian Lohoff wrote:
Hi,
i am regularly (every 4 hours or so) generating a new germany file with
osmosis from planet diff (updating + cutting) and then convert it
with the default car profile.
Now i switched from 0.3.9 to git current and
osrm-extract now hangs, or takes infinite time.
For testing i used a germany file from download.geofabrik.de which
worked. Convert took 663.46s.
Now i used my file again and it is running for 2 hours at the same
file size.
[extractor] Sorting edges by renumbered start ... ok, after 16.5565s
I found the live-lock of the osrm-extract - Its caused by commit
break;
}
+// skip invalid edges
+if (all_edges_list[i].result.target == SPECIAL_NODEID)
+{
After adding an i++; here
+continue;
+}
I get segfault in osrm-prepare with that file:
[info] Input file: germany.osrm
[info] Restrictions file: germany.osrm.restrictions
[info] Profile: profile.lua
[info] Threads: 8
[info] Generating edge-expanded graph representation
[info] - 82673 restrictions.
[info] Importing n = 21965574 nodes
[info] - 44850 bollard nodes, 81913 traffic lights
[info] and 23226747 edges
[info] Graph loaded ok and has 23226747 edges
[info] Removing graph geometry while preserving topology
Segmentation fault
Going back to 0.3.9
*grmpf*
Flo
--
Florian Lohoff f...@zz.de
We need to self-defense - GnuPG/PGP enable your email today!
signature.asc
Description: Digital signature
___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk
