[mkgmap-dev] routing & rendering penalty with smaller tiles in splitter
Hi, I'm attempting to split the Philippines into smaller tiles using splitter. This is to make rendering faster. Currently I've tested with the following: --max-nodes=80 --max-nodes=40 --max-nodes=20 On my tests with mapsource and roadtrip, no routing and rendering problems so far. What do others experience when making smaller tiles? What is the "optimum" tile size for very dense data areas with minimal penalty for routing and rendering? -- cheers, maning -- "Freedom is still the most radical idea of all" -N.Branden wiki: http://esambale.wikispaces.com/ blog: http://epsg4253.wordpress.com/ -- ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2 of June 1 (all other contry extracts by gefabrik for Europe compiled except for Austria)
I fired up JOSM and deleted the myriad duplicate ways as no one else had bothered to do it. With luck, the austria map will build now. Cheers, Mark ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2
Hi Felix, > Well it does not look so bad that mkgmap should crash. There are about > 40-50 nodes that have no tags attached to them at all (except if someone > cleaned up before me looking at it). In my eyes this should not lead > mkgmap to crash. Ideally, yes, it shouldn't crash on any data but, at this time, mkgmap can't cope with a small area that contains more nodes/arcs than are allowed in a subdivision. I am not saying this issue cannot be fixed but, to me, it's a low priority because no "sensible" map should contain such a cluster of nodes. At least now it tells you where the problem area is. Cheers, Mark ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2
See, http://www.openstreetmap.org/?lat=47.13751&lon=15.46509&zoom=16 ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
[mkgmap-dev] Commit: r1056: Make error message more useful.
Version 1056 was commited by markb on 2009-06-02 12:40:07 +0100 (Tue, 02 Jun 2009) Make error message more useful. ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2
Hi Felix, > Hallo > Here is another file to test. I don't manage to compile it with --route > (even when parsing --ignore-osm-bounds which solved the problem for the > other sample). > Maybe you could have a look at it. > > http://openmtbmap.x-nation.de/maps/Debug/63660006.osm.gz I am about to commit another version that will give this message on that file: 2009/06/02 10:35:08 SEVERE (NOD1Part): BBox[47.13673/15.46656, 47.13673/15.46658] has zero width or height - does the OSM data near there contain zillions of nodes? So, check those coordinates! Cheers, Mark ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
[mkgmap-dev] mkgmap error with austria.osm.bz2
Hallo Here is another file to test. I don't manage to compile it with --route (even when parsing --ignore-osm-bounds which solved the problem for the other sample). Maybe you could have a look at it. http://openmtbmap.x-nation.de/maps/Debug/63660006.osm.gz Felix ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
[mkgmap-dev] Commit: r1055: Allow for extremely uneven distribution of nodes in subdivision.
Version 1055 was commited by markb on 2009-06-02 11:37:43 +0100 (Tue, 02 Jun 2009) Allow for extremely uneven distribution of nodes in subdivision. The last commit croaked on subdividing a region if all of the region's nodes went into the same sub-region. That is overly restrictive because you could possibly have a rectangular region where the nodes are only in one half of the region. This new commit now detects when a sub-region becomes impossibly small rather than worrying about the distribution of nodes in the sub-regions. ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
[mkgmap-dev] Commit: r1054: When subdivision fails to reduce number of nodes, report bbox and croak.
Version 1054 was commited by markb on 2009-06-02 10:04:38 +0100 (Tue, 02 Jun 2009) When subdivision fails to reduce number of nodes, report bbox and croak. At least now you will get a bbox reported so you can find the bad data. Not implemented as an assertion because they may not be enabled. ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2 of June 1 (all other contry extracts by gefabrik for Europe compiled except for Austria)
It must be bounds related. Using --ignore-osm-bounds and it compiles fine. Using --route but not parsing --ignore-osm-bounds and the mess happens. Mark Burton wrote: Hi, http://openmtbmap.x-nation.de/maps/Debug/63660027.osm.gz Here is the file. Created from YESTERDAYS geofrabrik austria.osm.bz2 with mkgmap splitter setting: --maxnodes=20 Well, I tried that and can process it with no problems: time java -Xmx512m -Dlog.config=/home/markb/OSM/logging.properties -ea -jar /home/markb/OSM/mkgmap.jar --code-page=1250 --country-name=Austria --country-abbr=at --gmapsupp --draw-priority=28 --remove-short-arcs --ignore-osm-bounds --latin1 --net --product-id=6324 --add-pois-to-areas --location-autofill=1 --ignore-turn-restrictions --lower-case --no-sorted-roads --ignore-maxspeeds --route --tdbfile --tdb-v4 63660027.osm ... 2009/06/02 07:18:44 INFO (MapMaker): finished making map 63660027.img closing 13.99user 0.40system 0:14.40elapsed 100%CPU (0avgtext+0avgdata 0maxresident)k 0inputs+9616outputs (1major+29694minor)pagefaults 0swaps I will now take a look at the data Robert's just mentioned. Cheers, Mark ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2 of June 1 (all other contry extracts by gefabrik for Europe compiled except for Austria)
Could you retry using only --route? Your commandline somehow makes the tile compile. I will try more to find out which command exactly makes it compile smooth. Mark Burton wrote: Hi, http://openmtbmap.x-nation.de/maps/Debug/63660027.osm.gz Here is the file. Created from YESTERDAYS geofrabrik austria.osm.bz2 with mkgmap splitter setting: --maxnodes=20 Well, I tried that and can process it with no problems: time java -Xmx512m -Dlog.config=/home/markb/OSM/logging.properties -ea -jar /home/markb/OSM/mkgmap.jar --code-page=1250 --country-name=Austria --country-abbr=at --gmapsupp --draw-priority=28 --remove-short-arcs --ignore-osm-bounds --latin1 --net --product-id=6324 --add-pois-to-areas --location-autofill=1 --ignore-turn-restrictions --lower-case --no-sorted-roads --ignore-maxspeeds --route --tdbfile --tdb-v4 63660027.osm ... 2009/06/02 07:18:44 INFO (MapMaker): finished making map 63660027.img closing 13.99user 0.40system 0:14.40elapsed 100%CPU (0avgtext+0avgdata 0maxresident)k 0inputs+9616outputs (1major+29694minor)pagefaults 0swaps I will now take a look at the data Robert's just mentioned. Cheers, Mark ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2 of June 1 (all other contry extracts by gefabrik for Europe compiled except for Austria)
Hi Robert, > http://page.mi.fu-berlin.de/vollmert/tmp/neud.osm.gz Yes, that file contains lot's of duplicate ways/nodes sitting on top of each other so it will never be able to be sub-divided (hence mkgmap blows up). Personally, I don't think we need to fix mkgmap to handle this because the data is obviously crap. What I can do is put in some code to detect this situation and issue a more useful error message before it bombs out. BTW if you download the same area, all the crap has gone away. Cheers, Mark ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2 of June 1 (all other contry extracts by gefabrik for Europe compiled except for Austria)
Thilo Hannemann wrote: > I tried to do so, but the small file was processed without error :(. The > big one is available at a website though > (http://osm.arndnet.de/problem.osm.zip). The problem to reproduce that > error is that it occurs for me only if I merge contourlines that I > generated on my own I suggest you create a separate overlay map with contours only and an second map with OSM data only. The SRTM map gets --transparent but no --route, the OSM map the other way round. This way you have to process the SRTM data only once. SRTM data don't change so there's no need for an update. If you update the OSM map you can easily merge the existing SRTM map into the gmapsupp.img. ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2 of June 1 (all other contry extracts by gefabrik for Europe compiled except for Austria)
Hi, > http://openmtbmap.x-nation.de/maps/Debug/63660027.osm.gz > Here is the file. Created from YESTERDAYS geofrabrik austria.osm.bz2 > with mkgmap splitter setting: --maxnodes=20 Well, I tried that and can process it with no problems: time java -Xmx512m -Dlog.config=/home/markb/OSM/logging.properties -ea -jar /home/markb/OSM/mkgmap.jar --code-page=1250 --country-name=Austria --country-abbr=at --gmapsupp --draw-priority=28 --remove-short-arcs --ignore-osm-bounds --latin1 --net --product-id=6324 --add-pois-to-areas --location-autofill=1 --ignore-turn-restrictions --lower-case --no-sorted-roads --ignore-maxspeeds --route --tdbfile --tdb-v4 63660027.osm ... 2009/06/02 07:18:44 INFO (MapMaker): finished making map 63660027.img closing 13.99user 0.40system 0:14.40elapsed 100%CPU (0avgtext+0avgdata 0maxresident)k 0inputs+9616outputs (1major+29694minor)pagefaults 0swaps I will now take a look at the data Robert's just mentioned. Cheers, Mark ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2 of June 1 (all other contry extracts by gefabrik for Europe compiled except for Austria)
On Jun 2, 2009, at 07:50, Thilo Hannemann wrote: The command line is java -Xmx2048m -ea -Dlog.config=logging.properties -jar trunk/dist/ mkgmap.jar --net --route problem.osm The log output is available at http://osm.arndnet.de/mkgmap.log.0 (15 MB) The input file problem.osm is available at http://osm.arndnet.de/problem.osm.zip (16 MB) Reduced (and slightly munged) extract that causes the same error here at http://page.mi.fu-berlin.de/vollmert/tmp/neud.osm.gz Cheers Robert ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2 of June 1 (all other contry extracts by gefabrik for Europe compiled except for Austria)
On Jun 2, 2009, at 07:50, Thilo Hannemann wrote: When looking at the log output there are a lot of ways with the name "SIEDLUNG NEUD?RFEL" (#35170047, #35160048, #35170059, #35170062, #35170063, #35170064, #35170070, #35170071, #35170072, #35170084, ... all in all 174) at about lat 51,08201/lon 14,67827. There are much less ways with that name in the original germay.osm.bz2! They consume 174 entries in TableA and TableB (whatever that is). But in TableB only 62 entries are allowed. This triggers a subdivision, but that doesn't help, as still they all get into one subdivision, which gets divided further and further until the assertion is triggered. [...] The log output is available at http://osm.arndnet.de/mkgmap.log.0 (15 MB) The input file problem.osm is available at http://osm.arndnet.de/problem.osm.zip (16 MB) I think this is just bad data: As far as I know, the splitter doesn't create new osm ids, and if you look at those ways (e.g. http://www.openstreetmap.org/browse/way/35170062) you'll see that those existed but have been deleted. Is it possible that your germany.osm.bz2 was from a different time than problem.osm.bz2? If not, maybe there's a bug somewhere (splitter?) that undeletes elements with visible='no', and your source data contained the deleted ways? Cheers Robert ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2 of June 1 (all other contry extracts by gefabrik for Europe compiled except for Austria)
Please compile with --route, without --route it compiles without error. --- http://openmtbmap.x-nation.de/maps/Debug/63660027.osm.gz Here is the file. Created from YESTERDAYS geofrabrik austria.osm.bz2 with mkgmap splitter setting: --maxnodes=20 Thilo Hannemann wrote: Hi Mark, I tried to do so, but the small file was processed without error :(. The big one is available at a website though (http://osm.arndnet.de/problem.osm.zip). The problem to reproduce that error is that it occurs for me only if I merge contourlines that I generated on my own (not with srtm2osm). So this is quite a special case. I wouldn't have reported that error, but as I see that extremecarver sees a similar error I thought it might help. Regards Thilo Am 02.06.2009 um 08:50 schrieb Mark Burton: Hi Felix, Thilo, Is it possible to produce a small example OSM file that shows this problem? If so, please zip it up and send it to me or put it on a website I can access. Cheers, Mark ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2 of June 1 (all other contry extracts by gefabrik for Europe compiled except for Austria)
http://openmtbmap.x-nation.de/maps/Debug/63660027.osm.gz Here is the file. Created from YESTERDAYS geofrabrik austria.osm.bz2 with mkgmap splitter setting: --maxnodes=20 Thilo Hannemann wrote: Hi Mark, I tried to do so, but the small file was processed without error :(. The big one is available at a website though (http://osm.arndnet.de/problem.osm.zip). The problem to reproduce that error is that it occurs for me only if I merge contourlines that I generated on my own (not with srtm2osm). So this is quite a special case. I wouldn't have reported that error, but as I see that extremecarver sees a similar error I thought it might help. Regards Thilo Am 02.06.2009 um 08:50 schrieb Mark Burton: Hi Felix, Thilo, Is it possible to produce a small example OSM file that shows this problem? If so, please zip it up and send it to me or put it on a website I can access. Cheers, Mark ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Re: [mkgmap-dev] mkgmap error with austria.osm.bz2 of June 1 (all other contry extracts by gefabrik for Europe compiled except for Austria)
Hi Mark, I tried to do so, but the small file was processed without error :(. The big one is available at a website though (http://osm.arndnet.de/problem.osm.zip ). The problem to reproduce that error is that it occurs for me only if I merge contourlines that I generated on my own (not with srtm2osm). So this is quite a special case. I wouldn't have reported that error, but as I see that extremecarver sees a similar error I thought it might help. Regards Thilo Am 02.06.2009 um 08:50 schrieb Mark Burton: Hi Felix, Thilo, Is it possible to produce a small example OSM file that shows this problem? If so, please zip it up and send it to me or put it on a website I can access. Cheers, Mark ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
