Hi all,
this morning I downloaded a new Europe extract (europe-140301.osm.pbf) from geofabrik. I tried to split it with splitter and I was surprised that I got an error.
As I had splitter r314 I updated to splitter r317. But the error still exists.
I have no idea why this happens and what i
Hi Gert,
looks like an error in the input file.
You may try if osmconvert can read it, if not,
you have to download it again :-(
Gerd
From: thesurve...@wolke7.net
To: mkgmap-dev@lists.mkgmap.org.uk
Date: Sun, 2 Mar 2014 14:37:36 +0100
Subject: [mkgmap-dev] splitter exception
Hi all
with the network :-(
Many thanks
Gert
Gesendet:Sonntag, 02. Mrz 2014 um 16:56 Uhr
Von:Gerd Petermann gpetermann_muenc...@hotmail.com
An:mkgmap-dev@lists.mkgmap.org.uk mkgmap-dev@lists.mkgmap.org.uk
Betreff:Re: [mkgmap-dev] splitter exception
Hi Gert,
looks like an error in the input file
Hi all,
I see a few possible solutions for the problem:
1) simple but slow: use a smaller max-areas value so that splitter need one
more pass.
The only needed change in the code would be a test for the situation and an
appropriate error message.
2) I can add an option like --allow-huge-data which
Hi Gerd,
I gave it a try, but it failed. The only output I got was:
SparseLong2ShortMapInline: Allocating three-tier structure to save area
info (HashMap-vector-chunkvector)
Length-1 chunks: 93.749.999, used Bytes including overhead: 962.665.848
Length-2 chunks: 0, used Bytes including
Hi Henning,
stupid me!
I've uploaded the wrong binary, here is the right one:
http://files.mkgmap.org.uk/download/105/splitter.jar
Gerd
Date: Sat, 13 Apr 2013 11:57:14 +0200
From: o...@aighes.de
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: Re: [mkgmap-dev] splitter exception with SRTM data
Hi Henning,
yes, with large input file the difference is relative small. You may see
problems when you
run a small machine (e.g. a netbook), because then the additional 180MB are
more important.
Gerd
Henning Scholland wrote
Hi Gerd,
the second file works as normal.
Log:
Am 13.04.2013 15:36, schrieb GerdP:
Hi Henning,
yes, with large input file the difference is relative small. You may see
problems when you
run a small machine (e.g. a netbook), because then the additional 180MB are
more important.
Maybe you can implement a automatic switch between the two
Hi Henning,
yes, that sounds like a good option to me, and it easy to do.
Gerd
Henning Scholland wrote
Am 13.04.2013 15:36, schrieb GerdP:
Hi Henning,
yes, with large input file the difference is relative small. You may see
problems when you
run a small machine (e.g. a netbook), because
Hi all,
I've committed r301 which implements what Henning suggested.
The old structure is used when less than 2GB are configured.
On my machine that means something like -Xmx2303M or less.
Gerd
Henning Scholland wrote
Maybe you can implement a automatic switch between the two
possibilities,
2013 18:51:34 +0200
From: ku...@suse.de
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: Re: [mkgmap-dev] splitter exception with SRTM data for USA
Hi,
On Thu, Apr 11, Gerd Petermann wrote:
Hi Thorsten,
I fear my idea regarding the numering of node ids will not help.
The problem
Am 12.04.2013 09:22, schrieb Gerd Petermann:
Statistics for *coords *map:
*Length-1* chunks:*4.580.310*, used Bytes including overhead: 47.376.048
Planet with data of yesterday:
Length-1 chunks: 10.454.925, used Bytes including overhead: 107.695.080
If the rising continueslinear, the limit
.
Gerd
Date: Fri, 12 Apr 2013 09:30:15 +0200
From: o...@aighes.de
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: Re: [mkgmap-dev] splitter exception with SRTM data for USA
Am 12.04.2013 09:22, schrieb Gerd
Petermann:
Statistics for coords map:
Length-1 chunks
-dev] splitter exception with SRTM data for USA
Am 12.04.2013 09:22, schrieb Gerd Petermann:
Statistics for *coords *map:
*Length-1* chunks:*4.580.310*, used Bytes including overhead:
47.376.048
Planet with data of yesterday:
Length-1 chunks: 10.454.925, used Bytes including overhead
: [mkgmap-dev] splitter exception with SRTM data for USA
Hi Gerd,
my value for max-nodes is also 160.
Henning
Am 12.04.2013 09:36, schrieb Gerd Petermann:
Hi Henning,
that is more than expected. What
to have better data.
(e.g. --precomp-sea will also play a role)
Gerd
Date: Fri, 12 Apr 2013 09:43:48 +0200
From: o...@aighes.de
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: Re: [mkgmap-dev] splitter exception with SRTM data
Hi Henning,
thanks, that explains the higher values. When you use --split-file, the
max-nodes value is ignored.
You create 804 areas, I create 1502.
Gerd
Date: Fri, 12 Apr 2013 09:56:29 +0200
From: o...@aighes.de
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: Re: [mkgmap-dev] splitter exception
Hi Henning,
yes, whole planet, and I use keep-complete=true, overlap=0 and
stop-after=gen-problem-list because that is enough to get the info.
Gerd
Henning Scholland wrote
Am 12.04.2013 10:06, schrieb Gerd Petermann:
Hi Henning,
thanks, that explains the higher values. When you use
Am 12.04.2013 10:52, schrieb GerdP:
Hi Henning,
yes, whole planet, and I use keep-complete=true, overlap=0 and
stop-after=gen-problem-list because that is enough to get the info.
Gerd
With these parameters and splitting the complete planet I got the
following values:
Length-1 chunks:
Hi Henning,
Henning Scholland wrote
With these parameters and splitting the complete planet I got the
following values:
Length-1 chunks: 5.547.829, used Bytes including overhead: 57.051.176
Afterwards I generated a new areas.list file, containing all my (partly
overlapping) maps also
Hi,
I generated SRTM data for the USA with phygthmap and wanted to try
to split it now for compiling with mkgmap. But while this worked fine
for all other countries, in this case I get always the following
exception:
MAP occupancy: 2.350.000.000, number of area dictionary entries: 3994 of 65535
Hi Thorsten,
it seems that your data has reached a limit in the data structure used in
splitter.
This happens when you have a huge number of consecutive ids.
Can you configure the way how the ids for the points are generated?
A simple change would be to use
1 3 5 7 ..
instead of
1 2 3 4 ...
Hi Thorsten,
another question: The wiki of phygthmap says that you don't need splitting:
http://wiki.openstreetmap.org/wiki/Phyghtmap
Why do you do it?
Gerd
Date: Thu, 11 Apr 2013 14:06:30 +0200
From: ku...@suse.de
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: [mkgmap-dev] splitter exception
Am 11.04.2013 15:19, schrieb GerdP:
Hi Thorsten,
it seems that your data has reached a limit in the data structure used in
splitter.
This happens when you have a huge number of consecutive ids.
Can you configure the way how the ids for the points are generated?
A simple change would be to
. That's much easier and simpler then to let phyghtmap
create a big amount of files and try to find and cut the ones you need.
Thorsten
Gerd
Date: Thu, 11 Apr 2013 14:06:30 +0200
From: ku...@suse.de
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: [mkgmap-dev] splitter exception with SRTM data
+0200
From: ku...@suse.de
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: [mkgmap-dev] splitter exception with SRTM data for USA
Hi,
I generated SRTM data for the USA with phygthmap and wanted to try
to split it now for compiling with mkgmap. But while this worked fine
for all other countries
...@suse.de
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: [mkgmap-dev] splitter exception with SRTM data for USA
Hi,
I generated SRTM data for the USA with phygthmap and wanted to try
to split it now for compiling with mkgmap. But while this worked fine
for all other countries
@
To:
mkgmap-dev@.org
Subject: [mkgmap-dev] splitter exception with SRTM data for USA
Hi,
I generated SRTM data for the USA with phygthmap and wanted to try
to split it now for compiling with mkgmap. But while this worked fine
for all other countries, in this case I get always the following
phyghtmap
create a big amount of files and try to find and cut the ones you need.
Thorsten
Gerd
Date: Thu, 11 Apr 2013 14:06:30 +0200
From:
kukuk@
To:
mkgmap-dev@.org
Subject: [mkgmap-dev] splitter exception with SRTM data for USA
Hi,
I
@
To:
mkgmap-dev@.org
Subject: [mkgmap-dev] splitter exception with SRTM data for USA
Hi,
I generated SRTM data for the USA with phygthmap and wanted to try
to split it now for compiling with mkgmap. But while this worked fine
for all other countries
Apr 2013 16:54:13 +0200
From: ku...@suse.de
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: Re: [mkgmap-dev] splitter exception with SRTM data for USA
Hi Gerd,
On Thu, Apr 11, GerdP wrote:
Hi Thorsten,
ok, so I assume that you can patch pyghtmap to generate the ids as I
@lists.mkgmap.org.uk
Subject: Re: [mkgmap-dev] splitter exception with SRTM data for USA
Hi,
On Thu, Apr 11, Gerd Petermann wrote:
Hi Thorsten,
I fear my idea regarding the numering of node ids will not help.
The problem is the amount of nodes and the fact that the generated data
probably
32 matches
Mail list logo
