Re: [mkgmap-dev] undocumented contour line feature

[Gerd Petermann]

Hi Andrzej,

thanks, that's a good point against this idea.

Gerd

Von: mkgmap-dev  im Auftrag von Andrzej 
Popowski 
Gesendet: Samstag, 25. März 2017 01:44:58
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] undocumented contour line feature

Hi Gerd,

 > I like the idea that mkgmap adds SRTM data "on the fly" instead of
 > first creating huge OSM files, pass them through splitter and so on.

It could be handy, but contours aren't evenly spread over map area. You
will get big variation in tile size and no way to correct it.

--
Best regards,
Andrzej
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] undocumented contour line feature

[Andrzej Popowski]

Hi Gerd,

> I like the idea that mkgmap adds SRTM data "on the fly" instead of
> first creating huge OSM files, pass them through splitter and so on.

It could be handy, but contours aren't evenly spread over map area. You 
will get big variation in tile size and no way to correct it.


--
Best regards,
Andrzej
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] undocumented contour line feature

[Steve Ratcliffe]

On 24/03/17 21:32, Gerd Petermann wrote:

only class GeoTiffDEM is optional, the active code is able to read *.hgt files 
and can
produce ways with elevation data.


Ah OK.  It was the only file containing srtm, should have searched for SRTM!

..Steve
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] undocumented contour line feature

[Gerd Petermann]

Hi Steve,

only class GeoTiffDEM is optional, the active code is able to read *.hgt files 
and can
produce ways with elevation data. I stumbled over it because it appears in
MapperBasedMapDataSource.addBackground() which I plan to move to
MapDetails so that we don't have to override it in many sources.

I like the idea that mkgmap adds SRTM data "on the fly" instead of first 
creating huge OSM
files, pass them through splitter and so on. No idea how much work would be 
needed to
make the code work and how many poblems that would cause, esp. if we also try to
download SRTM files automatically.

Gerd


Von: mkgmap-dev  im Auftrag von Steve 
Ratcliffe 
Gesendet: Freitag, 24. März 2017 22:05:26
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] undocumented contour line feature

Hi

> mkgmap contains sources to generate contour lines from SRTM data, but it 
> seems to be very
> incomplete. The last significant changes in the source was in 2010, and I 
> never heard that anybody uses
> options like --x-contours since I started to contribute to mkgmap.

All classes in packages named "optional" are not included in the
download distribution.  So it has never been available except if you
compile the source yourself and include it.

..Steve


___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] undocumented contour line feature

[Steve Ratcliffe]

Hi


mkgmap contains sources to generate contour lines from SRTM data, but it seems 
to be very
incomplete. The last significant changes in the source was in 2010, and I never 
heard that anybody uses
options like --x-contours since I started to contribute to mkgmap.


All classes in packages named "optional" are not included in the 
download distribution.  So it has never been available except if you 
compile the source yourself and include it.


..Steve


___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] RAM and mdr Europa ?

[Carlos Dávila]

El 24/03/17 a las 17:07, Thomas Morgenstern escribió:



How many RAM must i have for Europa complete ?



2-3 months ago I had the same problem on a Linux machine with 8 GB RAM, 
but during the last weeks I've been able to build Europe index with 
-Xmx7500m. As Gerd suggested, it depends on your style.


___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] RAM and mdr Europa ?

[Thomas Morgenstern]

Hi, I found a solution for me:  Now i use only the option -index and  
removed the option -x-splitt-name-index.


in this configuration is 9800 MB RAM enough.


thomas


Am 24.03.2017 um 19:18 schrieb Bernhard Hiller:

Hi Thomas,
since you have 10 GB of RAM for all of the tasks running on your 
computer, I doubt that 9800 MB for Java/mkgmap is actually feasable. 
With Win 7, I put away some 1200-1500 MB for the operating system.
If a process gets more memory, swapping to disk will occur, which is a 
slow process, and the garbage collection might fail in such situations 
(well, not sure for Java, but I saw such situations with .Net).
I do not know how much RAM will be used up by WIN 10, but I think 
replacing "/-Xmx9800m/" by "/-Xmx8500m/" could be worth a test; you 
could also (additionally) set the initial heap size to that amount 
("/-Xms8500m/") .

Bernhard

Am 24.03.2017 um 17:07 schrieb Thomas Morgenstern:


Hi, I have a W10, 64 bit machine  and 10 GB RAM. Since  a few months 
i can not generate the mdr-file for Europa from 
www.Download.Geofabrik.de In a first run i generate only all the 
maptiles. No Problem. in a second i will generate the overview, tdb 
and mdr. I start j/ava -Xmx9800m -XX:-UseGCOverheadLimit jar 
mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index 
D:\Karten\Europa\*.img./


and get the error.


with mkgmap-r3864 it get the same error.

How many RAM must i have for Europa complete ?. In august 2016 it was 
possible to create the mdr with 6 GB RAM. But the filesize is growm ...


thomas





mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] RAM and mdr Europa ?

[Bernhard Hiller]

Hi Thomas,
since you have 10 GB of RAM for all of the tasks running on your 
computer, I doubt that 9800 MB for Java/mkgmap is actually feasable. 
With Win 7, I put away some 1200-1500 MB for the operating system.
If a process gets more memory, swapping to disk will occur, which is a 
slow process, and the garbage collection might fail in such situations 
(well, not sure for Java, but I saw such situations with .Net).
I do not know how much RAM will be used up by WIN 10, but I think 
replacing "/-Xmx9800m/" by "/-Xmx8500m/" could be worth a test; you 
could also (additionally) set the initial heap size to that amount 
("/-Xms8500m/") .

Bernhard

Am 24.03.2017 um 17:07 schrieb Thomas Morgenstern:


Hi, I have a W10, 64 bit machine  and 10 GB RAM. Since  a few months i 
can not generate the mdr-file for Europa from 
www.Download.Geofabrik.de In a first run i generate only all the 
maptiles. No Problem. in a second i will generate the overview, tdb 
and mdr. I start j/ava -Xmx9800m -XX:-UseGCOverheadLimit jar 
mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index 
D:\Karten\Europa\*.img./


and get the error.

with mkgmap-r3864 it get the same error.

How many RAM must i have for Europa complete ?. In august 2016 it was 
possible to create the mdr with 6 GB RAM. But the filesize is growm ...


thomas






___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] RAM and mdr Europa ?

[Gerd Petermann]

... but we have currently no option to control what is used for the index.
I assume it could be a new special tag like mkgmap:no-index=true
or maybe a program option like --exclude-from-index=type1,type2, type3..type4
which would exclude single types or ranges.
No idea how much work that would be and how the device works when something
is not in the index.

Gerd

Von: mkgmap-dev  im Auftrag von Gerd 
Petermann 
Gesendet: Freitag, 24. März 2017 17:40:41
An: Development list for mkgmap
Betreff: Re: [mkgmap-dev] RAM and mdr Europa ?

Hi Mike,

my  understanding is that mkgmap can decide which elements are used to build 
the index
and what string are put into the index.
AFAIK it can not decide what you can search in the device, as it may also 
perform a search without an
index.

Gerd

Von: mkgmap-dev  im Auftrag von Mike 
Baggaley 
Gesendet: Freitag, 24. März 2017 17:33:47
An: 'Development list for mkgmap'
Betreff: Re: [mkgmap-dev] RAM and mdr Europa ?

Is it possible to not put POIs into the index, but still have them
displayed? I would like to have gates and stiles on my map, but not have
them searchable in the index. Is this possible?

Cheers,
Mike

-Original Message-
From: Gerd Petermann [mailto:gpetermann_muenc...@hotmail.com]
Sent: 24 March 2017 16:25
To: Development list for mkgmap 
Subject: Re: [mkgmap-dev] RAM and mdr Europa ?

Hi Thomas,

I think it depends on the style. The more indexable objects you create and
the longer the names, the more memory is needed.
Andrzej suggested not to put POI with type 0x28 into the index. Do you think
this would help to reduce size in your case?
See this thread:
http://gis.19327.n8.nabble.com/POI-indexing-problem-with-label-0x2800-tt5889
663.html

Gerd

Von: mkgmap-dev  im Auftrag von
Thomas Morgenstern 
Gesendet: Freitag, 24. März 2017 17:07:22
An: Development list for mkgmap
Betreff: [mkgmap-dev] RAM and mdr Europa ?

Hi, I have a W10, 64 bit machine  and 10 GB RAM. Since  a few months i can
not generate the mdr-file for Europa from
www.Download.Geofabrik.de In a first run i
generate only all the maptiles. No Problem. in a second i will generate the
overview, tdb and mdr. I start java -Xmx9800m -XX:-UseGCOverheadLimit jar
mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index
D:\Karten\Europa\*.img.

and get the error.

[cid:part1.6A605C7E.D89F4F60@img2ms.de]

with mkgmap-r3864 it get the same error.

How many RAM must i have for Europa complete ?. In august 2016 it was
possible to create the mdr with 6 GB RAM. But the filesize is growm ...

thomas




___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] RAM and mdr Europa ?

[Gerd Petermann]

Hi Mike,

my  understanding is that mkgmap can decide which elements are used to build 
the index
and what string are put into the index.
AFAIK it can not decide what you can search in the device, as it may also 
perform a search without an
index.

Gerd

Von: mkgmap-dev  im Auftrag von Mike 
Baggaley 
Gesendet: Freitag, 24. März 2017 17:33:47
An: 'Development list for mkgmap'
Betreff: Re: [mkgmap-dev] RAM and mdr Europa ?

Is it possible to not put POIs into the index, but still have them
displayed? I would like to have gates and stiles on my map, but not have
them searchable in the index. Is this possible?

Cheers,
Mike

-Original Message-
From: Gerd Petermann [mailto:gpetermann_muenc...@hotmail.com]
Sent: 24 March 2017 16:25
To: Development list for mkgmap 
Subject: Re: [mkgmap-dev] RAM and mdr Europa ?

Hi Thomas,

I think it depends on the style. The more indexable objects you create and
the longer the names, the more memory is needed.
Andrzej suggested not to put POI with type 0x28 into the index. Do you think
this would help to reduce size in your case?
See this thread:
http://gis.19327.n8.nabble.com/POI-indexing-problem-with-label-0x2800-tt5889
663.html

Gerd

Von: mkgmap-dev  im Auftrag von
Thomas Morgenstern 
Gesendet: Freitag, 24. März 2017 17:07:22
An: Development list for mkgmap
Betreff: [mkgmap-dev] RAM and mdr Europa ?

Hi, I have a W10, 64 bit machine  and 10 GB RAM. Since  a few months i can
not generate the mdr-file for Europa from
www.Download.Geofabrik.de In a first run i
generate only all the maptiles. No Problem. in a second i will generate the
overview, tdb and mdr. I start java -Xmx9800m -XX:-UseGCOverheadLimit jar
mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index
D:\Karten\Europa\*.img.

and get the error.

[cid:part1.6A605C7E.D89F4F60@img2ms.de]

with mkgmap-r3864 it get the same error.

How many RAM must i have for Europa complete ?. In august 2016 it was
possible to create the mdr with 6 GB RAM. But the filesize is growm ...

thomas




___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] RAM and mdr Europa ?

[Mike Baggaley]

Is it possible to not put POIs into the index, but still have them
displayed? I would like to have gates and stiles on my map, but not have
them searchable in the index. Is this possible?

Cheers,
Mike

-Original Message-
From: Gerd Petermann [mailto:gpetermann_muenc...@hotmail.com] 
Sent: 24 March 2017 16:25
To: Development list for mkgmap 
Subject: Re: [mkgmap-dev] RAM and mdr Europa ?

Hi Thomas,

I think it depends on the style. The more indexable objects you create and
the longer the names, the more memory is needed.
Andrzej suggested not to put POI with type 0x28 into the index. Do you think
this would help to reduce size in your case?
See this thread:
http://gis.19327.n8.nabble.com/POI-indexing-problem-with-label-0x2800-tt5889
663.html

Gerd

Von: mkgmap-dev  im Auftrag von
Thomas Morgenstern 
Gesendet: Freitag, 24. März 2017 17:07:22
An: Development list for mkgmap
Betreff: [mkgmap-dev] RAM and mdr Europa ?

Hi, I have a W10, 64 bit machine  and 10 GB RAM. Since  a few months i can
not generate the mdr-file for Europa from
www.Download.Geofabrik.de In a first run i
generate only all the maptiles. No Problem. in a second i will generate the
overview, tdb and mdr. I start java -Xmx9800m -XX:-UseGCOverheadLimit jar
mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index
D:\Karten\Europa\*.img.

and get the error.

[cid:part1.6A605C7E.D89F4F60@img2ms.de]

with mkgmap-r3864 it get the same error.

How many RAM must i have for Europa complete ?. In august 2016 it was
possible to create the mdr with 6 GB RAM. But the filesize is growm ...

thomas




___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] undocumented contour line feature

[Gerd Petermann]

Hi all,

I've tried to use it with --x-contours and it turned out that it doesn't work.
1) The code expects the SRTM data to be available, it has no automatic download 
feature like e.g. phyghtmap. I think that this would be needed to make it a 
good feature.
2) The  code can only add SRTM data for a tile which is not too large ("must 
not span more than one SRTM file"). This would also require more work.
3) If the code generates ways they are ignored because some methods are not 
called to process them. It may have worked before r2599, but surely not since 
then.

So, I think it is safe to remove the code since nobody complained.

Gerd

Von: mkgmap-dev  im Auftrag von Gerd 
Petermann 
Gesendet: Freitag, 24. März 2017 10:08:57
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: [mkgmap-dev] undocumented contour line feature

Hi all,

mkgmap contains sources to generate contour lines from SRTM data, but it seems 
to be very
incomplete. The last significant changes in the source was in 2010, and I never 
heard that anybody uses
options like --x-contours since I started to contribute to mkgmap.
See also
http://www.mkgmap.org.uk/pipermail/mkgmap-dev/2009q3/002581.html

I'd like to either remove the code completely or mayve make it work if you 
think that it would be better to have the code in mkgmap
instead of a separate package like phyghtmap.
Does anybody remember why it is not documented?

Gerd
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

[mkgmap-dev] Commit r3864: refactoring, no functional change: rewrite code which was intended to implement a plugin system for OSM readers

[svn commit]

Version mkgmap-r3864 was committed by gerd on Fri, 24 Mar 2017

refactoring, no functional change: rewrite code which was intended to implement 
a plugin system for OSM readers

This makes the code more transparent.

http://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=3864
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

[mkgmap-dev] undocumented contour line feature

[Gerd Petermann]

Hi all,

mkgmap contains sources to generate contour lines from SRTM data, but it seems 
to be very
incomplete. The last significant changes in the source was in 2010, and I never 
heard that anybody uses 
options like --x-contours since I started to contribute to mkgmap.
See also 
http://www.mkgmap.org.uk/pipermail/mkgmap-dev/2009q3/002581.html

I'd like to either remove the code completely or mayve make it work if you 
think that it would be better to have the code in mkgmap
instead of a separate package like phyghtmap. 
Does anybody remember why it is not documented? 

Gerd
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev