Re: [mkgmap-dev] [Partch v2] reduce peak memory usage for global index

2017-03-30 Thread Thomas Morgenstern
Hi Gerd, Thanks for your work. Now i have  created the whole Europa -mdr 
with my limited 10 GB RAM and option x-split-name-index.


thomas


Am 30.03.2017 um 21:54 schrieb Thomas Morgenstern:


Sorry for my mail, i forgot to use the /lib- folder

thomas


Am 30.03.2017 um 18:12 schrieb Gerd Petermann:

Hi all,

attached is an improved version which also implements the new option 
--x-mdr7-excl.
It also has some debug messages which will print Strings which appear very 
often, something like this:
Street index (Mdr7) 'Service' : 11.09%
Street index (Mdr7) 'Straße' : 7.09%
Street index (Mdr7) 'CyW' : 1.66%
Street index (Mdr7) 'Pth' : 3.81%
Street index (Mdr7) 'Weg' : 1.13%
Street index (Mdr7) 'Foot' : 9.17%
Street index (Mdr7) 'Steps' : 1.58%
(sample from Arndts "Speichenkarte" style which adds osm tags to the street 
name.

The idea is to use Option --x-mdr7-excl="Service,Straße,Foot,Pth" to exclude 
some strings from the global index.
This will esp. reduce heap memory usage , but it will also reduce the size of 
the index.

The search will still find roads like "Abc Straße" when you search for abc, but 
it will not display all the streets containing
Straße when you just type Straße. It should also still display "Straße des 17. 
Juni" if you type
"Straße des" or just "Juni" in case you use --x-split-name-index.

The binary is here:
http://files.mkgmap.org.uk/download/342/mkgmap.jar

Gerd






___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev




___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] [Partch v2] reduce peak memory usage for global index

2017-03-30 Thread Gerd Petermann
Hi Thomas,

the jar needs libraries. To run it, you must replace the original mkgmap.jar 
(or rename that first)

Gerd

Von: mkgmap-dev  im Auftrag von Thomas 
Morgenstern 
Gesendet: Donnerstag, 30. März 2017 21:51:27
An: Development list for mkgmap
Betreff: Re: [mkgmap-dev] [Partch v2] reduce peak memory usage for global index

Hi Gerd, something goes wrong with the compiled mkgmap.jar. i have downloaded 
it . but it gives me a error.  Mybee the error is reladed to the compilation ?  
See screenshot :


[cid:part1.1ED55BC0.25CA812A@img2ms.de]

thomas

Am 30.03.2017 um 18:12 schrieb Gerd Petermann:

Hi all,

attached is an improved version which also implements the new option 
--x-mdr7-excl.
It also has some debug messages which will print Strings which appear very 
often, something like this:
Street index (Mdr7) 'Service' : 11.09%
Street index (Mdr7) 'Straße' : 7.09%
Street index (Mdr7) 'CyW' : 1.66%
Street index (Mdr7) 'Pth' : 3.81%
Street index (Mdr7) 'Weg' : 1.13%
Street index (Mdr7) 'Foot' : 9.17%
Street index (Mdr7) 'Steps' : 1.58%
(sample from Arndts "Speichenkarte" style which adds osm tags to the street 
name.

The idea is to use Option --x-mdr7-excl="Service,Straße,Foot,Pth" to exclude 
some strings from the global index.
This will esp. reduce heap memory usage , but it will also reduce the size of 
the index.

The search will still find roads like "Abc Straße" when you search for abc, but 
it will not display all the streets containing
Straße when you just type Straße. It should also still display "Straße des 17. 
Juni" if you type
"Straße des" or just "Juni" in case you use --x-split-name-index.

The binary is here:
http://files.mkgmap.org.uk/download/342/mkgmap.jar

Gerd








___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] [Partch v2] reduce peak memory usage for global index

2017-03-30 Thread Thomas Morgenstern

Sorry for my mail, i forgot to use the /lib- folder

thomas


Am 30.03.2017 um 18:12 schrieb Gerd Petermann:

Hi all,

attached is an improved version which also implements the new option 
--x-mdr7-excl.
It also has some debug messages which will print Strings which appear very 
often, something like this:
Street index (Mdr7) 'Service' : 11.09%
Street index (Mdr7) 'Straße' : 7.09%
Street index (Mdr7) 'CyW' : 1.66%
Street index (Mdr7) 'Pth' : 3.81%
Street index (Mdr7) 'Weg' : 1.13%
Street index (Mdr7) 'Foot' : 9.17%
Street index (Mdr7) 'Steps' : 1.58%
(sample from Arndts "Speichenkarte" style which adds osm tags to the street 
name.

The idea is to use Option --x-mdr7-excl="Service,Straße,Foot,Pth" to exclude 
some strings from the global index.
This will esp. reduce heap memory usage , but it will also reduce the size of 
the index.

The search will still find roads like "Abc Straße" when you search for abc, but 
it will not display all the streets containing
Straße when you just type Straße. It should also still display "Straße des 17. 
Juni" if you type
"Straße des" or just "Juni" in case you use --x-split-name-index.

The binary is here:
http://files.mkgmap.org.uk/download/342/mkgmap.jar

Gerd






___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] [Partch v2] reduce peak memory usage for global index

2017-03-30 Thread Thomas Morgenstern
Hi Gerd, something goes wrong with the compiled mkgmap.jar. i have 
downloaded it . but it gives me a error.  Mybee the error is reladed to 
the compilation ?  See screenshot :





thomas

Am 30.03.2017 um 18:12 schrieb Gerd Petermann:

Hi all,

attached is an improved version which also implements the new option 
--x-mdr7-excl.
It also has some debug messages which will print Strings which appear very 
often, something like this:
Street index (Mdr7) 'Service' : 11.09%
Street index (Mdr7) 'Straße' : 7.09%
Street index (Mdr7) 'CyW' : 1.66%
Street index (Mdr7) 'Pth' : 3.81%
Street index (Mdr7) 'Weg' : 1.13%
Street index (Mdr7) 'Foot' : 9.17%
Street index (Mdr7) 'Steps' : 1.58%
(sample from Arndts "Speichenkarte" style which adds osm tags to the street 
name.

The idea is to use Option --x-mdr7-excl="Service,Straße,Foot,Pth" to exclude 
some strings from the global index.
This will esp. reduce heap memory usage , but it will also reduce the size of 
the index.

The search will still find roads like "Abc Straße" when you search for abc, but 
it will not display all the streets containing
Straße when you just type Straße. It should also still display "Straße des 17. 
Juni" if you type
"Straße des" or just "Juni" in case you use --x-split-name-index.

The binary is here:
http://files.mkgmap.org.uk/download/342/mkgmap.jar

Gerd






___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] [Partch v2] reduce peak memory usage for global index

2017-03-30 Thread Arndt Röhrig

Hallo Gerd,thank you, i think, this is a good way to reduce the global index (and the memory).My first idea was, only build adresses from ways with an original "name"-entry from OSM. Your method exclude more ways "Straße,Weg,etc".Perhaps the need of memory for "Europe" becomes less than 6GB :) Then i can build a EU-map with adresses.GreetsArndtGerd Petermann  hat am 30. März 2017 um 18:12 geschrieben:Hi all,attached is an improved version which also implements the new option --x-mdr7-excl.It also has some debug messages which will print Strings which appear very often, something like this:Street index (Mdr7) 'Service' : 11.09%Street index (Mdr7) 'Straße' : 7.09%Street index (Mdr7) 'CyW' : 1.66%Street index (Mdr7) 'Pth' : 3.81%Street index (Mdr7) 'Weg' : 1.13%Street index (Mdr7) 'Foot' : 9.17%Street index (Mdr7) 'Steps' : 1.58%(sample from Arndts "Speichenkarte" style which adds osm tags to the street name.The idea is to use Option --x-mdr7-excl="Service,Straße,Foot,Pth" to exclude some strings from the global index.This will esp. reduce heap memory usage , but it will also reduce the size of the index.The search will still find roads like "Abc Straße" when you search for abc, but it will not display all the streets containingStraße when you just type Straße. It should also still display "Straße des 17. Juni" if you type"Straße des" or just "Juni" in case you use --x-split-name-index.The binary is here:http://files.mkgmap.org.uk/download/342/mkgmap.jarGerd___mkgmap-dev mailing listmkgmap-dev@lists.mkgmap.org.ukhttp://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
 
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev