[mkgmap-dev] option --mdr7-del: change or add new option?

2022-01-16 Thread Gerd Petermann
Hi all, the current implementation only removes words from the right. Felix and Mike both suggested to change that so that the listed words are removed anywhere, and I think Arndt's Style would also benefit. Should I simply change the implementation and documentation or is backward

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Gerd Petermann
Hi Arndt, I can reproduce the crash with NRW++. I am not yet sure where this has to be fixed, but it is related to the large number of different characters. Gerd Von: Gerd Petermann Gesendet: Sonntag, 16. Januar 2022 20:18 An: Development list for

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Gerd Petermann
Hi Ticker, yes, one byte at a time. Else we would need symbol width > 8, and Garmin doesn't use that for the unicode maps that I know.to I plan to contact the author of GPXsee, Martin Tůma. He seems to know much more than we do and maybe he is willing to help. Gerd

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Ticker Berkin
Hi Gerd So, for unicode, it just runs on the stream of utf-8 representation a byte at a time, rather than on unicode chars? It works but is not a good compression. Ticker On Sun, 2022-01-16 at 19:16 +, Gerd Petermann wrote: > Hi Ticker, > > you seem to think that the encoder must

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Gerd Petermann
Hi Arndt, thanks, I'll try to download and reproduce this tomorrow Gerd Von: mkgmap-dev im Auftrag von Arndt Röhrig Gesendet: Sonntag, 16. Januar 2022 19:34 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Gerd Petermann
Hi Ticker, you seem to think that the encoder must understand what a codepoint is? I don't think so. The only important thing is that utf-8 still can use a single 0 to terminate strings. Gerd Von: mkgmap-dev im Auftrag von Ticker Berkin Gesendet:

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Ticker Berkin
Hi Gerd More unicode problems: The data structures for the frequency analysis and then the list of chars to encode will all need attention. Ticker ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Arndt Röhrig
Hi Gerd, the tiles are here: https://speichenkarte.de/Karten/Speiche_NRWplus_mkgmap.zip splitter tiles: https://speichenkarte.de/Karten/Speiche_NRWplus_Splitter.zip Greetz Arndt P.S.

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Ticker Berkin
Hi Gerd A bit more: Are the boundary conditions for tab1Width (ie the space for the shifted minCode values) correct? eg if depth is 16, there is no minCode for this level, so the maximum minCode appears at level 15, the range being 1..2^15-1 (I think) I see a couple of problems with unicode:

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Gerd Petermann
Hi Arndt, do you also have the *.img files from NRWplus? I want to create the index here, so I need the *.img files and the options. Gerd Von: mkgmap-dev im Auftrag von Arndt Röhrig Gesendet: Sonntag, 16. Januar 2022 18:37 An: Development list for

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Arndt Röhrig
Hi Gerd, NRWplus is ready. Did you need the splitter-tiles or the map? The gmap-Version from the map is here: https://speichenkarte.de/Karten/Speiche_NRWplus_gmap_220116.zip Greetz Arndt

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Gerd Petermann
Hi Arndt, I don't see anything wrong in the diagnostic data. This seems to be a very small map. Please post a link to the tile(s) so that I can try to reproduce the crash here. Gerd Von: mkgmap-dev im Auftrag von Arndt Röhrig Gesendet: Sonntag, 16.

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Gerd Petermann
Hi Ticker, reg. " unless --code-page is given" I see. Will try to change the code so that Mdr16 evaluates sort later. Gerd Von: mkgmap-dev im Auftrag von Ticker Berkin Gesendet: Sonntag, 16. Januar 2022 13:37 An: Development list for mkgmap Betreff:

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Arndt Röhrig
Hi Gerd, i forget to activate the diagnostic function. I build the maps new, but it takes time. Fabrik and NRWplusare running now.. Here are the information from "Fabrik", the other map send i later. Greetz

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Gerd Petermann
Hi Arndt, please post the diagnostic information from mkgmap for the map(s) that causes the crash. Esp. I need the data following the text "following frequencies:" Gerd Von: mkgmap-dev im Auftrag von Arndt Röhrig Gesendet: Sonntag, 16. Januar 2022

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Arndt Röhrig
Hi Gerd, i run a test with Speiche Deutschland, NRW+, Kanaren, Balearen, Alpen and "Fabrik"-a little cut around my home. size mkgmap-r4855 vs mkgmap-mdr2-r4867 (gmap) Alpen: 3,68 GB (3.954.902.039

Re: [mkgmap-dev] mkgmap-dev Digest, Vol 162, Issue 25

2022-01-16 Thread John Thorn
Hi Gerd et al, Downloaded 4865 and ran it to make a .GMAP with no changes to data nor options Compared with running v4286 (which works for me so I still use) : MDR is now 43092K was 47347K Runtime (reading .MP files) seemed slower, maybe 30% slower Some .RGN files are bigger : now 5855K was

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Ticker Berkin
Hi Gerd I'm just starting to look at this, but won't be able to do much today, but some initial findings: If just making gmapi from .img, unless --code-page is given it doesn't do compression, however the Mdr generated with the expected charset. MdrCheck and MdrDisplay, including string dump,

Re: [mkgmap-dev] Please try and report results of Huffman compression

2022-01-16 Thread Gerd Petermann
Hi all, see https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap=4866 and https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap=4867 Please use https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4867.zip for further tests. Gerd Von: 7770