Re: [mkgmap-dev] max-jobs patch

2018-02-19 Thread Mike Baggaley
__ Von: mkgmap-dev <mkgmap-dev-boun...@lists.mkgmap.org.uk> im Auftrag von Mike Baggaley <m...@tvage.co.uk> Gesendet: Freitag, 16. Februar 2018 17:18:15 An: 'Development list for mkgmap' Betreff: Re: [mkgmap-dev] max-jobs patch Hi Gerd, I misread the --max-jobs with no value function

Re: [mkgmap-dev] max-jobs patch

2018-02-19 Thread Gerd Petermann
dev-boun...@lists.mkgmap.org.uk> im Auftrag von Mike Baggaley <m...@tvage.co.uk> Gesendet: Freitag, 16. Februar 2018 17:18:15 An: 'Development list for mkgmap' Betreff: Re: [mkgmap-dev] max-jobs patch Hi Gerd, I misread the --max-jobs with no value functionality. Please find attached a r

Re: [mkgmap-dev] max-jobs patch

2018-02-16 Thread Mike Baggaley
Gerd Von: Mike Baggaley <m...@tvage.co.uk> Gesendet: Freitag, 16. Februar 2018 11:20:03 An: 'Gerd Petermann' Betreff: RE: [mkgmap-dev] max-jobs patch Hi Gerd, as the functionality of --max-jobs without a value is the same as not specifying the parameter (i.e. it is

Re: [mkgmap-dev] max-jobs patch

2018-02-14 Thread Gerd Petermann
kgmap.org.uk Betreff: Re: [mkgmap-dev] max-jobs patch I tried renaming the java library to force a failure and got a java error "Error occurred during initialization of VM" before any mkgmap code was executed, so to be on the safe side, I have removed that code and amended the message

Re: [mkgmap-dev] max-jobs patch

2018-02-14 Thread Mike Baggaley
al Message- From: Steve Ratcliffe [mailto:st...@parabola.me.uk] Sent: 13 February 2018 23:01 To: mkgmap-dev@lists.mkgmap.org.uk Subject: Re: [mkgmap-dev] max-jobs patch Hi Mike > I could take out that bit of code, which is just determining how > much physical memory is installed, so t

Re: [mkgmap-dev] max-jobs patch

2018-02-13 Thread Steve Ratcliffe
Hi Mike I could take out that bit of code, which is just determining how much physical memory is installed, so that mkgmap won't suggest that the user increases the available heap too much. It isn't used in determining a value for maxjobs. Since it is just used for an informational message,

Re: [mkgmap-dev] max-jobs patch

2018-02-13 Thread Mike Baggaley
: Gerd Petermann [mailto:gpetermann_muenc...@hotmail.com] Sent: 10 February 2018 15:45 To: mkgmap-dev@lists.mkgmap.org.uk Subject: Re: [mkgmap-dev] max-jobs patch Hi Mike, I've compiled r4107 with your patch: http://files.mkgmap.org.uk/download/418/mkgmap.jar I did not yet try it because I am still

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Gerd Petermann
Hi Mike, I've compiled r4107 with your patch: http://files.mkgmap.org.uk/download/418/mkgmap.jar I did not yet try it because I am still fighting with the crash in MapSource. I am not sure if the usage of classes like com.sun.management.OperatingSystemMXBean are supported with openjdk? Will

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Henning Scholland
Hi Gerd, these are my runtimes of several compilations of my Turkey map, splitted with 1.500.000 nodes, compiled witout index, gmapi and gmappsupp, but including DEM and routing etc. RAM in GB    Threads     Time1 in ms    Time2 in ms 12                    8                328106           

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Mike Baggaley
(or milliseconds when less than 1 second). Regards, Mike -Original Message- From: Gerd Petermann [mailto:gpetermann_muenc...@hotmail.com] Sent: 07 February 2018 19:06 To: Development list for mkgmap <mkgmap-dev@lists.mkgmap.org.uk> Subject: Re: [mkgmap-dev] max-jobs patch Hi Mike,

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Gerd Petermann
<mkgmap-dev-boun...@lists.mkgmap.org.uk> im Auftrag von Bernd Weigelt <weigelt.be...@web.de> Gesendet: Samstag, 10. Februar 2018 10:19:09 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] max-jobs patch Hi Gerd the unpatched version uses up to 8.7 GB with the options for mkgma

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Gerd Petermann
Samstag, 10. Februar 2018 09:43 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] max-jobs patch Hi tested on my linux box, looks good Heap is 4.4 GB with 8 threads. With the unpatched version i'm using -Xmx8G for the heap Bernd Am Donnerstag, 8. Februar 2018, 15:34:23 CET schrieb Ge

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Bernd Weigelt
Hi tested on my linux box, looks good Heap is 4.4 GB with 8 threads. With the unpatched version i'm using -Xmx8G for the heap Bernd Am Donnerstag, 8. Februar 2018, 15:34:23 CET schrieb Gerd Petermann: > binary is here: > http://files.mkgmap.org.uk/download/415/mkgmap.jar > > For those

Re: [mkgmap-dev] max-jobs patch

2018-02-09 Thread Henning Scholland
Hi Gerd, maybe splitter can be modified  similar. Henning ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] max-jobs patch

2018-02-09 Thread Henning Scholland
Hi Gerd, Hi Mike, I gave it a try on all my maps (splitted with max-nodes=1.600.000). Removed xmx and max jobs. mkgmap used all 8 logical cores and about 4GB of memory. So it seems, Gerd was correct with the 500mb per job. So I would suggest to limit max-jobs with 32bit java to 3 jobs and to

Re: [mkgmap-dev] max-jobs patch

2018-02-08 Thread Gerd Petermann
t for mkgmap Betreff: Re: [mkgmap-dev] max-jobs patch Hi Gerd, Maybe my map is somehow special, but mkgmap definitely need more than 1gb heap per job. I will check on the weekend. Can you please post a patched mkgmap.jar? How about doing it the other way round and suggest the user to use max

Re: [mkgmap-dev] max-jobs patch

2018-02-08 Thread Henning Scholland
_ >Von: mkgmap-dev <mkgmap-dev-boun...@lists.mkgmap.org.uk> im Auftrag von >Manfred Haiduk <mhai...@t-online.de> >Gesendet: Mittwoch, 7. Februar 2018 22:28 >An: mkgmap-dev@lists.mkgmap.org.uk >Betreff: Re: [mkgmap-dev] max-jobs patch > >I don't know, if Nordrh

Re: [mkgmap-dev] max-jobs patch

2018-02-08 Thread Gerd Petermann
__ Von: mkgmap-dev <mkgmap-dev-boun...@lists.mkgmap.org.uk> im Auftrag von Manfred Haiduk <mhai...@t-online.de> Gesendet: Mittwoch, 7. Februar 2018 22:28 An: mkgmap-dev@lists.mkgmap.org.uk Betreff: Re: [mkgmap-dev] max-jobs patch I don't know, if Nordrhein-Westfalen is that kind of

Re: [mkgmap-dev] max-jobs patch

2018-02-07 Thread Manfred Haiduk
018 07:28 To: Mike Baggaley <m...@tvage.co.uk>; 'Development list for mkgmap' <mkgmap-dev@lists.mkgmap.org.uk> Subject: Re: [mkgmap-dev] max-jobs patch Hi Mike, thought about this again. Maybe this change is too simple. With multiple jobs one also needs more heap (-Xmx JRE option). If you create

Re: [mkgmap-dev] max-jobs patch

2018-02-07 Thread Gerd Petermann
erd Von: mkgmap-dev <mkgmap-dev-boun...@lists.mkgmap.org.uk> im Auftrag von Mike Baggaley <m...@tvage.co.uk> Gesendet: Mittwoch, 7. Februar 2018 01:58 An: 'Development list for mkgmap' Betreff: Re: [mkgmap-dev] max-jobs patch Hi Gerd, please f

Re: [mkgmap-dev] max-jobs patch

2018-02-06 Thread Mike Baggaley
t list for mkgmap' <mkgmap-dev@lists.mkgmap.org.uk> Subject: Re: [mkgmap-dev] max-jobs patch Hi Mike, thought about this again. Maybe this change is too simple. With multiple jobs one also needs more heap (-Xmx JRE option). If you create rather large tiles with splitter (max-nodes=160) you nee

Re: [mkgmap-dev] max-jobs patch

2018-02-05 Thread Henning Scholland
Hi Gerd, I think it's even more in combination with DEM. I usually use 6 of my 8 cores and ending up with 10 to 12 GB of heap. So I definitely agree with you available heap somehow needs to be considered as well. Not only CPU cores. Btw. for CFD/FEM analysis the simulation is usually is faster if

Re: [mkgmap-dev] max-jobs patch

2018-02-04 Thread Gerd Petermann
Hi Mike, thought about this again. Maybe this change is too simple. With multiple jobs one also needs more heap (-Xmx JRE option). If you create rather large tiles with splitter (max-nodes=160) you need 0.5 - 1 GB for each job. Not sure what happens when a user creates a map with 10 tiles