Re: [mkgmap-dev] max-jobs patch

2018-02-19 Thread Mike Baggaley
. However, my background is C++ and C#, not Java, so I may be missing some subtlety. Cheers, Mike -Original Message- From: Gerd Petermann [mailto:gpetermann_muenc...@hotmail.com] Sent: 19 February 2018 09:12 To: Development list for mkgmap Subject: Re: [mkgmap-dev] max-jobs patch Hi

Re: [mkgmap-dev] max-jobs patch

2018-02-19 Thread Gerd Petermann
im Auftrag von Mike Baggaley Gesendet: Freitag, 16. Februar 2018 17:18:15 An: 'Development list for mkgmap' Betreff: Re: [mkgmap-dev] max-jobs patch Hi Gerd, I misread the --max-jobs with no value functionality. Please find attached a revised patch that does function that way when th

Re: [mkgmap-dev] max-jobs patch

2018-02-16 Thread Mike Baggaley
Gerd Von: Mike Baggaley Gesendet: Freitag, 16. Februar 2018 11:20:03 An: 'Gerd Petermann' Betreff: RE: [mkgmap-dev] max-jobs patch Hi Gerd, as the functionality of --max-jobs without a value is the same as not specifying the parameter (i.e. it is the default), it seems to me to be bet

Re: [mkgmap-dev] max-jobs patch

2018-02-15 Thread Gerd Petermann
her. Gerd Von: mkgmap-dev im Auftrag von Gerd Petermann Gesendet: Mittwoch, 14. Februar 2018 19:38:06 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] max-jobs patch Hi Mike, okay, I'll try it tomorrow. Gerd _

Re: [mkgmap-dev] max-jobs patch

2018-02-14 Thread Gerd Petermann
Hi Mike, okay, I'll try it tomorrow. Gerd Von: mkgmap-dev im Auftrag von Mike Baggaley Gesendet: Mittwoch, 14. Februar 2018 18:30:28 An: 'Steve Ratcliffe'; mkgmap-dev@lists.mkgmap.org.uk Betreff: Re: [mkgmap-dev] max-jobs patch I tri

Re: [mkgmap-dev] max-jobs patch

2018-02-14 Thread Mike Baggaley
al Message- From: Steve Ratcliffe [mailto:st...@parabola.me.uk] Sent: 13 February 2018 23:01 To: mkgmap-dev@lists.mkgmap.org.uk Subject: Re: [mkgmap-dev] max-jobs patch Hi Mike > I could take out that bit of code, which is just determining how > much physical memory is installed, so t

Re: [mkgmap-dev] max-jobs patch

2018-02-13 Thread Steve Ratcliffe
Hi Mike I could take out that bit of code, which is just determining how much physical memory is installed, so that mkgmap won't suggest that the user increases the available heap too much. It isn't used in determining a value for maxjobs. Since it is just used for an informational message, yo

Re: [mkgmap-dev] max-jobs patch

2018-02-13 Thread Mike Baggaley
al Message- From: Gerd Petermann [mailto:gpetermann_muenc...@hotmail.com] Sent: 10 February 2018 15:45 To: mkgmap-dev@lists.mkgmap.org.uk Subject: Re: [mkgmap-dev] max-jobs patch Hi Mike, I've compiled r4107 with your patch: http://files.mkgmap.org.uk/download/418/mkgmap.jar I did not yet

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Gerd Petermann
Hi Mike, I've compiled r4107 with your patch: http://files.mkgmap.org.uk/download/418/mkgmap.jar I did not yet try it because I am still fighting with the crash in MapSource. I am not sure if the usage of classes like com.sun.management.OperatingSystemMXBean are supported with openjdk? Will this

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Henning Scholland
Hi Gerd, these are my runtimes of several compilations of my Turkey map, splitted with 1.500.000 nodes, compiled witout index, gmapi and gmappsupp, but including DEM and routing etc. RAM in GB    Threads     Time1 in ms    Time2 in ms 12                    8                328106            3236

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Mike Baggaley
and seconds (or milliseconds when less than 1 second). Regards, Mike -Original Message- From: Gerd Petermann [mailto:gpetermann_muenc...@hotmail.com] Sent: 07 February 2018 19:06 To: Development list for mkgmap Subject: Re: [mkgmap-dev] max-jobs patch Hi Mike, I did not yet try it. My u

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Gerd Petermann
Auftrag von Bernd Weigelt Gesendet: Samstag, 10. Februar 2018 10:19:09 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] max-jobs patch Hi Gerd the unpatched version uses up to 8.7 GB with the options for mkgmap I'm using maxnodes=512000 to create an area.list and use this file for

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Bernd Weigelt
Hi Gerd the unpatched version uses up to 8.7 GB with the options for mkgmap I'm using maxnodes=512000 to create an area.list and use this file for every build. At the moment i see no problem with the patched version Bernd Am Samstag, 10. Februar 2018, 09:56:41 CET schrieb Gerd Petermann:

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Gerd Petermann
: [mkgmap-dev] max-jobs patch Hi tested on my linux box, looks good Heap is 4.4 GB with 8 threads. With the unpatched version i'm using -Xmx8G for the heap Bernd Am Donnerstag, 8. Februar 2018, 15:34:23 CET schrieb Gerd Petermann: > binary is here: > http://files.mkgmap.org.uk/d

Re: [mkgmap-dev] max-jobs patch

2018-02-10 Thread Bernd Weigelt
Hi tested on my linux box, looks good Heap is 4.4 GB with 8 threads. With the unpatched version i'm using -Xmx8G for the heap Bernd Am Donnerstag, 8. Februar 2018, 15:34:23 CET schrieb Gerd Petermann: > binary is here: > http://files.mkgmap.org.uk/download/415/mkgmap.jar > > For those users

Re: [mkgmap-dev] max-jobs patch

2018-02-09 Thread Henning Scholland
Hi Gerd, maybe splitter can be modified  similar. Henning ___ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Re: [mkgmap-dev] max-jobs patch

2018-02-09 Thread Henning Scholland
Hi Gerd, Hi Mike, I gave it a try on all my maps (splitted with max-nodes=1.600.000). Removed xmx and max jobs. mkgmap used all 8 logical cores and about 4GB of memory. So it seems, Gerd was correct with the 500mb per job. So I would suggest to limit max-jobs with 32bit java to 3 jobs and to RAM/5

Re: [mkgmap-dev] max-jobs patch

2018-02-08 Thread Gerd Petermann
with or without a paramter before there should be no difference. Gerd Von: mkgmap-dev im Auftrag von Henning Scholland Gesendet: Donnerstag, 8. Februar 2018 09:56 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] max-jobs patch Hi Gerd, Maybe my

Re: [mkgmap-dev] max-jobs patch

2018-02-08 Thread Henning Scholland
Memory() / (512 * 1024 * 1024), >Runtime.getRuntime().availableProcessors()) as default, maybe also for >the case that one >specifies --max-jobs . > >How does that sound? > >Gerd > > > > > > >________________ >Von: mkgmap-dev im

Re: [mkgmap-dev] max-jobs patch

2018-02-08 Thread Gerd Petermann
___ Von: mkgmap-dev im Auftrag von Manfred Haiduk Gesendet: Mittwoch, 7. Februar 2018 22:28 An: mkgmap-dev@lists.mkgmap.org.uk Betreff: Re: [mkgmap-dev] max-jobs patch I don't know, if Nordrhein-Westfalen is that kind of large tiles you meant. Splitter ended up with 43 files

Re: [mkgmap-dev] max-jobs patch

2018-02-07 Thread Manfred Haiduk
obs. What are your experiences? Did you try with large maps, say > 40 large tiles ? Gerd Von: mkgmap-dev im Auftrag von Mike Baggaley Gesendet: Mittwoch, 7. Februar 2018 01:58 An: 'Development list for mkgmap' Betreff: Re: [mkgmap-dev] max

Re: [mkgmap-dev] max-jobs patch

2018-02-07 Thread Gerd Petermann
erd Von: mkgmap-dev im Auftrag von Mike Baggaley Gesendet: Mittwoch, 7. Februar 2018 01:58 An: 'Development list for mkgmap' Betreff: Re: [mkgmap-dev] max-jobs patch Hi Gerd, please find attached v2 of the max-jobs patch. This version additionally c

Re: [mkgmap-dev] max-jobs patch

2018-02-06 Thread Mike Baggaley
ubject: Re: [mkgmap-dev] max-jobs patch Hi Mike, thought about this again. Maybe this change is too simple. With multiple jobs one also needs more heap (-Xmx JRE option). If you create rather large tiles with splitter (max-nodes=160) you need 0.5 - 1 GB for each job. Not sure what happens w

Re: [mkgmap-dev] max-jobs patch

2018-02-05 Thread Henning Scholland
Hi Gerd, I think it's even more in combination with DEM. I usually use 6 of my 8 cores and ending up with 10 to 12 GB of heap. So I definitely agree with you available heap somehow needs to be considered as well. Not only CPU cores. Btw. for CFD/FEM analysis the simulation is usually is faster if y

Re: [mkgmap-dev] max-jobs patch

2018-02-04 Thread Gerd Petermann
Hi Mike, thought about this again. Maybe this change is too simple. With multiple jobs one also needs more heap (-Xmx JRE option). If you create rather large tiles with splitter (max-nodes=160) you need 0.5 - 1 GB for each job. Not sure what happens when a user creates a map with 10 tiles o