Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-26 Thread Gerd Petermann
Hi Ticker,

good to see that the code in WrongAngleFixer is reviewed. I am sure it can be 
improved.
Just keep in mind that it sometimes finds out that it is better to place the 
"moved" point
on top of another. If this happens with routing nodes you need a way to 
calculate the bearing
values "between" these points. If you decide to remove the information from the 
coords
you probably have to store it in the way.

Gerd

Von: mkgmap-dev  im Auftrag von Ticker 
Berkin 
Gesendet: Samstag, 25. Februar 2017 18:17:37
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Gerd

Sorry about the delay in replying. Thoughts on some of this.

Assuming the MapRes and highRes are related by powers of 2, and all the
rounding is done consistently, there should never be any difference
between going via highRes to get from the original doubleFloat value to
a MapRes value.

The most consistent rounding in mkgmap code is to the closest whole
number with x.5 rounding up towards plus infinity.
This is also the definition of Math.round().

So, it would be much clearer and have the same effect if
 old:imgFmt.Utils.toMapUnit
 new:Coord.toHighPrec
were re-coded as
  return Math.round(degrees / 360.0D * (1 << resolution))

Other cases of rounding should be checked - esp. Utils.roundup()),
which I thought was wrong, but looking again seems OK.
This effects how the base Lat/Lon for a subdivision is held - should be
a correctly rounded value.

In the new versions of Coord.getLatitude/Longitude(), could have/use
final int DELTA_HALF = 1 << (DELTA_SHIFT - 1);

I'm still studying the wrongAngleFixer/AlternativePos/DisplayedCoord
stuff, but getting a little bit lost as to when need to keep the all
the flags in the copy of the Coord and when not (ie getDisplayedCoord
loses all the flags and highPrec info) and what is taken into account
for the distance() function

I have this feeling that Coord shouldn't have all this INC/DEC_LAT/LON
stuff but wrongAngleFixer just make up an adjacent Coord if it does a
better job

Ticker

On Fri, 2017-02-24 at 10:54 +, Gerd Petermann wrote:
> Hi Ticker,
>
> okay, here are my findings so far:
> 1) We assume that the double values read from OSM or polist (*.mp)
> format are precise
> 2) The code in the Coord class tries to reduce rounding errors. It
> calculates both the 24 values AND the high prec values
> from the given doubles. An alternative would be to calculate only the
> high prec values from the doubles and then
> calculate the 24 bit values by shifting, but that would in fact mean
> that the value is rounded two times. In some edge cases
> you will get different 24 values doing this. The delta values are
> stored in the Coord instance and for 30 bits precision
> they are -32 <= delta < 32.
> The picture grid1 shows some OSM elements and the Garmin Grid (24 bit
> resolution):
> http://files.mkgmap.org.uk/download/335/grid1.png
> and what the "normal" rounding does (note the zig-zagging rails)
> http://files.mkgmap.org.uk/download/336/grid2.png
>
> 3) The method Coord.getAlternativePositions() called by
> WrongAngleFixer introduces some additional problems:
> It creates Coord instances where the delta values can be up to 63 (
> -63 <= delta < 63). This sounds much, but it only happens for OSM
> nodes
> which are far from any Garmin grid point. Imagine that an OSM node
> lies exactly in the center of four Garmin grid points.
> All four would have the same rounding error, but the distance between
> them can be ~2.3 m.
> Which of the four Garmin points should be returned by the
> Coord.getDisplayedCoord() method?
> For a single POI like a natural=peak it doesn't really matter, but
> for a node which is part of a roundabout or a railway=rail
> you want to get the point which "looks" better. A human knows by
> experience that rails are not zig-zagging, so
> the goal of the WrongAngleFixer is find the Garmin point which causes
> the smallest errors in the angles.
> This is not only done for points which lie exactly in the center of
> Garmin grid points, but for all which are not close to one such
> point.
> The WrongAngleFixer uses a iterative try-error approach to find those
> nodes which should be "moved", and it needs to know the
> "original" position. I found no performant way to implement that with
> hashmaps, so I decided to code what we have now.
> The improved result looks like this:
> http://files.mkgmap.org.uk/download/337/grid3.png
>
> Later in the data flow the routines for the road network also need to
> know the real positions when they calculate the bearing values.
>
> In short: I found no better solution, it works quite well but one has
>

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-25 Thread Ticker Berkin
Hi Gerd

Sorry about the delay in replying. Thoughts on some of this.

Assuming the MapRes and highRes are related by powers of 2, and all the
rounding is done consistently, there should never be any difference
between going via highRes to get from the original doubleFloat value to
a MapRes value.

The most consistent rounding in mkgmap code is to the closest whole
number with x.5 rounding up towards plus infinity.
This is also the definition of Math.round().

So, it would be much clearer and have the same effect if 
 old:imgFmt.Utils.toMapUnit
 new:Coord.toHighPrec
were re-coded as
  return Math.round(degrees / 360.0D * (1 << resolution))

Other cases of rounding should be checked - esp. Utils.roundup()),
which I thought was wrong, but looking again seems OK.
This effects how the base Lat/Lon for a subdivision is held - should be
a correctly rounded value.

In the new versions of Coord.getLatitude/Longitude(), could have/use
final int DELTA_HALF = 1 << (DELTA_SHIFT - 1);

I'm still studying the wrongAngleFixer/AlternativePos/DisplayedCoord
stuff, but getting a little bit lost as to when need to keep the all
the flags in the copy of the Coord and when not (ie getDisplayedCoord
loses all the flags and highPrec info) and what is taken into account
for the distance() function

I have this feeling that Coord shouldn't have all this INC/DEC_LAT/LON
stuff but wrongAngleFixer just make up an adjacent Coord if it does a
better job

Ticker

On Fri, 2017-02-24 at 10:54 +, Gerd Petermann wrote:
> Hi Ticker,
> 
> okay, here are my findings so far:
> 1) We assume that the double values read from OSM or polist (*.mp)
> format are precise
> 2) The code in the Coord class tries to reduce rounding errors. It
> calculates both the 24 values AND the high prec values
> from the given doubles. An alternative would be to calculate only the
> high prec values from the doubles and then
> calculate the 24 bit values by shifting, but that would in fact mean
> that the value is rounded two times. In some edge cases
> you will get different 24 values doing this. The delta values are
> stored in the Coord instance and for 30 bits precision
> they are -32 <= delta < 32. 
> The picture grid1 shows some OSM elements and the Garmin Grid (24 bit
> resolution):
> http://files.mkgmap.org.uk/download/335/grid1.png
> and what the "normal" rounding does (note the zig-zagging rails)
> http://files.mkgmap.org.uk/download/336/grid2.png
> 
> 3) The method Coord.getAlternativePositions() called by
> WrongAngleFixer introduces some additional problems:
> It creates Coord instances where the delta values can be up to 63 (
> -63 <= delta < 63). This sounds much, but it only happens for OSM
> nodes
> which are far from any Garmin grid point. Imagine that an OSM node
> lies exactly in the center of four Garmin grid points.
> All four would have the same rounding error, but the distance between
> them can be ~2.3 m.
> Which of the four Garmin points should be returned by the
> Coord.getDisplayedCoord() method?
> For a single POI like a natural=peak it doesn't really matter, but
> for a node which is part of a roundabout or a railway=rail 
> you want to get the point which "looks" better. A human knows by
> experience that rails are not zig-zagging, so 
> the goal of the WrongAngleFixer is find the Garmin point which causes
> the smallest errors in the angles.
> This is not only done for points which lie exactly in the center of
> Garmin grid points, but for all which are not close to one such
> point.
> The WrongAngleFixer uses a iterative try-error approach to find those
> nodes which should be "moved", and it needs to know the
> "original" position. I found no performant way to implement that with
> hashmaps, so I decided to code what we have now.
> The improved result looks like this:
> http://files.mkgmap.org.uk/download/337/grid3.png
> 
> Later in the data flow the routines for the road network also need to
> know the real positions when they calculate the bearing values.
> 
> In short: I found no better solution, it works quite well but one has
> to think twice if he needs the Garmin position or the high prec (OSM)
> position.
> 
> Worth noting is that the WrongAngleFixer is called for lines and
> shapes, but at different stages. 
> For lines (and roads), it is called  before MapLine instances are
> created. For shapes, it is called by the ShapeMergeFilter
> which is called after all the sub division splitting happened. 
> That means In the current code (r3820), the ShapeSplitter doesn't
> have to care about "moved" points in shapes.
> 
> Gerd
> 
> Von: mkgmap-dev  im Auftrag
> von Gerd Petermann 
> Gesendet: D

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-24 Thread Gerd Petermann
Hi Ticker,

okay, here are my findings so far:
1) We assume that the double values read from OSM or polist (*.mp) format are 
precise
2) The code in the Coord class tries to reduce rounding errors. It calculates 
both the 24 values AND the high prec values
from the given doubles. An alternative would be to calculate only the high prec 
values from the doubles and then
calculate the 24 bit values by shifting, but that would in fact mean that the 
value is rounded two times. In some edge cases
you will get different 24 values doing this. The delta values are stored in the 
Coord instance and for 30 bits precision
they are -32 <= delta < 32. 
The picture grid1 shows some OSM elements and the Garmin Grid (24 bit 
resolution):
http://files.mkgmap.org.uk/download/335/grid1.png
and what the "normal" rounding does (note the zig-zagging rails)
http://files.mkgmap.org.uk/download/336/grid2.png

3) The method Coord.getAlternativePositions() called by WrongAngleFixer 
introduces some additional problems:
It creates Coord instances where the delta values can be up to 63 (-63 <= delta 
< 63). This sounds much, but it only happens for OSM nodes
which are far from any Garmin grid point. Imagine that an OSM node lies exactly 
in the center of four Garmin grid points.
All four would have the same rounding error, but the distance between them can 
be ~2.3 m.
Which of the four Garmin points should be returned by the 
Coord.getDisplayedCoord() method?
For a single POI like a natural=peak it doesn't really matter, but for a node 
which is part of a roundabout or a railway=rail 
you want to get the point which "looks" better. A human knows by experience 
that rails are not zig-zagging, so 
the goal of the WrongAngleFixer is find the Garmin point which causes the 
smallest errors in the angles.
This is not only done for points which lie exactly in the center of Garmin grid 
points, but for all which are not close to one such point.
The WrongAngleFixer uses a iterative try-error approach to find those nodes 
which should be "moved", and it needs to know the
"original" position. I found no performant way to implement that with hashmaps, 
so I decided to code what we have now.
The improved result looks like this:
http://files.mkgmap.org.uk/download/337/grid3.png

Later in the data flow the routines for the road network also need to know the 
real positions when they calculate the bearing values.

In short: I found no better solution, it works quite well but one has to think 
twice if he needs the Garmin position or the high prec (OSM) position.

Worth noting is that the WrongAngleFixer is called for lines and shapes, but at 
different stages. 
For lines (and roads), it is called  before MapLine instances are created. For 
shapes, it is called by the ShapeMergeFilter
which is called after all the sub division splitting happened. 
That means In the current code (r3820), the ShapeSplitter doesn't have to care 
about "moved" points in shapes.

Gerd

Von: mkgmap-dev  im Auftrag von Gerd 
Petermann 
Gesendet: Dienstag, 21. Februar 2017 20:01:06
An: Development list for mkgmap
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Ticker,

okay, I'll try to find out (again) why I decided to do the move only in 
low-prec. I know that I was not happy with that, but I forgot the reason. I 
think one was that the WrongAngleFixer started to move points too far. Anyway, 
I should fix this first.

I started to go for 32 bits because some algos which I coded for JOSM use this 
res. It seemed easier to change mkgmap to
also use 32 bits, but I am no longer sure about that.

Gerd

Von: mkgmap-dev  im Auftrag von Ticker 
Berkin 
Gesendet: Dienstag, 21. Februar 2017 18:44:35
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi

According to my calcs, full 32 bit integers give a resolution of about
10mm at the equator. Why do you need better than existing high-res (30
bits - ~40mm)? Maybe go to 31 to save the +-180 degree problem.

Not to have the resolution as a powerOfTwo of the garmin map unit would
require a lot of changes throughout the code and a run-time cost.

Manipulating high-res deltas such that the rounded values diverges from
the the std lat/long value seems very wrong (is this what it does, or
does it simply change one but not the other). Maybe wrong-angle stuff
should be looked at to see if there is a better way. This is an area
I've never been near.

Would be great if Area/bounds and Coord used the same (high-prec) units
and there was no ambiguity about contains().

Ticker




___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
m

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-21 Thread Gerd Petermann
Hi Ticker,

okay, I'll try to find out (again) why I decided to do the move only in 
low-prec. I know that I was not happy with that, but I forgot the reason. I 
think one was that the WrongAngleFixer started to move points too far. Anyway, 
I should fix this first.

I started to go for 32 bits because some algos which I coded for JOSM use this 
res. It seemed easier to change mkgmap to
also use 32 bits, but I am no longer sure about that.

Gerd

Von: mkgmap-dev  im Auftrag von Ticker 
Berkin 
Gesendet: Dienstag, 21. Februar 2017 18:44:35
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi

According to my calcs, full 32 bit integers give a resolution of about
10mm at the equator. Why do you need better than existing high-res (30
bits - ~40mm)? Maybe go to 31 to save the +-180 degree problem.

Not to have the resolution as a powerOfTwo of the garmin map unit would
require a lot of changes throughout the code and a run-time cost.

Manipulating high-res deltas such that the rounded values diverges from
the the std lat/long value seems very wrong (is this what it does, or
does it simply change one but not the other). Maybe wrong-angle stuff
should be looked at to see if there is a better way. This is an area
I've never been near.

Would be great if Area/bounds and Coord used the same (high-prec) units
and there was no ambiguity about contains().

Ticker




___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-21 Thread Ticker Berkin
Hi

According to my calcs, full 32 bit integers give a resolution of about
10mm at the equator. Why do you need better than existing high-res (30
bits - ~40mm)? Maybe go to 31 to save the +-180 degree problem.
 
Not to have the resolution as a powerOfTwo of the garmin map unit would
require a lot of changes throughout the code and a run-time cost.

Manipulating high-res deltas such that the rounded values diverges from
the the std lat/long value seems very wrong (is this what it does, or
does it simply change one but not the other). Maybe wrong-angle stuff
should be looked at to see if there is a better way. This is an area
I've never been near.

Would be great if Area/bounds and Coord used the same (high-prec) units
and there was no ambiguity about contains().

Ticker


 

___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-21 Thread Gerd Petermann
Hi Andrzej,

sounds possible, but would require lots of difficult changes.
That's the problem, each possible way seems to include lots of changes :-(
I think the first step is to code more unit tests ...

Gerd




Von: mkgmap-dev  im Auftrag von Andrzej 
Popowski 
Gesendet: Dienstag, 21. Februar 2017 13:13:25
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Gerd,

could you really make a map, which include both +180 and -180
coordinates? I create a map of Asia and I intentionally limit area to
179., because of compilation problems.

Maybe if you limit input data that way, that you never process -180 and
+180 at the same time, then you could ignore double meaning of +-180?

--
Best regards,
Andrzej
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-21 Thread Andrzej Popowski

Hi Gerd,

could you really make a map, which include both +180 and -180 
coordinates? I create a map of Asia and I intentionally limit area to 
179., because of compilation problems.


Maybe if you limit input data that way, that you never process -180 and 
+180 at the same time, then you could ignore double meaning of +-180?


--
Best regards,
Andrzej
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-21 Thread Gerd Petermann
Hi Andrzej,

no, it causes lots of problems.
For example, the bounding box for planet is (-90.0, -180.0, 90.0, 180.0).
If we don't distinct the positions of the left side from the right the area is 
a line with width 0.

The funny thing is that the precision in OSM doesn't even use all possible 32 
bit integers, only those for
-180 * 10_000_000 to 180 * 10_000_000  so the extreme values near 
Integer.MAX_VALUE are never used
(at least that is the conversion done in pbf or o5m format).

I think about using this format for Coord and maybe also Area.

Gerd

Von: mkgmap-dev  im Auftrag von Andrzej 
Popowski 
Gesendet: Dienstag, 21. Februar 2017 12:23:57
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Gerd,

 > I found new problems, e.g. 180.0 degrees and -180.0 degrees started
 > to give the same 32 bit value.

Isn't it good? The same is true for 24 bit precision and even for 8bit
angles.

--
Best regards,
Andrzej
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-21 Thread Andrzej Popowski

Hi Gerd,

> I found new problems, e.g. 180.0 degrees and -180.0 degrees started
> to give the same 32 bit value.

Isn't it good? The same is true for 24 bit precision and even for 8bit 
angles.


--
Best regards,
Andrzej
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-21 Thread Gerd Petermann
Hi Ticker,

I thought about this for a while and I am still not sure where to go.

One problem with the high-prec stuff is that it is missleading.
When I started to code the highprec() code my only intention was to be able to
retreive "the original" position as coded in OSM.
You probably learned it the hard way that the value returned by 
Coord.getLatitude()
sometimes is different to the value from a rounded Coord.getHighPrecLat() .
The reason is that functions like Coord.getAlternativePositions() used by 
WrongAngleFixer
create Coord instances with the same highprec positions but different rounding 
(a bit more to
the left or right, a bit more up or down). The idea is that the map looks 
better when
the error for that single point is increased. A good place to check this are 
multiple parallel rails.

I am still trying to find good code to calculate the bounding box for coords 
with this special case.
When such a point is close to or "on" the bounding box in one precision it 
might be outside
with the other. I wonder if it would be better to use low precision as soon as 
possible.

If you have a good idea for that please let me know.

In the meantime I have found some reasons to change precision from 30 to 32 bit 
as this helps when
checking mp-relations. I found new problems, e.g. 180.0 degrees and -180.0 
degrees started to give the
same 32 bit value. Working on that now...

Gerd


Von: mkgmap-dev  im Auftrag von Ticker 
Berkin 
Gesendet: Freitag, 17. Februar 2017 15:49:10
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Gerd

Thoughts were:

I was having problems with a multi-polygon relation where OSM showed a
very small gap between 2 parts, but some final cutting of the shape
found that these lines now intersected, and I thought it could be a
mapPrec vs highPrec problem where the multiPolygonRelation logic is
looking for this sort of thing. Changing it to highPrec didn't fix it
(you found that the problem was roundCoord filter) but the changes
looked worth keeping because:

MultiPolygon cutting to expose holes uses highPrec and it seemed best
to be consistent, avoiding cuts that might leave very small areas.

A general move in the direction of all coordinates/bounds/etc being the
held only in highPrec and resolution 24 not being a special case.

But I don't have strong feelings about it.

Ticker

On Fri, 2017-02-17 at 13:12 +, Gerd Petermann wrote:
> Hi Ticker,
>
> I did not see an advantage in using high-prec. Why do you think it
> should be used?
>
> Gerd
>
> 
> Von: mkgmap-dev  im Auftrag
> von Ticker Berkin 
> Gesendet: Freitag, 17. Februar 2017 13:27:28
> An: mkgmap-dev@lists.mkgmap.org.uk
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
>
> Hi Gerd
>
> Yes - sorry, my fault.
> I've just tested a fix to this and the sea is OK now. Is is worth
> keeping the high-res changes in the split-shape branch pending more
> work on MultiPolygonRelation? If so I'll commit.
>
> Ticker
>
>
> On Fri, 2017-02-17 at 10:49 +, Gerd Petermann wrote:
> > Hi Ticker,
> >
> > problem is in these lines:
> > if (remove) {
> > // check if the polygon contains
> > the
> > complete bounding box
> > if
> > (w.getBounds().contains(tileArea.getBounds())) {
> > remove = false;
> > }
> > }
> > 1) The SeaGenerator creates an outer way which is larger than the
> > tile bounds.
> > 2) This test was wrong because w.getBounds() returns a bbox  in
> > highprec values and tileArea.getBounds()  is in Garmin units
> >
> > Gerd
> > ____________
> > Von: mkgmap-dev  im Auftrag
> > von Ticker Berkin 
> > Gesendet: Freitag, 17. Februar 2017 11:00:49
> > An: mkgmap-dev@lists.mkgmap.org.uk
> > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> >
> > Hi Gerd
> >
> > Good.
> >
> > Ticker
> >
> > On Fri, 2017-02-17 at 09:41 +, Gerd Petermann wrote:
> > > Hi Ticker,
> > >
> > > attached is the patch I've created with help of svn.
> > > It only reverts the changes made to MultiPolygonRelation in
> > > r3771.
> > >
> > > I don't know yet why they cause trouble.
> > >
> > > Gerd
> > > 
> > > Von: mkgmap-dev  im
> > > Auftrag
> > > von Ticker Berkin 
> > > Gesendet: Freitag, 17. Feb

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-17 Thread Ticker Berkin
Hi Gerd

Thoughts were:

I was having problems with a multi-polygon relation where OSM showed a
very small gap between 2 parts, but some final cutting of the shape
found that these lines now intersected, and I thought it could be a
mapPrec vs highPrec problem where the multiPolygonRelation logic is
looking for this sort of thing. Changing it to highPrec didn't fix it
(you found that the problem was roundCoord filter) but the changes
looked worth keeping because:

MultiPolygon cutting to expose holes uses highPrec and it seemed best
to be consistent, avoiding cuts that might leave very small areas.

A general move in the direction of all coordinates/bounds/etc being the
held only in highPrec and resolution 24 not being a special case.

But I don't have strong feelings about it.

Ticker

On Fri, 2017-02-17 at 13:12 +, Gerd Petermann wrote:
> Hi Ticker,
> 
> I did not see an advantage in using high-prec. Why do you think it
> should be used?
> 
> Gerd
> 
> 
> Von: mkgmap-dev  im Auftrag
> von Ticker Berkin 
> Gesendet: Freitag, 17. Februar 2017 13:27:28
> An: mkgmap-dev@lists.mkgmap.org.uk
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> 
> Hi Gerd
> 
> Yes - sorry, my fault.
> I've just tested a fix to this and the sea is OK now. Is is worth
> keeping the high-res changes in the split-shape branch pending more
> work on MultiPolygonRelation? If so I'll commit.
> 
> Ticker
> 
> 
> On Fri, 2017-02-17 at 10:49 +, Gerd Petermann wrote:
> > Hi Ticker,
> > 
> > problem is in these lines:
> > if (remove) {
> > // check if the polygon contains
> > the
> > complete bounding box
> > if
> > (w.getBounds().contains(tileArea.getBounds())) {
> > remove = false;
> > }
> > }
> > 1) The SeaGenerator creates an outer way which is larger than the
> > tile bounds.
> > 2) This test was wrong because w.getBounds() returns a bbox  in
> > highprec values and tileArea.getBounds()  is in Garmin units
> > 
> > Gerd
> > ____________________
> > Von: mkgmap-dev  im Auftrag
> > von Ticker Berkin 
> > Gesendet: Freitag, 17. Februar 2017 11:00:49
> > An: mkgmap-dev@lists.mkgmap.org.uk
> > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> > 
> > Hi Gerd
> > 
> > Good.
> > 
> > Ticker
> > 
> > On Fri, 2017-02-17 at 09:41 +, Gerd Petermann wrote:
> > > Hi Ticker,
> > > 
> > > attached is the patch I've created with help of svn.
> > > It only reverts the changes made to MultiPolygonRelation in
> > > r3771.
> > > 
> > > I don't know yet why they cause trouble.
> > > 
> > > Gerd
> > > 
> > > Von: mkgmap-dev  im
> > > Auftrag
> > > von Ticker Berkin 
> > > Gesendet: Freitag, 17. Februar 2017 10:32:11
> > > An: mkgmap-dev@lists.mkgmap.org.uk
> > > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape
> > > branch
> > > 
> > > Hi Gerd
> > > 
> > > Yes - if that fixes it.
> > > But
> > >  in r3771 were there a couple of other changes not to
> > > MultiPolygon...
> > >  haven't a lot more changes been made since to MultiPolygon...
> > > 
> > > Ticker
> > > 
> > > 
> > > On Fri, 2017-02-17 at 09:19 +0000, Gerd Petermann wrote:
> > > > Hi Ticker,
> > > > 
> > > > I think the problems were introduced with the highprec changes
> > > > in
> > > > MultiPolygonRelation in r3771.
> > > > When I revert those the problem is gone. If you don't mind I
> > > > commit
> > > > this revert.
> > > > 
> > > > Gerd
> > > > 
> > > > Von: mkgmap-dev  im
> > > > Auftrag
> > > > von Gerd Petermann 
> > > > Gesendet: Freitag, 17. Februar 2017 10:02:38
> > > > An: Development list for mkgmap
> > > > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape
> > > > branch
> > > > 
> > > > Hi Ticker,
> > > > 
> > > > don't need test data, found out what you meant.
> > > > 
> > > > Gerd
> > > > ___

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-17 Thread Gerd Petermann
Hi Ticker,

I did not see an advantage in using high-prec. Why do you think it should be 
used?

Gerd


Von: mkgmap-dev  im Auftrag von Ticker 
Berkin 
Gesendet: Freitag, 17. Februar 2017 13:27:28
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Gerd

Yes - sorry, my fault.
I've just tested a fix to this and the sea is OK now. Is is worth
keeping the high-res changes in the split-shape branch pending more
work on MultiPolygonRelation? If so I'll commit.

Ticker


On Fri, 2017-02-17 at 10:49 +, Gerd Petermann wrote:
> Hi Ticker,
>
> problem is in these lines:
> if (remove) {
> // check if the polygon contains the
> complete bounding box
> if
> (w.getBounds().contains(tileArea.getBounds())) {
> remove = false;
> }
> }
> 1) The SeaGenerator creates an outer way which is larger than the
> tile bounds.
> 2) This test was wrong because w.getBounds() returns a bbox  in
> highprec values and tileArea.getBounds()  is in Garmin units
>
> Gerd
> 
> Von: mkgmap-dev  im Auftrag
> von Ticker Berkin 
> Gesendet: Freitag, 17. Februar 2017 11:00:49
> An: mkgmap-dev@lists.mkgmap.org.uk
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
>
> Hi Gerd
>
> Good.
>
> Ticker
>
> On Fri, 2017-02-17 at 09:41 +, Gerd Petermann wrote:
> > Hi Ticker,
> >
> > attached is the patch I've created with help of svn.
> > It only reverts the changes made to MultiPolygonRelation in r3771.
> >
> > I don't know yet why they cause trouble.
> >
> > Gerd
> > ________
> > Von: mkgmap-dev  im Auftrag
> > von Ticker Berkin 
> > Gesendet: Freitag, 17. Februar 2017 10:32:11
> > An: mkgmap-dev@lists.mkgmap.org.uk
> > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> >
> > Hi Gerd
> >
> > Yes - if that fixes it.
> > But
> >  in r3771 were there a couple of other changes not to
> > MultiPolygon...
> >  haven't a lot more changes been made since to MultiPolygon...
> >
> > Ticker
> >
> >
> > On Fri, 2017-02-17 at 09:19 +, Gerd Petermann wrote:
> > > Hi Ticker,
> > >
> > > I think the problems were introduced with the highprec changes in
> > > MultiPolygonRelation in r3771.
> > > When I revert those the problem is gone. If you don't mind I
> > > commit
> > > this revert.
> > >
> > > Gerd
> > > 
> > > Von: mkgmap-dev  im
> > > Auftrag
> > > von Gerd Petermann 
> > > Gesendet: Freitag, 17. Februar 2017 10:02:38
> > > An: Development list for mkgmap
> > > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape
> > > branch
> > >
> > > Hi Ticker,
> > >
> > > don't need test data, found out what you meant.
> > >
> > > Gerd
> > > 
> > > Von: mkgmap-dev  im
> > > Auftrag
> > > von Gerd Petermann 
> > > Gesendet: Freitag, 17. Februar 2017 09:52:56
> > > An: Development list for mkgmap
> > > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape
> > > branch
> > >
> > > Hi Ticker,
> > >
> > > okay, I'll merge the branch into trunk.
> > > Please post some test data to show the coastline problem and I'll
> > > try
> > > to fix it.
> > >
> > > Gerd
> > > 
> > > Von: mkgmap-dev  im
> > > Auftrag
> > > von Ticker Berkin 
> > > Gesendet: Freitag, 17. Februar 2017 09:50:17
> > > An: mkgmap-dev@lists.mkgmap.org.uk
> > > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape
> > > branch
> > >
> > > Hi Gerd
> > >
> > > I fixed this problem with r3807 in the split-shape branch and
> > > this
> > > should probably be merged into trunk.
> > >
> > > Mike was also getting another problem that might be related to
> > > generate-sea:extend-sea-sectors
> > >
> > > I don't know much about this area, but just having this option
> > > and
> > > nothing else of significance, it seems as if the overview map has
> &

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-17 Thread Ticker Berkin
Hi Gerd

Yes - sorry, my fault.
I've just tested a fix to this and the sea is OK now. Is is worth
keeping the high-res changes in the split-shape branch pending more
work on MultiPolygonRelation? If so I'll commit.

Ticker


On Fri, 2017-02-17 at 10:49 +, Gerd Petermann wrote:
> Hi Ticker,
> 
> problem is in these lines:
> if (remove) {
> // check if the polygon contains the
> complete bounding box
> if
> (w.getBounds().contains(tileArea.getBounds())) {
> remove = false;
> }
> }
> 1) The SeaGenerator creates an outer way which is larger than the
> tile bounds.
> 2) This test was wrong because w.getBounds() returns a bbox  in
> highprec values and tileArea.getBounds()  is in Garmin units
> 
> Gerd
> 
> Von: mkgmap-dev  im Auftrag
> von Ticker Berkin 
> Gesendet: Freitag, 17. Februar 2017 11:00:49
> An: mkgmap-dev@lists.mkgmap.org.uk
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> 
> Hi Gerd
> 
> Good.
> 
> Ticker
> 
> On Fri, 2017-02-17 at 09:41 +, Gerd Petermann wrote:
> > Hi Ticker,
> > 
> > attached is the patch I've created with help of svn.
> > It only reverts the changes made to MultiPolygonRelation in r3771.
> > 
> > I don't know yet why they cause trouble.
> > 
> > Gerd
> > ________
> > Von: mkgmap-dev  im Auftrag
> > von Ticker Berkin 
> > Gesendet: Freitag, 17. Februar 2017 10:32:11
> > An: mkgmap-dev@lists.mkgmap.org.uk
> > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> > 
> > Hi Gerd
> > 
> > Yes - if that fixes it.
> > But
> >  in r3771 were there a couple of other changes not to
> > MultiPolygon...
> >  haven't a lot more changes been made since to MultiPolygon...
> > 
> > Ticker
> > 
> > 
> > On Fri, 2017-02-17 at 09:19 +, Gerd Petermann wrote:
> > > Hi Ticker,
> > > 
> > > I think the problems were introduced with the highprec changes in
> > > MultiPolygonRelation in r3771.
> > > When I revert those the problem is gone. If you don't mind I
> > > commit
> > > this revert.
> > > 
> > > Gerd
> > > 
> > > Von: mkgmap-dev  im
> > > Auftrag
> > > von Gerd Petermann 
> > > Gesendet: Freitag, 17. Februar 2017 10:02:38
> > > An: Development list for mkgmap
> > > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape
> > > branch
> > > 
> > > Hi Ticker,
> > > 
> > > don't need test data, found out what you meant.
> > > 
> > > Gerd
> > > 
> > > Von: mkgmap-dev  im
> > > Auftrag
> > > von Gerd Petermann 
> > > Gesendet: Freitag, 17. Februar 2017 09:52:56
> > > An: Development list for mkgmap
> > > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape
> > > branch
> > > 
> > > Hi Ticker,
> > > 
> > > okay, I'll merge the branch into trunk.
> > > Please post some test data to show the coastline problem and I'll
> > > try
> > > to fix it.
> > > 
> > > Gerd
> > > 
> > > Von: mkgmap-dev  im
> > > Auftrag
> > > von Ticker Berkin 
> > > Gesendet: Freitag, 17. Februar 2017 09:50:17
> > > An: mkgmap-dev@lists.mkgmap.org.uk
> > > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape
> > > branch
> > > 
> > > Hi Gerd
> > > 
> > > I fixed this problem with r3807 in the split-shape branch and
> > > this
> > > should probably be merged into trunk.
> > > 
> > > Mike was also getting another problem that might be related to
> > > generate-sea:extend-sea-sectors
> > > 
> > > I don't know much about this area, but just having this option
> > > and
> > > nothing else of significance, it seems as if the overview map has
> > > all
> > > sea if it has a coastline
> > > 
> > > Ticker
> > > 
> > > On Thu, 2017-02-16 at 20:12 +, Gerd Petermann wrote:
> > > > Hi Ticker,
> > > > 
> > > > In case you need test data: I've uploaded a file

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-17 Thread Gerd Petermann
Hi Ticker,

problem is in these lines:
if (remove) {
// check if the polygon contains the complete 
bounding box
if 
(w.getBounds().contains(tileArea.getBounds())) {
remove = false;
}
}
1) The SeaGenerator creates an outer way which is larger than the tile bounds.
2) This test was wrong because w.getBounds() returns a bbox  in highprec values 
and tileArea.getBounds()  is in Garmin units

Gerd

Von: mkgmap-dev  im Auftrag von Ticker 
Berkin 
Gesendet: Freitag, 17. Februar 2017 11:00:49
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Gerd

Good.

Ticker

On Fri, 2017-02-17 at 09:41 +, Gerd Petermann wrote:
> Hi Ticker,
>
> attached is the patch I've created with help of svn.
> It only reverts the changes made to MultiPolygonRelation in r3771.
>
> I don't know yet why they cause trouble.
>
> Gerd
> 
> Von: mkgmap-dev  im Auftrag
> von Ticker Berkin 
> Gesendet: Freitag, 17. Februar 2017 10:32:11
> An: mkgmap-dev@lists.mkgmap.org.uk
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
>
> Hi Gerd
>
> Yes - if that fixes it.
> But
>  in r3771 were there a couple of other changes not to MultiPolygon...
>  haven't a lot more changes been made since to MultiPolygon...
>
> Ticker
>
>
> On Fri, 2017-02-17 at 09:19 +, Gerd Petermann wrote:
> > Hi Ticker,
> >
> > I think the problems were introduced with the highprec changes in
> > MultiPolygonRelation in r3771.
> > When I revert those the problem is gone. If you don't mind I commit
> > this revert.
> >
> > Gerd
> > 
> > Von: mkgmap-dev  im Auftrag
> > von Gerd Petermann 
> > Gesendet: Freitag, 17. Februar 2017 10:02:38
> > An: Development list for mkgmap
> > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> >
> > Hi Ticker,
> >
> > don't need test data, found out what you meant.
> >
> > Gerd
> > ________
> > Von: mkgmap-dev  im Auftrag
> > von Gerd Petermann 
> > Gesendet: Freitag, 17. Februar 2017 09:52:56
> > An: Development list for mkgmap
> > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> >
> > Hi Ticker,
> >
> > okay, I'll merge the branch into trunk.
> > Please post some test data to show the coastline problem and I'll
> > try
> > to fix it.
> >
> > Gerd
> > 
> > Von: mkgmap-dev  im Auftrag
> > von Ticker Berkin 
> > Gesendet: Freitag, 17. Februar 2017 09:50:17
> > An: mkgmap-dev@lists.mkgmap.org.uk
> > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> >
> > Hi Gerd
> >
> > I fixed this problem with r3807 in the split-shape branch and this
> > should probably be merged into trunk.
> >
> > Mike was also getting another problem that might be related to
> > generate-sea:extend-sea-sectors
> >
> > I don't know much about this area, but just having this option and
> > nothing else of significance, it seems as if the overview map has
> > all
> > sea if it has a coastline
> >
> > Ticker
> >
> > On Thu, 2017-02-16 at 20:12 +, Gerd Petermann wrote:
> > > Hi Ticker,
> > >
> > > In case you need test data: I've uploaded a file :
> > > http://files.mkgmap.org.uk/download/334/88009211.osm.pbf
> > > Produces the error with r3811 without any options, just
> > > java -jar mkpgmap.jar 88009211.osm.pbf
> > > Seems to work okay with r3807.
> > >
> > > Gerd
> > >
> > > 
> > > Von: mkgmap-dev  im
> > > Auftrag
> > > von Mike Baggaley 
> > > Gesendet: Donnerstag, 16. Februar 2017 10:40:55
> > > An: mkgmap-dev@lists.mkgmap.org.uk
> > > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape
> > > branch
> > >
> > > HI Ticker, I'll package up some data for you. I have generate
> > > -sea:extend-sea-sectors in my options file, I think it will be
> > > related to that.
> > >
> > > Regards,
> > > Mike
> > >
> > > -Original Message-
> > > From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk]
> > &g

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-17 Thread Ticker Berkin
Hi Gerd

Good.

Ticker

On Fri, 2017-02-17 at 09:41 +, Gerd Petermann wrote:
> Hi Ticker,
> 
> attached is the patch I've created with help of svn.
> It only reverts the changes made to MultiPolygonRelation in r3771.
> 
> I don't know yet why they cause trouble.
> 
> Gerd
> 
> Von: mkgmap-dev  im Auftrag
> von Ticker Berkin 
> Gesendet: Freitag, 17. Februar 2017 10:32:11
> An: mkgmap-dev@lists.mkgmap.org.uk
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> 
> Hi Gerd
> 
> Yes - if that fixes it.
> But
>  in r3771 were there a couple of other changes not to MultiPolygon...
>  haven't a lot more changes been made since to MultiPolygon...
> 
> Ticker
> 
> 
> On Fri, 2017-02-17 at 09:19 +, Gerd Petermann wrote:
> > Hi Ticker,
> > 
> > I think the problems were introduced with the highprec changes in
> > MultiPolygonRelation in r3771.
> > When I revert those the problem is gone. If you don't mind I commit
> > this revert.
> > 
> > Gerd
> > 
> > Von: mkgmap-dev  im Auftrag
> > von Gerd Petermann 
> > Gesendet: Freitag, 17. Februar 2017 10:02:38
> > An: Development list for mkgmap
> > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> > 
> > Hi Ticker,
> > 
> > don't need test data, found out what you meant.
> > 
> > Gerd
> > ________
> > Von: mkgmap-dev  im Auftrag
> > von Gerd Petermann 
> > Gesendet: Freitag, 17. Februar 2017 09:52:56
> > An: Development list for mkgmap
> > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> > 
> > Hi Ticker,
> > 
> > okay, I'll merge the branch into trunk.
> > Please post some test data to show the coastline problem and I'll
> > try
> > to fix it.
> > 
> > Gerd
> > 
> > Von: mkgmap-dev  im Auftrag
> > von Ticker Berkin 
> > Gesendet: Freitag, 17. Februar 2017 09:50:17
> > An: mkgmap-dev@lists.mkgmap.org.uk
> > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> > 
> > Hi Gerd
> > 
> > I fixed this problem with r3807 in the split-shape branch and this
> > should probably be merged into trunk.
> > 
> > Mike was also getting another problem that might be related to
> > generate-sea:extend-sea-sectors
> > 
> > I don't know much about this area, but just having this option and
> > nothing else of significance, it seems as if the overview map has
> > all
> > sea if it has a coastline
> > 
> > Ticker
> > 
> > On Thu, 2017-02-16 at 20:12 +, Gerd Petermann wrote:
> > > Hi Ticker,
> > > 
> > > In case you need test data: I've uploaded a file :
> > > http://files.mkgmap.org.uk/download/334/88009211.osm.pbf
> > > Produces the error with r3811 without any options, just
> > > java -jar mkpgmap.jar 88009211.osm.pbf
> > > Seems to work okay with r3807.
> > > 
> > > Gerd
> > > 
> > > 
> > > Von: mkgmap-dev  im
> > > Auftrag
> > > von Mike Baggaley 
> > > Gesendet: Donnerstag, 16. Februar 2017 10:40:55
> > > An: mkgmap-dev@lists.mkgmap.org.uk
> > > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape
> > > branch
> > > 
> > > HI Ticker, I'll package up some data for you. I have generate
> > > -sea:extend-sea-sectors in my options file, I think it will be
> > > related to that.
> > > 
> > > Regards,
> > > Mike
> > > 
> > > -Original Message-
> > > From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk]
> > > Sent: 16 February 2017 08:17
> > > To: mkgmap-dev@lists.mkgmap.org.uk
> > > Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape
> > > branch
> > > 
> > > Hi Mike
> > > 
> > > I'll fix/improve the message.
> > > 
> > > Can you tell if it is the sea polygons, the line 'coastline', or
> > > the
> > > island area (if your style generates this) that is corrupt.
> > > 
> > > Maybe send your splitter options / areas.list, mkgmap options and
> > > style
> > > and I'll see if I can reproduce.
> > > 
> > > Ticker
> > > 
> &

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-17 Thread Gerd Petermann
Hi Ticker,

attached is the patch I've created with help of svn.
It only reverts the changes made to MultiPolygonRelation in r3771.

I don't know yet why they cause trouble.

Gerd

Von: mkgmap-dev  im Auftrag von Ticker 
Berkin 
Gesendet: Freitag, 17. Februar 2017 10:32:11
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Gerd

Yes - if that fixes it.
But
 in r3771 were there a couple of other changes not to MultiPolygon...
 haven't a lot more changes been made since to MultiPolygon...

Ticker


On Fri, 2017-02-17 at 09:19 +, Gerd Petermann wrote:
> Hi Ticker,
>
> I think the problems were introduced with the highprec changes in
> MultiPolygonRelation in r3771.
> When I revert those the problem is gone. If you don't mind I commit
> this revert.
>
> Gerd
> 
> Von: mkgmap-dev  im Auftrag
> von Gerd Petermann 
> Gesendet: Freitag, 17. Februar 2017 10:02:38
> An: Development list for mkgmap
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
>
> Hi Ticker,
>
> don't need test data, found out what you meant.
>
> Gerd
> 
> Von: mkgmap-dev  im Auftrag
> von Gerd Petermann 
> Gesendet: Freitag, 17. Februar 2017 09:52:56
> An: Development list for mkgmap
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
>
> Hi Ticker,
>
> okay, I'll merge the branch into trunk.
> Please post some test data to show the coastline problem and I'll try
> to fix it.
>
> Gerd
> 
> Von: mkgmap-dev  im Auftrag
> von Ticker Berkin 
> Gesendet: Freitag, 17. Februar 2017 09:50:17
> An: mkgmap-dev@lists.mkgmap.org.uk
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
>
> Hi Gerd
>
> I fixed this problem with r3807 in the split-shape branch and this
> should probably be merged into trunk.
>
> Mike was also getting another problem that might be related to
> generate-sea:extend-sea-sectors
>
> I don't know much about this area, but just having this option and
> nothing else of significance, it seems as if the overview map has all
> sea if it has a coastline
>
> Ticker
>
> On Thu, 2017-02-16 at 20:12 +, Gerd Petermann wrote:
> > Hi Ticker,
> >
> > In case you need test data: I've uploaded a file :
> > http://files.mkgmap.org.uk/download/334/88009211.osm.pbf
> > Produces the error with r3811 without any options, just
> > java -jar mkpgmap.jar 88009211.osm.pbf
> > Seems to work okay with r3807.
> >
> > Gerd
> >
> > 
> > Von: mkgmap-dev  im Auftrag
> > von Mike Baggaley 
> > Gesendet: Donnerstag, 16. Februar 2017 10:40:55
> > An: mkgmap-dev@lists.mkgmap.org.uk
> > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> >
> > HI Ticker, I'll package up some data for you. I have generate
> > -sea:extend-sea-sectors in my options file, I think it will be
> > related to that.
> >
> > Regards,
> > Mike
> >
> > -Original Message-
> > From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk]
> > Sent: 16 February 2017 08:17
> > To: mkgmap-dev@lists.mkgmap.org.uk
> > Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> >
> > Hi Mike
> >
> > I'll fix/improve the message.
> >
> > Can you tell if it is the sea polygons, the line 'coastline', or
> > the
> > island area (if your style generates this) that is corrupt.
> >
> > Maybe send your splitter options / areas.list, mkgmap options and
> > style
> > and I'll see if I can reproduce.
> >
> > Ticker
> >
> > On Thu, 2017-02-16 at 01:23 +, Mike Baggaley wrote:
> > > HI Ticker, I've tried the patch without the --order-by-decreasing
> > > -area option and it does now run without crashing. However, it
> > > suffers from the same problem as I mentioned earlier when trying
> > > -
> > > -order-by-decreasing-area without the patch, in that the
> > > coastline
> > > is
> > > corrupted. I haven't yet turned on detailed logging - I can do
> > > that
> > > if it would help.
> > >
> > > I note that in MapSplitter.java there is a new line:
> > >
> > > log.info("Single item larger that WANTED_MAX_AREA_SIZE",
> > > area.getBounds().getCenter().toOSMURL());
> > >
> > > I think this should say '

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-17 Thread Ticker Berkin
Hi Gerd

Yes - if that fixes it.
But
 in r3771 were there a couple of other changes not to MultiPolygon...
 haven't a lot more changes been made since to MultiPolygon...

Ticker


On Fri, 2017-02-17 at 09:19 +, Gerd Petermann wrote:
> Hi Ticker,
> 
> I think the problems were introduced with the highprec changes in
> MultiPolygonRelation in r3771.
> When I revert those the problem is gone. If you don't mind I commit
> this revert.
> 
> Gerd
> 
> Von: mkgmap-dev  im Auftrag
> von Gerd Petermann 
> Gesendet: Freitag, 17. Februar 2017 10:02:38
> An: Development list for mkgmap
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> 
> Hi Ticker,
> 
> don't need test data, found out what you meant.
> 
> Gerd
> 
> Von: mkgmap-dev  im Auftrag
> von Gerd Petermann 
> Gesendet: Freitag, 17. Februar 2017 09:52:56
> An: Development list for mkgmap
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> 
> Hi Ticker,
> 
> okay, I'll merge the branch into trunk.
> Please post some test data to show the coastline problem and I'll try
> to fix it.
> 
> Gerd
> 
> Von: mkgmap-dev  im Auftrag
> von Ticker Berkin 
> Gesendet: Freitag, 17. Februar 2017 09:50:17
> An: mkgmap-dev@lists.mkgmap.org.uk
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> 
> Hi Gerd
> 
> I fixed this problem with r3807 in the split-shape branch and this
> should probably be merged into trunk.
> 
> Mike was also getting another problem that might be related to
> generate-sea:extend-sea-sectors
> 
> I don't know much about this area, but just having this option and
> nothing else of significance, it seems as if the overview map has all
> sea if it has a coastline
> 
> Ticker
> 
> On Thu, 2017-02-16 at 20:12 +, Gerd Petermann wrote:
> > Hi Ticker,
> > 
> > In case you need test data: I've uploaded a file :
> > http://files.mkgmap.org.uk/download/334/88009211.osm.pbf
> > Produces the error with r3811 without any options, just
> > java -jar mkpgmap.jar 88009211.osm.pbf
> > Seems to work okay with r3807.
> > 
> > Gerd
> > 
> > 
> > Von: mkgmap-dev  im Auftrag
> > von Mike Baggaley 
> > Gesendet: Donnerstag, 16. Februar 2017 10:40:55
> > An: mkgmap-dev@lists.mkgmap.org.uk
> > Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> > 
> > HI Ticker, I'll package up some data for you. I have generate
> > -sea:extend-sea-sectors in my options file, I think it will be
> > related to that.
> > 
> > Regards,
> > Mike
> > 
> > -Original Message-
> > From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk]
> > Sent: 16 February 2017 08:17
> > To: mkgmap-dev@lists.mkgmap.org.uk
> > Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> > 
> > Hi Mike
> > 
> > I'll fix/improve the message.
> > 
> > Can you tell if it is the sea polygons, the line 'coastline', or
> > the
> > island area (if your style generates this) that is corrupt.
> > 
> > Maybe send your splitter options / areas.list, mkgmap options and
> > style
> > and I'll see if I can reproduce.
> > 
> > Ticker
> > 
> > On Thu, 2017-02-16 at 01:23 +, Mike Baggaley wrote:
> > > HI Ticker, I've tried the patch without the --order-by-decreasing
> > > -area option and it does now run without crashing. However, it
> > > suffers from the same problem as I mentioned earlier when trying 
> > > -
> > > -order-by-decreasing-area without the patch, in that the
> > > coastline
> > > is
> > > corrupted. I haven't yet turned on detailed logging - I can do
> > > that
> > > if it would help.
> > > 
> > > I note that in MapSplitter.java there is a new line:
> > > 
> > > log.info("Single item larger that WANTED_MAX_AREA_SIZE",
> > > area.getBounds().getCenter().toOSMURL());
> > > 
> > > I think this should say 'than' rather than 'that' and probably
> > > WANTED_MAX_AREA_SIZE should be outside the string so we see an
> > > actual
> > > number.
> > > 
> > > Regards,
> > > Mike
> > 
> > 
> > 
> > ___
> > mkgmap-dev mailing list
> > mkgmap-dev@lists.mkgmap.org.uk
&g

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-17 Thread Gerd Petermann
Hi Ticker,

I think the problems were introduced with the highprec changes in 
MultiPolygonRelation in r3771.
When I revert those the problem is gone. If you don't mind I commit this revert.

Gerd

Von: mkgmap-dev  im Auftrag von Gerd 
Petermann 
Gesendet: Freitag, 17. Februar 2017 10:02:38
An: Development list for mkgmap
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Ticker,

don't need test data, found out what you meant.

Gerd

Von: mkgmap-dev  im Auftrag von Gerd 
Petermann 
Gesendet: Freitag, 17. Februar 2017 09:52:56
An: Development list for mkgmap
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Ticker,

okay, I'll merge the branch into trunk.
Please post some test data to show the coastline problem and I'll try to fix it.

Gerd

Von: mkgmap-dev  im Auftrag von Ticker 
Berkin 
Gesendet: Freitag, 17. Februar 2017 09:50:17
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Gerd

I fixed this problem with r3807 in the split-shape branch and this
should probably be merged into trunk.

Mike was also getting another problem that might be related to
generate-sea:extend-sea-sectors

I don't know much about this area, but just having this option and
nothing else of significance, it seems as if the overview map has all
sea if it has a coastline

Ticker

On Thu, 2017-02-16 at 20:12 +, Gerd Petermann wrote:
> Hi Ticker,
>
> In case you need test data: I've uploaded a file :
> http://files.mkgmap.org.uk/download/334/88009211.osm.pbf
> Produces the error with r3811 without any options, just
> java -jar mkpgmap.jar 88009211.osm.pbf
> Seems to work okay with r3807.
>
> Gerd
>
> 
> Von: mkgmap-dev  im Auftrag
> von Mike Baggaley 
> Gesendet: Donnerstag, 16. Februar 2017 10:40:55
> An: mkgmap-dev@lists.mkgmap.org.uk
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
>
> HI Ticker, I'll package up some data for you. I have generate
> -sea:extend-sea-sectors in my options file, I think it will be
> related to that.
>
> Regards,
> Mike
>
> -Original Message-
> From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk]
> Sent: 16 February 2017 08:17
> To: mkgmap-dev@lists.mkgmap.org.uk
> Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
>
> Hi Mike
>
> I'll fix/improve the message.
>
> Can you tell if it is the sea polygons, the line 'coastline', or the
> island area (if your style generates this) that is corrupt.
>
> Maybe send your splitter options / areas.list, mkgmap options and
> style
> and I'll see if I can reproduce.
>
> Ticker
>
> On Thu, 2017-02-16 at 01:23 +, Mike Baggaley wrote:
> > HI Ticker, I've tried the patch without the --order-by-decreasing
> > -area option and it does now run without crashing. However, it
> > suffers from the same problem as I mentioned earlier when trying -
> > -order-by-decreasing-area without the patch, in that the coastline
> > is
> > corrupted. I haven't yet turned on detailed logging - I can do that
> > if it would help.
> >
> > I note that in MapSplitter.java there is a new line:
> >
> > log.info("Single item larger that WANTED_MAX_AREA_SIZE",
> > area.getBounds().getCenter().toOSMURL());
> >
> > I think this should say 'than' rather than 'that' and probably
> > WANTED_MAX_AREA_SIZE should be outside the string so we see an
> > actual
> > number.
> >
> > Regards,
> > Mike
>
>
>
> ___
> mkgmap-dev mailing list
> mkgmap-dev@lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
> ___
> mkgmap-dev mailing list
> mkgmap-dev@lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-17 Thread Gerd Petermann
Hi Ticker,

don't need test data, found out what you meant.

Gerd

Von: mkgmap-dev  im Auftrag von Gerd 
Petermann 
Gesendet: Freitag, 17. Februar 2017 09:52:56
An: Development list for mkgmap
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Ticker,

okay, I'll merge the branch into trunk.
Please post some test data to show the coastline problem and I'll try to fix it.

Gerd

Von: mkgmap-dev  im Auftrag von Ticker 
Berkin 
Gesendet: Freitag, 17. Februar 2017 09:50:17
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Gerd

I fixed this problem with r3807 in the split-shape branch and this
should probably be merged into trunk.

Mike was also getting another problem that might be related to
generate-sea:extend-sea-sectors

I don't know much about this area, but just having this option and
nothing else of significance, it seems as if the overview map has all
sea if it has a coastline

Ticker

On Thu, 2017-02-16 at 20:12 +, Gerd Petermann wrote:
> Hi Ticker,
>
> In case you need test data: I've uploaded a file :
> http://files.mkgmap.org.uk/download/334/88009211.osm.pbf
> Produces the error with r3811 without any options, just
> java -jar mkpgmap.jar 88009211.osm.pbf
> Seems to work okay with r3807.
>
> Gerd
>
> 
> Von: mkgmap-dev  im Auftrag
> von Mike Baggaley 
> Gesendet: Donnerstag, 16. Februar 2017 10:40:55
> An: mkgmap-dev@lists.mkgmap.org.uk
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
>
> HI Ticker, I'll package up some data for you. I have generate
> -sea:extend-sea-sectors in my options file, I think it will be
> related to that.
>
> Regards,
> Mike
>
> -Original Message-
> From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk]
> Sent: 16 February 2017 08:17
> To: mkgmap-dev@lists.mkgmap.org.uk
> Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
>
> Hi Mike
>
> I'll fix/improve the message.
>
> Can you tell if it is the sea polygons, the line 'coastline', or the
> island area (if your style generates this) that is corrupt.
>
> Maybe send your splitter options / areas.list, mkgmap options and
> style
> and I'll see if I can reproduce.
>
> Ticker
>
> On Thu, 2017-02-16 at 01:23 +, Mike Baggaley wrote:
> > HI Ticker, I've tried the patch without the --order-by-decreasing
> > -area option and it does now run without crashing. However, it
> > suffers from the same problem as I mentioned earlier when trying -
> > -order-by-decreasing-area without the patch, in that the coastline
> > is
> > corrupted. I haven't yet turned on detailed logging - I can do that
> > if it would help.
> >
> > I note that in MapSplitter.java there is a new line:
> >
> > log.info("Single item larger that WANTED_MAX_AREA_SIZE",
> > area.getBounds().getCenter().toOSMURL());
> >
> > I think this should say 'than' rather than 'that' and probably
> > WANTED_MAX_AREA_SIZE should be outside the string so we see an
> > actual
> > number.
> >
> > Regards,
> > Mike
>
>
>
> ___
> mkgmap-dev mailing list
> mkgmap-dev@lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
> ___
> mkgmap-dev mailing list
> mkgmap-dev@lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-17 Thread Gerd Petermann
Hi Ticker,

okay, I'll merge the branch into trunk.
Please post some test data to show the coastline problem and I'll try to fix it.

Gerd

Von: mkgmap-dev  im Auftrag von Ticker 
Berkin 
Gesendet: Freitag, 17. Februar 2017 09:50:17
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Gerd

I fixed this problem with r3807 in the split-shape branch and this
should probably be merged into trunk.

Mike was also getting another problem that might be related to
generate-sea:extend-sea-sectors

I don't know much about this area, but just having this option and
nothing else of significance, it seems as if the overview map has all
sea if it has a coastline

Ticker

On Thu, 2017-02-16 at 20:12 +, Gerd Petermann wrote:
> Hi Ticker,
>
> In case you need test data: I've uploaded a file :
> http://files.mkgmap.org.uk/download/334/88009211.osm.pbf
> Produces the error with r3811 without any options, just
> java -jar mkpgmap.jar 88009211.osm.pbf
> Seems to work okay with r3807.
>
> Gerd
>
> 
> Von: mkgmap-dev  im Auftrag
> von Mike Baggaley 
> Gesendet: Donnerstag, 16. Februar 2017 10:40:55
> An: mkgmap-dev@lists.mkgmap.org.uk
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
>
> HI Ticker, I'll package up some data for you. I have generate
> -sea:extend-sea-sectors in my options file, I think it will be
> related to that.
>
> Regards,
> Mike
>
> -Original Message-
> From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk]
> Sent: 16 February 2017 08:17
> To: mkgmap-dev@lists.mkgmap.org.uk
> Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
>
> Hi Mike
>
> I'll fix/improve the message.
>
> Can you tell if it is the sea polygons, the line 'coastline', or the
> island area (if your style generates this) that is corrupt.
>
> Maybe send your splitter options / areas.list, mkgmap options and
> style
> and I'll see if I can reproduce.
>
> Ticker
>
> On Thu, 2017-02-16 at 01:23 +, Mike Baggaley wrote:
> > HI Ticker, I've tried the patch without the --order-by-decreasing
> > -area option and it does now run without crashing. However, it
> > suffers from the same problem as I mentioned earlier when trying -
> > -order-by-decreasing-area without the patch, in that the coastline
> > is
> > corrupted. I haven't yet turned on detailed logging - I can do that
> > if it would help.
> >
> > I note that in MapSplitter.java there is a new line:
> >
> > log.info("Single item larger that WANTED_MAX_AREA_SIZE",
> > area.getBounds().getCenter().toOSMURL());
> >
> > I think this should say 'than' rather than 'that' and probably
> > WANTED_MAX_AREA_SIZE should be outside the string so we see an
> > actual
> > number.
> >
> > Regards,
> > Mike
>
>
>
> ___
> mkgmap-dev mailing list
> mkgmap-dev@lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
> ___
> mkgmap-dev mailing list
> mkgmap-dev@lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-17 Thread Ticker Berkin
Hi Gerd

I fixed this problem with r3807 in the split-shape branch and this
should probably be merged into trunk.

Mike was also getting another problem that might be related to
generate-sea:extend-sea-sectors

I don't know much about this area, but just having this option and
nothing else of significance, it seems as if the overview map has all
sea if it has a coastline

Ticker

On Thu, 2017-02-16 at 20:12 +, Gerd Petermann wrote:
> Hi Ticker,
> 
> In case you need test data: I've uploaded a file :
> http://files.mkgmap.org.uk/download/334/88009211.osm.pbf
> Produces the error with r3811 without any options, just
> java -jar mkpgmap.jar 88009211.osm.pbf
> Seems to work okay with r3807.
> 
> Gerd
> 
> 
> Von: mkgmap-dev  im Auftrag
> von Mike Baggaley 
> Gesendet: Donnerstag, 16. Februar 2017 10:40:55
> An: mkgmap-dev@lists.mkgmap.org.uk
> Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> 
> HI Ticker, I'll package up some data for you. I have generate
> -sea:extend-sea-sectors in my options file, I think it will be
> related to that.
> 
> Regards,
> Mike
> 
> -Original Message-
> From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk]
> Sent: 16 February 2017 08:17
> To: mkgmap-dev@lists.mkgmap.org.uk
> Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> 
> Hi Mike
> 
> I'll fix/improve the message.
> 
> Can you tell if it is the sea polygons, the line 'coastline', or the
> island area (if your style generates this) that is corrupt.
> 
> Maybe send your splitter options / areas.list, mkgmap options and
> style
> and I'll see if I can reproduce.
> 
> Ticker
> 
> On Thu, 2017-02-16 at 01:23 +, Mike Baggaley wrote:
> > HI Ticker, I've tried the patch without the --order-by-decreasing
> > -area option and it does now run without crashing. However, it
> > suffers from the same problem as I mentioned earlier when trying -
> > -order-by-decreasing-area without the patch, in that the coastline
> > is
> > corrupted. I haven't yet turned on detailed logging - I can do that
> > if it would help.
> > 
> > I note that in MapSplitter.java there is a new line:
> > 
> > log.info("Single item larger that WANTED_MAX_AREA_SIZE",
> > area.getBounds().getCenter().toOSMURL());
> > 
> > I think this should say 'than' rather than 'that' and probably
> > WANTED_MAX_AREA_SIZE should be outside the string so we see an
> > actual
> > number.
> > 
> > Regards,
> > Mike
> 
> 
> 
> ___
> mkgmap-dev mailing list
> mkgmap-dev@lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
> ___
> mkgmap-dev mailing list
> mkgmap-dev@lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-16 Thread Gerd Petermann
Hi Ticker,

In case you need test data: I've uploaded a file :
http://files.mkgmap.org.uk/download/334/88009211.osm.pbf
Produces the error with r3811 without any options, just
java -jar mkpgmap.jar 88009211.osm.pbf
Seems to work okay with r3807.

Gerd


Von: mkgmap-dev  im Auftrag von Mike 
Baggaley 
Gesendet: Donnerstag, 16. Februar 2017 10:40:55
An: mkgmap-dev@lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

HI Ticker, I'll package up some data for you. I have 
generate-sea:extend-sea-sectors in my options file, I think it will be related 
to that.

Regards,
Mike

-Original Message-
From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk]
Sent: 16 February 2017 08:17
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Mike

I'll fix/improve the message.

Can you tell if it is the sea polygons, the line 'coastline', or the
island area (if your style generates this) that is corrupt.

Maybe send your splitter options / areas.list, mkgmap options and style
and I'll see if I can reproduce.

Ticker

On Thu, 2017-02-16 at 01:23 +, Mike Baggaley wrote:
> HI Ticker, I've tried the patch without the --order-by-decreasing
> -area option and it does now run without crashing. However, it
> suffers from the same problem as I mentioned earlier when trying -
> -order-by-decreasing-area without the patch, in that the coastline is
> corrupted. I haven't yet turned on detailed logging - I can do that
> if it would help.
>
> I note that in MapSplitter.java there is a new line:
>
> log.info("Single item larger that WANTED_MAX_AREA_SIZE",
> area.getBounds().getCenter().toOSMURL());
>
> I think this should say 'than' rather than 'that' and probably
> WANTED_MAX_AREA_SIZE should be outside the string so we see an actual
> number.
>
> Regards,
> Mike



___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-16 Thread Mike Baggaley
HI Ticker, I'll package up some data for you. I have 
generate-sea:extend-sea-sectors in my options file, I think it will be related 
to that.

Regards,
Mike

-Original Message-
From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk] 
Sent: 16 February 2017 08:17
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Mike

I'll fix/improve the message.

Can you tell if it is the sea polygons, the line 'coastline', or the
island area (if your style generates this) that is corrupt.

Maybe send your splitter options / areas.list, mkgmap options and style
and I'll see if I can reproduce.

Ticker

On Thu, 2017-02-16 at 01:23 +, Mike Baggaley wrote:
> HI Ticker, I've tried the patch without the --order-by-decreasing
> -area option and it does now run without crashing. However, it
> suffers from the same problem as I mentioned earlier when trying -
> -order-by-decreasing-area without the patch, in that the coastline is
> corrupted. I haven't yet turned on detailed logging - I can do that
> if it would help.
> 
> I note that in MapSplitter.java there is a new line:
> 
> log.info("Single item larger that WANTED_MAX_AREA_SIZE",
> area.getBounds().getCenter().toOSMURL());
> 
> I think this should say 'than' rather than 'that' and probably
> WANTED_MAX_AREA_SIZE should be outside the string so we see an actual
> number.
> 
> Regards,
> Mike



___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-16 Thread Ticker Berkin
Hi Mike

I'll fix/improve the message.

Can you tell if it is the sea polygons, the line 'coastline', or the
island area (if your style generates this) that is corrupt.

Maybe send your splitter options / areas.list, mkgmap options and style
and I'll see if I can reproduce.

Ticker

On Thu, 2017-02-16 at 01:23 +, Mike Baggaley wrote:
> HI Ticker, I've tried the patch without the --order-by-decreasing
> -area option and it does now run without crashing. However, it
> suffers from the same problem as I mentioned earlier when trying -
> -order-by-decreasing-area without the patch, in that the coastline is
> corrupted. I haven't yet turned on detailed logging - I can do that
> if it would help.
> 
> I note that in MapSplitter.java there is a new line:
> 
> log.info("Single item larger that WANTED_MAX_AREA_SIZE",
> area.getBounds().getCenter().toOSMURL());
> 
> I think this should say 'than' rather than 'that' and probably
> WANTED_MAX_AREA_SIZE should be outside the string so we see an actual
> number.
> 
> Regards,
> Mike

___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-15 Thread Mike Baggaley
HI Ticker, I've tried the patch without the --order-by-decreasing-area option 
and it does now run without crashing. However, it suffers from the same problem 
as I mentioned earlier when trying --order-by-decreasing-area without the 
patch, in that the coastline is corrupted. I haven't yet turned on detailed 
logging - I can do that if it would help.

I note that in MapSplitter.java there is a new line:

log.info("Single item larger that WANTED_MAX_AREA_SIZE", 
area.getBounds().getCenter().toOSMURL());

I think this should say 'than' rather than 'that' and probably 
WANTED_MAX_AREA_SIZE should be outside the string so we see an actual number.

Regards,
Mike

-Original Message-
From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk] 
Sent: 15 February 2017 16:14
To: mkgmap-dev@lists.mkgmap.org.uk
Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

Hi Gerd / Mike

I've just committed a fix for this to the split-shape branch

Ticker

On Wed, 2017-02-15 at 08:53 +, Ticker Berkin wrote:
> Hi Mike
> 
> OK - I think I understand the problem.
> 
> Can you try with --order-by-decreasing-area and let me know if that
> stops the unbound recursion, and, in the meantime, I'll work on it.
> 
> Thanks
> Ticker
> 
> 
> On Wed, 2017-02-15 at 00:48 +, Mike Baggaley wrote:
> > HI Ticker, having run this under the debugger now, it appears that
> > it
> > is not the postcode data after all - I was getting confused between
> > the too small to split messages and too many POIs messages. I was
> > previously getting too small to split messages in splitter, but not
> > in mkgmap.
> > 
> > I temporarily changed the code to:
> > 
> > } else if (mustSplit) { // can't reduce
> > size, so force more subdivisions
> > if (depth < 1000) {
> > log.debug("splitting
> > area by contents", area);
> > MapArea[] sublist =
> > area.split(1, 1, bounds, true);
> > addAreasToList(sublist,
> > alist, depth + 1);
> > continue;
> > } else {
> > log.error("Area too
> > small to split at " + area.getBounds().getCenter().toOSMURL() + "
> > (reduce the density of points, length of lines, etc.)");
> > 
> > }
> > }
> > 
> > This ran successfully and gave a single error:
> >  Area too small to split at 
> > http://www.openstreetmap.org/?mlat=51.797190&mlon=0.918646&zoom=17 
> > (r
> > educe the density of points, length of lines, etc.
> > 
> > Stopping in the debugger, I can see that sizes[MapArea.SHAPE_KIND]
> > is
> > 68076 and from the coordinate it is processing the coastline. The
> > call stack has the same value for the sizes[MapArea.SHAPE_KIND] in
> > every instance of addAreasToList, so it looks like the call to
> > area.split is not actually splitting. Looking at the resulting file
> > in BaseCamp, I can see that the coastline is corrupt.
> > 
> > Hope that helps,
> > Mike
> > 
> > -Original Message-
> > From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk] 
> > Sent: 14 February 2017 23:21
> > To: Mike Baggaley 
> > Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> > 
> > Hi Mike
> > 
> > I have the raw postcode data (codePointOpen.zip) which I processes
> > just
> > to take the first few at the same point but I can change it do all
> > of
> > them individually. Do you feed it with a map through the splitter
> > or
> > just make a postcode only overlay? What is the bit of style you use
> > to
> > represent each postcode? I can probably knock up something similar.
> > 
> > The code should cope - I can't see anything obviously wrong so need
> > to
> > try and reproduce the problem
> > 
> > Ticker 
> > 
> > On Tue, 2017-02-14 at 18:17 +, Mike Baggaley wrote:
> > > Hi Ticker the data is postcode centres (points). As well as
> > > geographic postcodes, the Royal Mail postcode data includes a
> > > number
> > > of postcodes that are centred on sorting offices (presumably for
> > > box
> > > numbers). There are quite a few at large sorting offices, but if
> > > each
> &g

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-15 Thread Ticker Berkin
Hi Mike

I think this is just a problem with the rules the tool you are using to
show the image conflicting with what --order-by-decreasing-area aims to
achieve on a Garmin device.

For instance, observations of GPSMapEdit shows it renders smaller
polygons on top of larger ones as the way of deciding what is shown.
--order-by-decreasing-area has split polygons geographical and so this
size-based rule becomes meaningless and can result in what you are
seeing.

Given it didn't crash, I hope I've understood what your original
problem was and fixed it in split-shape branch.

Regards
Ticker

On Wed, 2017-02-15 at 17:12 +, Mike Baggaley wrote:
> Hi Ticker, that stops the unbound recursion, however the map it
> produces is faulty. The only areas that show up as land are complete
> rectangles within the mainland (see attachment). Even small islets do
> not have any land area. Of course this may be a different problem.
> 
> Regards,
> Mike

___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-15 Thread Ticker Berkin
Hi Gerd / Mike

I've just committed a fix for this to the split-shape branch

Ticker

On Wed, 2017-02-15 at 08:53 +, Ticker Berkin wrote:
> Hi Mike
> 
> OK - I think I understand the problem.
> 
> Can you try with --order-by-decreasing-area and let me know if that
> stops the unbound recursion, and, in the meantime, I'll work on it.
> 
> Thanks
> Ticker
> 
> 
> On Wed, 2017-02-15 at 00:48 +, Mike Baggaley wrote:
> > HI Ticker, having run this under the debugger now, it appears that
> > it
> > is not the postcode data after all - I was getting confused between
> > the too small to split messages and too many POIs messages. I was
> > previously getting too small to split messages in splitter, but not
> > in mkgmap.
> > 
> > I temporarily changed the code to:
> > 
> > } else if (mustSplit) { // can't reduce
> > size, so force more subdivisions
> > if (depth < 1000) {
> > log.debug("splitting
> > area by contents", area);
> > MapArea[] sublist =
> > area.split(1, 1, bounds, true);
> > addAreasToList(sublist,
> > alist, depth + 1);
> > continue;
> > } else {
> > log.error("Area too
> > small to split at " + area.getBounds().getCenter().toOSMURL() + "
> > (reduce the density of points, length of lines, etc.)");
> > 
> > }
> > }
> > 
> > This ran successfully and gave a single error:
> >  Area too small to split at 
> > http://www.openstreetmap.org/?mlat=51.797190&mlon=0.918646&zoom=17 
> > (r
> > educe the density of points, length of lines, etc.
> > 
> > Stopping in the debugger, I can see that sizes[MapArea.SHAPE_KIND]
> > is
> > 68076 and from the coordinate it is processing the coastline. The
> > call stack has the same value for the sizes[MapArea.SHAPE_KIND] in
> > every instance of addAreasToList, so it looks like the call to
> > area.split is not actually splitting. Looking at the resulting file
> > in BaseCamp, I can see that the coastline is corrupt.
> > 
> > Hope that helps,
> > Mike
> > 
> > -Original Message-
> > From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk] 
> > Sent: 14 February 2017 23:21
> > To: Mike Baggaley 
> > Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> > 
> > Hi Mike
> > 
> > I have the raw postcode data (codePointOpen.zip) which I processes
> > just
> > to take the first few at the same point but I can change it do all
> > of
> > them individually. Do you feed it with a map through the splitter
> > or
> > just make a postcode only overlay? What is the bit of style you use
> > to
> > represent each postcode? I can probably knock up something similar.
> > 
> > The code should cope - I can't see anything obviously wrong so need
> > to
> > try and reproduce the problem
> > 
> > Ticker 
> > 
> > On Tue, 2017-02-14 at 18:17 +, Mike Baggaley wrote:
> > > Hi Ticker the data is postcode centres (points). As well as
> > > geographic postcodes, the Royal Mail postcode data includes a
> > > number
> > > of postcodes that are centred on sorting offices (presumably for
> > > box
> > > numbers). There are quite a few at large sorting offices, but if
> > > each
> > > split should be able to accept 255 points, and it is exceeding
> > > 2000
> > > splits before crashing, it looks like the splitting is not
> > > working 
> > > -
> > > there won't be more than 2000 * 255 postcodes at the same place.
> > > My
> > > OSM file is rather large. I can see whether I can extract a map
> > > centred on a sorting office.
> > > 
> > > Regards,
> > > Mike
> > > 
> > > -Original Message-
> > > From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk] 
> > > Sent: 14 February 2017 17:52
> > > To: mkgmap-dev@lists.mkgmap.org.uk
> > > Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape
> > > branch
> > > 
> > > Hi Mike
> > > 
> > > This is an 

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-15 Thread Ticker Berkin
Hi Mike

OK - I think I understand the problem.

Can you try with --order-by-decreasing-area and let me know if that
stops the unbound recursion, and, in the meantime, I'll work on it.

Thanks
Ticker


On Wed, 2017-02-15 at 00:48 +, Mike Baggaley wrote:
> HI Ticker, having run this under the debugger now, it appears that it
> is not the postcode data after all - I was getting confused between
> the too small to split messages and too many POIs messages. I was
> previously getting too small to split messages in splitter, but not
> in mkgmap.
> 
> I temporarily changed the code to:
> 
>   } else if (mustSplit) { // can't reduce
> size, so force more subdivisions
>   if (depth < 1000) {
>   log.debug("splitting
> area by contents", area);
>   MapArea[] sublist =
> area.split(1, 1, bounds, true);
>   addAreasToList(sublist,
> alist, depth + 1);
>   continue;
>   } else {
>   log.error("Area too
> small to split at " + area.getBounds().getCenter().toOSMURL() + "
> (reduce the density of points, length of lines, etc.)");  
>   
>   }
>   }
> 
> This ran successfully and gave a single error:
>  Area too small to split at 
> http://www.openstreetmap.org/?mlat=51.797190&mlon=0.918646&zoom=17 (r
> educe the density of points, length of lines, etc.
> 
> Stopping in the debugger, I can see that sizes[MapArea.SHAPE_KIND] is
> 68076 and from the coordinate it is processing the coastline. The
> call stack has the same value for the sizes[MapArea.SHAPE_KIND] in
> every instance of addAreasToList, so it looks like the call to
> area.split is not actually splitting. Looking at the resulting file
> in BaseCamp, I can see that the coastline is corrupt.
> 
> Hope that helps,
> Mike
> 
> -----Original Message-
> From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk] 
> Sent: 14 February 2017 23:21
> To: Mike Baggaley 
> Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> 
> Hi Mike
> 
> I have the raw postcode data (codePointOpen.zip) which I processes
> just
> to take the first few at the same point but I can change it do all of
> them individually. Do you feed it with a map through the splitter or
> just make a postcode only overlay? What is the bit of style you use
> to
> represent each postcode? I can probably knock up something similar.
> 
> The code should cope - I can't see anything obviously wrong so need
> to
> try and reproduce the problem
> 
> Ticker 
> 
> On Tue, 2017-02-14 at 18:17 +, Mike Baggaley wrote:
> > Hi Ticker the data is postcode centres (points). As well as
> > geographic postcodes, the Royal Mail postcode data includes a
> > number
> > of postcodes that are centred on sorting offices (presumably for
> > box
> > numbers). There are quite a few at large sorting offices, but if
> > each
> > split should be able to accept 255 points, and it is exceeding 2000
> > splits before crashing, it looks like the splitting is not working 
> > -
> > there won't be more than 2000 * 255 postcodes at the same place. My
> > OSM file is rather large. I can see whether I can extract a map
> > centred on a sorting office.
> > 
> > Regards,
> > Mike
> > 
> > -Original Message-
> > From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk] 
> > Sent: 14 February 2017 17:52
> > To: mkgmap-dev@lists.mkgmap.org.uk
> > Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> > 
> > Hi Mike
> > 
> > This is an area of code I've changed and it should be able to cope
> > with
> > many items at the same location without recursing.
> > 
> > Do you have some sample data? what are the items (point/line/shape
> > extended?)
> > 
> > Ticker
> > 
> > On Tue, 2017-02-14 at 17:40 +, Mike Baggaley wrote:
> > > Hi Gerd, since this change I am getting a
> > > java.lang.StackOverflowError crash
> > > caused by the code recursively attempting to split something
> > > which
> > > is
> > > unsplittable (assuming the split is based on location), as I have
> > > a
> > > large
> > > number of points at exactly the same location (from external data
&g

Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-14 Thread Ticker Berkin
Hi Mike

I have the raw postcode data (codePointOpen.zip) which I processes just
to take the first few at the same point but I can change it do all of
them individually. Do you feed it with a map through the splitter or
just make a postcode only overlay? What is the bit of style you use to
represent each postcode? I can probably knock up something similar.

The code should cope - I can't see anything obviously wrong so need to
try and reproduce the problem

Ticker 

On Tue, 2017-02-14 at 18:17 +, Mike Baggaley wrote:
> Hi Ticker the data is postcode centres (points). As well as
> geographic postcodes, the Royal Mail postcode data includes a number
> of postcodes that are centred on sorting offices (presumably for box
> numbers). There are quite a few at large sorting offices, but if each
> split should be able to accept 255 points, and it is exceeding 2000
> splits before crashing, it looks like the splitting is not working -
> there won't be more than 2000 * 255 postcodes at the same place. My
> OSM file is rather large. I can see whether I can extract a map
> centred on a sorting office.
> 
> Regards,
> Mike
> 
> -Original Message-
> From: Ticker Berkin [mailto:rwb-mkg...@jagit.co.uk] 
> Sent: 14 February 2017 17:52
> To: mkgmap-dev@lists.mkgmap.org.uk
> Subject: Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch
> 
> Hi Mike
> 
> This is an area of code I've changed and it should be able to cope
> with
> many items at the same location without recursing.
> 
> Do you have some sample data? what are the items (point/line/shape
> extended?)
> 
> Ticker
> 
> On Tue, 2017-02-14 at 17:40 +, Mike Baggaley wrote:
> > Hi Gerd, since this change I am getting a
> > java.lang.StackOverflowError crash
> > caused by the code recursively attempting to split something which
> > is
> > unsplittable (assuming the split is based on location), as I have a
> > large
> > number of points at exactly the same location (from external data I
> > add to
> > the OSM data).
> > 
> > The offending line is at
> > uk.me.parabola.mkgmap.build.MapSplitter.addAreasToList(MapSplitter.
> > ja
> > va:187)
> > . It is failing on my system with a depth of 2342. I suggest there
> > needs to
> > be a maximum depth after which it should give up trying to split.
> > 
> > } else if (mustSplit) { // can't reduce
> > size, so force more subdivisions
> > log.debug("splitting area by
> > contents", area);
> > MapArea[] sublist =
> > area.split(1, 1,
> > bounds, true);
> > addAreasToList(sublist, alist,
> > depth
> > + 1);
> > continue;
> > }
> > 
> > I am unsure whether you would want a fixed depth limit, would want
> > it
> > to be
> > set by parameter, would prefer to catch the error or think it would
> > be
> > possible to see whether the proposed area split has made any
> > improvement,
> > and give up if it hasn't.
> > 
> > Regards,
> > Mike
> > 
> > 
> > ___
> > mkgmap-dev mailing list
> > mkgmap-dev@lists.mkgmap.org.uk
> > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
> 
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev


Re: [mkgmap-dev] RE Commit r3801: merge split-shape branch

2017-02-14 Thread Ticker Berkin
Hi Mike

This is an area of code I've changed and it should be able to cope with
many items at the same location without recursing.

Do you have some sample data? what are the items (point/line/shape
extended?)

Ticker

On Tue, 2017-02-14 at 17:40 +, Mike Baggaley wrote:
> Hi Gerd, since this change I am getting a
> java.lang.StackOverflowError crash
> caused by the code recursively attempting to split something which is
> unsplittable (assuming the split is based on location), as I have a
> large
> number of points at exactly the same location (from external data I
> add to
> the OSM data).
> 
> The offending line is at
> uk.me.parabola.mkgmap.build.MapSplitter.addAreasToList(MapSplitter.ja
> va:187)
> . It is failing on my system with a depth of 2342. I suggest there
> needs to
> be a maximum depth after which it should give up trying to split.
> 
>   } else if (mustSplit) { // can't reduce
> size, so force more subdivisions
>   log.debug("splitting area by
> contents", area);
>   MapArea[] sublist =
> area.split(1, 1,
> bounds, true);
>   addAreasToList(sublist, alist,
> depth
> + 1);
>   continue;
>   }
> 
> I am unsure whether you would want a fixed depth limit, would want it
> to be
> set by parameter, would prefer to catch the error or think it would
> be
> possible to see whether the proposed area split has made any
> improvement,
> and give up if it hasn't.
> 
> Regards,
> Mike
> 
> 
> ___
> mkgmap-dev mailing list
> mkgmap-dev@lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
___
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev