Re: [talk-au] Australia "changing coordinates"

2016-08-02 Thread Warin

On 8/2/2016 3:37 PM, Andrew Davidson wrote:

WGS84 is a datum fixed; as in dated 1984 and the data does not change.


I'm not sure that you've understood exactly what a semi-dynamic datum 
is. Have a read of this:


http://ceur-ws.org/Vol-1142/paper6.pdf

particularly sections 3.4 and 3.5.


I'm reading
http://earth-info.nga.mil/GandG/publications/tr8350.2/wgs84fin.pdf
The document is dated in 1996 so more recent things are not in it. But I 
think the principles would hold.


It lists;
WGS 84  1 Jan 87 - 1 Jan 94
WGS 84 (G730) 2 Jan 94 - 28 Sept 96
WGS 84 (G873)  From 29 Sept 96

You will observe the refinements of WGS 84 (to reduce 
error/uncertainty). I would expect that suffix would be used in 
professional circles.
The (G) simply gives a refinement to WGS84, does not change the 
basis, and the refinements are getting smaller.

This document also introduces the concept of  'uncertainties', a good move.

Page 16 of 175 states in part
"As of 2 Jan 94, a set of geodetic coordinates shall include a 
designation of the reference frame and epoch of the observations"


Note that this is for any datum. I expect this date requirement will 
become more common and a requirement with earth centric datums.


"In summary, the refinements which have been made to WGS 84 have reduced 
the uncertainty in the coordinates of the reference frame, the 
uncertainty of the gravitational model and the uncertainty of the geoid 
undulations.They have not changed WGS 84. "


http://ceur-ws.org/Vol-1142/paper6.pdf
 In section 3.5 the error is introduced in making the first transform 
from GDA94 to WGS84. Not clear if this transform was made at all, or if 
made was not to the correct date.
The error could have been avoided by the correct transform in the first 
datum conversion?






Or you have access to survey points/marks and their data  in the local
area.


LOL. Reminds me of this quote:


"You'll never find a survey mark on the ground with coordinates 
referenced to WGS-84. If you do, it's wrong."


A global datum will have more compromises than a local datum. For that 
reason alone I would expect survey marks to be in the local datum..
e.g. NSW survey marks are GDA94 using MGA 
http://spatialservices.finance.nsw.gov.au/surveying/scims_online
I also expect these will be translated to the new earth centric datum as 
a mathematical operation some time in 2017.
I would expect that any local datum can be transformed into WGS84 with a 
sufficient level of accuracy for the task, if required (i.e. if the end 
equipment requires WGS84, or its refinements)



___
Talk-au mailing list
Talk-au@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-au


Re: [talk-au] Australia "changing coordinates"

2016-08-02 Thread Andrew Harvey
I found this explanation helpful
http://www.geoproject.com.au/gda.faq.html#q16

On Tue, 2 Aug 2016, at 01:57 PM, Andrew Davidson wrote:
> What to do about it? Unfortunately the changeover to GDA2020 is not 
> going to happen overnight, the plan is for a three year transition 
> starting in 2017. If it did happen overnight then we could just shift 
> all of the nodes in Australia to their new positions can keep on 
> mapping. What's actually going to happen is that the various different 
> organizations are going to switch at different times and the situation 
> for aerial imagery mosaics will be interesting if they aren't 
> retrospectively re-projected (you'll have some places on GDA2020 and 
> others still on GD94). So I'm guessing the approach of wait and see 
> might be the one to take. Obviously if organizations start releasing 
> data in GDA2020 and people start importing it into OSM we're going to 
> have to make the call: move everything to GDA2020 or convert imports 
> back to GDA94? It's only going to be a real issue once we get access to 
> aerial imagery that's in GDA2020 or people get general access to GPS 
> with decimetre accuracy.

If you have suggestions on better ways to handle this within OSM, please
add them as a suggestion for the 0.7 API at
https://wiki.openstreetmap.org/wiki/API_v0.7 Whether this means
including a date together with the coordinates (for correcting WGS84 to
account for drift), or supporting GDA2020 coordinates directly.

___
Talk-au mailing list
Talk-au@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-au


Re: [talk-au] Australia "changing coordinates"

2016-08-01 Thread Andrew Davidson

WGS84 is a datum fixed; as in dated 1984 and the data does not change.


I'm not sure that you've understood exactly what a semi-dynamic datum 
is. Have a read of this:


http://ceur-ws.org/Vol-1142/paper6.pdf

particularly sections 3.4 and 3.5.



Or you have access to survey points/marks and their data  in the local
area.


LOL. Reminds me of this quote:


"You'll never find a survey mark on the ground with coordinates 
referenced to WGS-84. If you do, it's wrong."


___
Talk-au mailing list
Talk-au@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-au


Re: [talk-au] Australia "changing coordinates"

2016-08-01 Thread Warin

On 8/2/2016 1:57 PM, Andrew Davidson wrote:
It's interesting because it highlights one of the foundation myths of 
OSM; which is that it uses the "WGS84" co-ordinate system. This is a 
convenient myth and if you're talking about only mapping to the 
nearest 5m then it is in effect true. However, once you start talking 
about sub-metre accuracy it stops being true for a number of reasons:


WGS84 is a datum fixed; as in dated 1984 and the data does not change.



1. Unless you are cleared by the US DoD you don't have access to this 
level of accuracy.


Or you have access to survey points/marks and their data  in the local 
area.




2. If the accuracy of your GPS is supplemented by external data then 
this is inevitably based on one of the realisations of the ITRS; which 
is not "WGS84".


No. The survey points can be in one datum and coordinate system and 
those can be translated to any other datum and/or coordinate system.

Datums are definitions .. they do not rely on nor based on something else.


3. WGS84 is a semi-dynamic datum. Every 1st of January the USAF 
uploads new co-ordinates for each of their ground control/monitoring 
stations (where they will be at 1st July). Which means that every 
location in WGS84 co-ordinates needs an epoch to indicate when the 
measurement was taken but the database schema for OpenStreetMap 
doesn't have an entry for this.


No .. WGS84 if fixed, it does not change.
https://en.wikipedia.org/wiki/World_Geodetic_System
And that in part is incorrect ... read 
http://earth-info.nga.mil/GandG/publications/tr8350.2/tr8350_2.html 
Documents EGM 96 ... as in 1996.
_"__Third Edition, 4 July 1997 has been amended to correct errata found 
in the original printing of this edition. There are no changes to the 
definition of WGS 84 and this does not constitute a "new" WGS 84."


_If WGS84 were to be 'updated' then I would expect a different number 
e.g. WGS94 for a 1994 model.  Otherwise it is not possible to 
distinguish between the two datums!




So what happens in OSM is that each country gets mapped to their local 
approximation of WGS84. In North America this is NAD83, Europe has the 
ETRS89 and the various national variations. The UK must be the most 
confusing as the OS seems to be maintaining two system OSGB36 and OS 
Net but a least they are far enough apart to be obvious.
WGS84 is not approximated to any local datum. Rather a local datum is 
modelled for the best fit of the local surface. A global model must make 
more compromises/approximations so will always be worse than a local 
model (assuming the same data, effort and level of complexity). 
Translation of data from one datum to another has approximations, but 
the datums themselves have no approximation, they may be derived 
(contrived) from approximations but they define the thing. If 'the' inch 
is defined as the length of the Quenn Of Britians thumb .. then that is 
what it is .. no approximation. (I would buy before the thumb nail is 
trimmed, and sell after it is trimmed.)


In Australia it means that we've been happily mapping to GDA94 and 
ignoring the fact that we're racing north at something like 70-90 mm a 
year. People mapping with consumer grade GPS are only within 5m anyway 
so don't care. People with access to survey grade GPS understand the 
difference and convert back to GDA94.


Depends on what you set your GPS datum too ... mine is set to WGS84.
The GPS knows what datum the map is, and adjusts for the required datum. 
With more or less accuracy depending on the model and the complexity 
implemented inside the GPS. As my GPS is obsolete by at least 2 
generations I don't see it having any capacity for the new earth centric 
datums.




What difference will it make to OSM? It depends. If you're mapping 
some where that has good quality aerial imagery and people have 
carefully traced things then it's going to be obvious 
(https://goo.gl/sWWfYm). On the other hand most of OSM in Australia 
can be described as roughly sketched and if all you have is Bing 
imagery and some crudely traced streets then I doubt you'll be able to 
tell (https://goo.gl/B7WVfz).


As the imagery is set for WGS84 it should not be a problem'. Problems 
may arise if (when) open sourced data is in some 'other' datum and 
imported without adjustment to whatever datum OSM uses.
What to do about it? Unfortunately the changeover to GDA2020 is not 
going to happen overnight, the plan is for a three year transition 
starting in 2017. If it did happen overnight then we could just shift 
all of the nodes in Australia to their new positions can keep on 
mapping. What's actually going to happen is that the various different 
organizations are going to switch at different timr84 o WGes and the 
situation for aerial imagery mosaics will be interesting if they 
aren't retrospectively re-projected (you'll have some places on 
GDA2020 and others still on GD94). So I'm guessing the approach of 
wait and see might be the one to take. Obviously 

Re: [talk-au] Australia "changing coordinates"

2016-08-01 Thread Andrew Davidson
It's interesting because it highlights one of the foundation myths of 
OSM; which is that it uses the "WGS84" co-ordinate system. This is a 
convenient myth and if you're talking about only mapping to the nearest 
5m then it is in effect true. However, once you start talking about 
sub-metre accuracy it stops being true for a number of reasons:


1. Unless you are cleared by the US DoD you don't have access to this 
level of accuracy.


2. If the accuracy of your GPS is supplemented by external data then 
this is inevitably based on one of the realisations of the ITRS; which 
is not "WGS84".


3. WGS84 is a semi-dynamic datum. Every 1st of January the USAF uploads 
new co-ordinates for each of their ground control/monitoring stations 
(where they will be at 1st July). Which means that every location in 
WGS84 co-ordinates needs an epoch to indicate when the measurement was 
taken but the database schema for OpenStreetMap doesn't have an entry 
for this.


So what happens in OSM is that each country gets mapped to their local 
approximation of WGS84. In North America this is NAD83, Europe has the 
ETRS89 and the various national variations. The UK must be the most 
confusing as the OS seems to be maintaining two system OSGB36 and OS Net 
but a least they are far enough apart to be obvious.


In Australia it means that we've been happily mapping to GDA94 and 
ignoring the fact that we're racing north at something like 70-90 mm a 
year. People mapping with consumer grade GPS are only within 5m anyway 
so don't care. People with access to survey grade GPS understand the 
difference and convert back to GDA94.


What difference will it make to OSM? It depends. If you're mapping some 
where that has good quality aerial imagery and people have carefully 
traced things then it's going to be obvious (https://goo.gl/sWWfYm). On 
the other hand most of OSM in Australia can be described as roughly 
sketched and if all you have is Bing imagery and some crudely traced 
streets then I doubt you'll be able to tell (https://goo.gl/B7WVfz).


What to do about it? Unfortunately the changeover to GDA2020 is not 
going to happen overnight, the plan is for a three year transition 
starting in 2017. If it did happen overnight then we could just shift 
all of the nodes in Australia to their new positions can keep on 
mapping. What's actually going to happen is that the various different 
organizations are going to switch at different times and the situation 
for aerial imagery mosaics will be interesting if they aren't 
retrospectively re-projected (you'll have some places on GDA2020 and 
others still on GD94). So I'm guessing the approach of wait and see 
might be the one to take. Obviously if organizations start releasing 
data in GDA2020 and people start importing it into OSM we're going to 
have to make the call: move everything to GDA2020 or convert imports 
back to GDA94? It's only going to be a real issue once we get access to 
aerial imagery that's in GDA2020 or people get general access to GPS 
with decimetre accuracy.


Whatever we do it'll be a good test to see what should happen in OSM 
when NAD83 gets replaced by 2022 and everything in the USA moves 1~1.5m 
(http://www.geodesy.noaa.gov/datums/newdatums/index.shtml).


On 29/7/16 22:40, Andy Mabbett wrote:

See you when you reach England ;-)

   http://www.bbc.co.uk/news/technology-36912700

But seriously: what impact might this have, on OSM?



___
Talk-au mailing list
Talk-au@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-au


Re: [talk-au] Australia "changing coordinates"

2016-07-30 Thread Warin

On 7/30/2016 1:57 PM, Andrew Harvey wrote:

On Sat, 30 Jul 2016, at 08:40 AM, Warin wrote:

The change, distance wise, is upto 1.5 metres, well within commercial
GPS uncertainties.

The change is to the datum. How this will work out with future global
datums we will have to wait and see.

In another 30 years there will probably be another change of around 1.5
metres again.

As receivers become more accurate and folks start use other ground based
positioning technology that gives millimetre accuracy, then that data in
OSM will over time become more out of sync as the tectonic plate moves
while the coordinate system remains fixed.

When that happens it would be good to see a future OSM API that lets us
upload data in a coordinate system like GDA so that we don't need to be
constantly updating coordinates to reflect the move in the techtonic
plate.


Sigh.

Simply changing from AGD66 to GDA94 can produce a change of around 100 metres 
in location of a coordinate.
So a change in datum can correct the drift without changing the coordinates.


From the above you can see that OZ moves at upto about 50 mm per year.

At present there is no datum system that 'drifts' over time, that would give a 
system that would need little alteration and fewer of them.

People who require the accuracy take into account the drift (usually 
professional surveyors with very expensive receivers, antennas etc.).





___
Talk-au mailing list
Talk-au@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-au


Re: [talk-au] Australia "changing coordinates"

2016-07-29 Thread Andrew Harvey
On Sat, 30 Jul 2016, at 08:40 AM, Warin wrote:
> The change, distance wise, is upto 1.5 metres, well within commercial 
> GPS uncertainties.
> 
> The change is to the datum. How this will work out with future global 
> datums we will have to wait and see.
> 
> In another 30 years there will probably be another change of around 1.5 
> metres again.

As receivers become more accurate and folks start use other ground based
positioning technology that gives millimetre accuracy, then that data in
OSM will over time become more out of sync as the tectonic plate moves
while the coordinate system remains fixed.

When that happens it would be good to see a future OSM API that lets us
upload data in a coordinate system like GDA so that we don't need to be
constantly updating coordinates to reflect the move in the techtonic
plate.

___
Talk-au mailing list
Talk-au@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-au


Re: [talk-au] Australia "changing coordinates"

2016-07-29 Thread Warin

On 7/29/2016 10:40 PM, Andy Mabbett wrote:

See you when you reach England ;-)

http://www.bbc.co.uk/news/technology-36912700

But seriously: what impact might this have, on OSM?


Very little!

The change, distance wise, is upto 1.5 metres, well within commercial 
GPS uncertainties.


The change is to the datum. How this will work out with future global 
datums we will have to wait and see.


In another 30 years there will probably be another change of around 1.5 
metres again.




___
Talk-au mailing list
Talk-au@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk-au