On 03/11/2014 02:06 AM, Jonathan Moules wrote:


TIFF stores floating point values as IEEE754 floats. Talking about significant
figures doesn't make much sense. You could test using Float64 with the hope
that 50.597 can be exactly represented as a Float64. Otherwise you'll have to
do the rounding when reading back from TIFF.


Hi Even,
Thanks for the information. I don't pretend to understand the fine details of floats, but it does seem counter intuitive that a simple 2 or 3 decimal places can't be accurately represented.
Here's a crazy idea could you perhaps use mm and then output to an integer raster?  No problem representing 50597mm.

I tried the Float64 but the values are identical (16 significant figures) even though the filesize is predictably larger.

I guess I'll have to make do, but it does introduce the problem of False Precision.

Thanks all,
Jonathan


This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

_______________________________________________
gdal-dev mailing list
gdal-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/gdal-dev


_______________________________________________
gdal-dev mailing list
gdal-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/gdal-dev

Reply via email to