Mathieu Bouchard wrote: >> but what is highest positive integer number I can represent with the >> current pd float precision? 16bit? 32.767? > > the highest positive integer is 340282346638528859811704183484516925440 > but you really want to know which is the highest positive integer for > which it is possible to subtract 1. It's 16777216 (I'm saying this > number very often on pd-list).
that is true, maybe because this information is missing in the help patch. so, when I type this number into a number box, it says 1.67772e+07 but it still seems to work, because I can subtract 16777216 correctly. >> for now, I am ok with a precision of 1cm. > > You won't get it with just floats. You will have to use pairs of floats > to get to this level. I separate the longitude values at the comma, which means this number (16777216) has to represent a range of ~111 km which gives a precision of less than 0.7cm. marius. _______________________________________________ PD-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list