for now, I am ok with a precision of 1cm. but what is highest positive integer number I can represent with the current pd float precision? 16bit? 32.767? (btw., would be nice to have this information in the float/number helppatch) that would only give me a precision of around 3.4 meters... marius.
Mathieu Bouchard wrote: > On Thu, 13 Dec 2007, Mathieu Bouchard wrote: > >> You can get twice better worst case by using values ranging from -1 to >> +1 (because 1 is a power of two, so it lies at the boundary of a new >> precision level) > > There was also a mistake in saying that. It improves precision, but only > by a factor of 180/128. > > _ _ __ ___ _____ ________ _____________ _____________________ ... > | Mathieu Bouchard - tél:+1.514.383.3801, Montréal QC Canada _______________________________________________ PD-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list