On 11/24/13 4:23 AM, Didier Juges wrote:
The Thunderbolt uses single precision floating point and digital filtering for
temperature so yes, you are going to see values like this. This is not unusual
(precision clearly out of step with accuracy), like the HP network analyzers
returning gain in dB with 4 decimals at microwave frequencies.
Not sure what your point is?
Should Lady Heather pretend to know better and muck with what's sent by the
receiver?
I prefer not but it's a matter of opinion.
Didier KO4BB
David J Taylor <[email protected]> wrote:
I hope no-one believes all the decimal digits shown in that
screen-shot! It
seems to me that it would be better if more realistic values were
presented!
37.808842 °C - really!
Often it's useful to report all the digits used in the calculation, so
you can reverse it back to the original, no doubt, limited precision
fixed point number.
_______________________________________________
time-nuts mailing list -- [email protected]
To unsubscribe, go to https://www.febo.com/cgi-bin/mailman/listinfo/time-nuts
and follow the instructions there.
