Heh, I had a whole answer prepared about IEEE floating-point accuracy [1], but I thought the numbers looked OK :)
Cheers, - Kim [1] http://en.wikipedia.org/wiki/Floating_point#Accuracy_problems On Tue, Mar 23, 2010 at 22:47, Tom Corcoran <tom.corco...@moonbade.com> wrote: > Apologies guys, it made complete sense at the time...clearly I need to > lay of the cr**k pie, damn. > > On 23/03/2010 21:28, Kim Gräsman wrote: >> Hi Tom, >> >> On Tue, Mar 23, 2010 at 22:02, Tom Corcoran<tom.corco...@moonbade.com> >> wrote: >> >>> I found what looks like a Math error: >>> >>> 1276.595744680851/47 = 27.16161158895428 >>> 1276.6/5 = 255.32 >>> >> My mental arithmetic is a little slow... What do you think is the problem? >> >> Thanks, >> - Kim ------------------------------------------------------------------------------ Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev _______________________________________________ To unsubscribe visit: https://lists.sourceforge.net/lists/listinfo/dqsd-users DQSD-Users@lists.sourceforge.net http://sourceforge.net/mailarchive/forum.php?forum_id=8601
