On 2011-06-08 21:09, Jason Grout wrote: > On 6/8/11 2:04 PM, Jeroen Demeyer wrote: >> On Trac ticket #8896 (http://trac.sagemath.org/sage_trac/ticket/8896), >> there is some discussion about whether or not the number 0.00000000 >> (with many zeros) should have a higher precision than 0.0. Currently, >> 0.0 and 0.0000000000000000 have the same precision of 53 bits. >> >> In my opinion, the current behaviour is what makes the most sense >> mathematically, but other disagree. > > Another issue is the following two cases: > > 000000000000000000.0 > > and > > 0.000000000000000000 > > Should those both have the same precision?
Since a decimal point simply indicates a change of exponent in the floating-point representation, I think these two certainly should have the same precision. Think of the above numbers as 0000000000000000000e-1 and 0000000000000000000e-18 Jeroen -- To post to this group, send an email to [email protected] To unsubscribe from this group, send an email to [email protected] For more options, visit this group at http://groups.google.com/group/sage-devel URL: http://www.sagemath.org
