On 6/8/11 2:04 PM, Jeroen Demeyer wrote:
On Trac ticket #8896 (http://trac.sagemath.org/sage_trac/ticket/8896),
there is some discussion about whether or not the number 0.00000000
(with many zeros) should have a higher precision than 0.0. Currently,
0.0 and 0.0000000000000000 have the same precision of 53 bits.
In my opinion, the current behaviour is what makes the most sense
mathematically, but other disagree.
Another issue is the following two cases:
000000000000000000.0
and
0.000000000000000000
Should those both have the same precision? As Robert points out on the
ticket, this is related to what the definition of 'trailing zero' is.
Thanks,
Jason
--
To post to this group, send an email to [email protected]
To unsubscribe from this group, send an email to
[email protected]
For more options, visit this group at http://groups.google.com/group/sage-devel
URL: http://www.sagemath.org
