On 6/8/11 2:17 PM, Jeroen Demeyer wrote:
On 2011-06-08 21:09, Jason Grout wrote:
On 6/8/11 2:04 PM, Jeroen Demeyer wrote:
On Trac ticket #8896 (http://trac.sagemath.org/sage_trac/ticket/8896),
there is some discussion about whether or not the number 0.00000000
(with many zeros) should have a higher precision than 0.0. Currently,
0.0 and 0.0000000000000000 have the same precision of 53 bits.
In my opinion, the current behaviour is what makes the most sense
mathematically, but other disagree.
Another issue is the following two cases:
000000000000000000.0
and
0.000000000000000000
Should those both have the same precision?
Since a decimal point simply indicates a change of exponent in the
floating-point representation, I think these two certainly should have
the same precision. Think of the above numbers as
0000000000000000000e-1
and
0000000000000000000e-18
Jeroen
But we already have the convention that zeros after the decimal indicate
precision:
sage: a=4.000000000000000000000000000000
sage: a.prec()
103
sage: b=4.00000
sage: b.prec()
53
So there is already something special about where the decimal point is
placed.
Jason
--
To post to this group, send an email to [email protected]
To unsubscribe from this group, send an email to
[email protected]
For more options, visit this group at http://groups.google.com/group/sage-devel
URL: http://www.sagemath.org
