#9172: cygwin: numerical noise in sage/rings/integer.pyx
----------------------+-----------------------------------------------------
Reporter: was | Owner: tbd
Type: defect | Status: new
Priority: major | Milestone: sage-4.6.2
Component: cygwin | Keywords:
Author: | Upstream: N/A
Reviewer: | Merged:
Work_issues: |
----------------------+-----------------------------------------------------
Comment(by drkirkby):
The correct answer is 2*sqrt(2), which is
{{{2.8284271247461900976033774484193961...}}}
So the expected value is {{{2.0239x10}}}^-16^ high, and result on Cygwin
is 2.9760x10^-16^ low. So the errors on Linux/OSX/Solaris is not much
lower than on Cygwin. We can't really expect any more from a floating
point number.
We could change the Expected value to {{{2.8284271247461...}}} What I
don't like about that, is then much larger errors can exist and them not
be detected. But this is far from the only such case, so I suggest just
changing the test to {{{2.8284271247461...}}}, which will solve this.
Dave
--
Ticket URL: <http://trac.sagemath.org/sage_trac/ticket/9172#comment:1>
Sage <http://www.sagemath.org>
Sage: Creating a Viable Open Source Alternative to Magma, Maple, Mathematica,
and MATLAB
--
You received this message because you are subscribed to the Google Groups
"sage-trac" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/sage-trac?hl=en.
