I could not find a 'wrong' result for sqrt (with 16 digits)
albeit only for a random shot of 10 or so numbers.
Another 'observation' though:
RxCalcSqrt(-1) returns nan (that's described in 1.2
The error messages for these wrong invocations are less that perfect:
say rxCalcSqrt()
say rxCalcSqrt(3,3,3)
say rxCalcSqrt('A')
and where could I access this
Where an error occurs, the variable MATHERRNO is set with additional
information that further defines the source of the error
(Neither error nor syntax is raised. Program spits out an error message - Error
88 - and abends)
picky (as in them good old times):
Walter
----- Original Message -----
From: Mike Cowlishaw
To: 'Open Object Rexx Developer Mailing List'
Sent: Thursday, May 24, 2012 10:12 PM
Subject: Re: [Oorexx-devel] rxmath
"I seem to recall" that the 'precision' is not correct anyway .. the result
returned is the binary floating point converted to a decimal number and then
rounded to the requested number of digits. So broken [double-rounded] even
before returned to the caller.
[Lots of cases, by the way, where this is normal ...most Unix/Linux
implementations do this.]
Mike------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Oorexx-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/oorexx-devel
