"I seem to recall" that the 'precision' is not correct anyway .. the result
returned is the binary floating point converted to a decimal number and then
rounded to the requested number of digits. So broken [double-rounded] even
before returned to the caller.
[Lots of cases, by the way, where this is normal ...most Unix/Linux
implementations do this.]
Mike
_____
From: Walter Pachl [mailto:[email protected]]
Sent: 24 May 2012 21:00
To: Open Object Rexx Developer Mailing List
Subject: [Oorexx-devel] rxmath
I think I reported this 'problem' a long time (actually years) ago.
A program should do what the doc specifies
and the other way round.
/* Deja vu *****************************************************
Many (all?) functions of the rxmath package say
precision
The precision of the calculation. If a value is not specified,
the precision of the calling Rexx activity
is used. If the precision exceeds 16 digits, the call will fail.
In fact, the functions don't fail but use a maximum precision of 16!
Try this
***************************************************************/
Numeric Digits 20
Say 'digits() ='digits()
Say 'RxCalcSqrt(2) ='RxCalcSqrt(2)
Say 'RxCalcSqrt(2,9) ='RxCalcSqrt(2,9)
Say 'RxCalcSqrt(2,11)='RxCalcSqrt(2,11)
Say 'RxCalcSqrt(2,15)='RxCalcSqrt(2,15)
Say 'RxCalcSqrt(2,16)='RxCalcSqrt(2,16)
Say 'RxCalcSqrt(2,18)='RxCalcSqrt(2,18)
::requires 'rxmath' LIBRARY
Regards
Walter
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Oorexx-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/oorexx-devel
