datatype 47^2
floating
So
(n^2) | 5729082486784839
is promoted to float, and loses precision. Same when the big number is
extended - it's converted to float.
For
(x: n^2) | 5729082486784839
I get 147 as the result.
Henry Rich
On 9/5/2017 12:41 PM, Rob B wrote:
Could someone explain this please?
n=.14
n
14
(*: n) | 5729082486784839
147
196 | 5729082486784839
147
(n^2) | 5729082486784839
0
(n^2) | 5729082486784839x
0
(x: n^2) | 5729082486784839
0
(x: n^2) | 5729082486784839x
147
Regards, Rob Burns
----------------------------------------------------------------------
For information about J forums see http://www.jsoftware.com/forums.htm
----------------------------------------------------------------------
For information about J forums see http://www.jsoftware.com/forums.htm