Verified in a simpler example… there seems to be discontinuity around the “16
significant figures” area in formatting the number within (8!:2) …
!22x
1124000727777607680000
'c0' (8!:2) !22x
1,124,000,727,777,607,680,000
!23x
25852016738884976640000
'c0' (8!:2) !23x
25,852,016,738,884,978,212,864
!30x
265252859812191058636308480000000
'c0' (8!:2) !30x
265,252,859,812,191,032,188,804,700,045,312
Rob
On 30 Apr 2022, at 12:27 pm, Mr. Brian B. McGuinness <[email protected]> wrote:
I was playing around with extended precision and found that when I format the
results of a calculation I get more nonzero digits at the end than I do when I
just let the result display normally. For example:
!100x
93326215443944152681699238856266700490715968264381621468592963895217599993229915608941463976156518286253697920827223758251185210916864000000000000000000000000
'c0' (8!:2) !100x
93,326,215,443,944,163,159,976,979,467,798,536,412,765,149,252,739,980,661,474,384,325,625,785,282,152,304,831,674,467,853,997,780,872,771,564,755,772,036,613,628,485,669,284,340,068,195,836,863,115,824,201,728
1000000000x|!100x
0
I think that (8!:2) is giving me erroneous digits at the end from rounding
error.
--- Brian
----------------------------------------------------------------------
For information about J forums see http://www.jsoftware.com/forums.htm
----------------------------------------------------------------------
For information about J forums see http://www.jsoftware.com/forums.htm
