Verified in a simpler example… there seems to be discontinuity around the “16 
significant figures” area in formatting the number within (8!:2) …

   !22x
1124000727777607680000
   'c0' (8!:2) !22x
1,124,000,727,777,607,680,000

   !23x
25852016738884976640000
   'c0' (8!:2) !23x
25,852,016,738,884,978,212,864

   !30x
265252859812191058636308480000000
   'c0' (8!:2) !30x
265,252,859,812,191,032,188,804,700,045,312


Rob

> On 30 Apr 2022, at 12:27 pm, Mr. Brian B. McGuinness <[email protected]> wrote:
> 
> I was playing around with extended precision and found that when I format the 
> results of a calculation I get more nonzero digits at the end than I do when 
> I just let the result display normally.  For example:
> 
>   !100x
> 
> 93326215443944152681699238856266700490715968264381621468592963895217599993229915608941463976156518286253697920827223758251185210916864000000000000000000000000
> 
> 
>   'c0' (8!:2) !100x
> 
> 93,326,215,443,944,163,159,976,979,467,798,536,412,765,149,252,739,980,661,474,384,325,625,785,282,152,304,831,674,467,853,997,780,872,771,564,755,772,036,613,628,485,669,284,340,068,195,836,863,115,824,201,728
> 
> 
> 1000000000x|!100x
> 
> 0
> 
> 
> I think that (8!:2) is giving me erroneous digits at the end from rounding 
> error.
> 
> --- Brian
> 
> ----------------------------------------------------------------------
> For information about J forums see http://www.jsoftware.com/forums.htm

----------------------------------------------------------------------
For information about J forums see http://www.jsoftware.com/forums.htm

Reply via email to