I was playing around with extended precision and found that when I format the 
results of a calculation I get more nonzero digits at the end than I do when I 
just let the result display normally.  For example:

   !100x

93326215443944152681699238856266700490715968264381621468592963895217599993229915608941463976156518286253697920827223758251185210916864000000000000000000000000


   'c0' (8!:2) !100x

93,326,215,443,944,163,159,976,979,467,798,536,412,765,149,252,739,980,661,474,384,325,625,785,282,152,304,831,674,467,853,997,780,872,771,564,755,772,036,613,628,485,669,284,340,068,195,836,863,115,824,201,728


1000000000x|!100x

0


I think that (8!:2) is giving me erroneous digits at the end from rounding 
error.

--- Brian

----------------------------------------------------------------------
For information about J forums see http://www.jsoftware.com/forums.htm

Reply via email to