Hi Rob, Your right. It's the print precision (again!) ...
Thanks. Although I am a bit apprehensive to apply it since I've develop the system using 16 print precision. I don't know if I have a code somewhere that expects it to be so. :-SS I'll look at the new fmt for this one. r/Alex -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Rob Hodgkinson Sent: Wednesday, April 29, 2009 7:40 PM To: Programming forum Subject: Re: [Jprogramming] Getting the decimal values Alex, you may be asking 'too much print precision' on your display, eg: decimal=:-<. 9!:11 ]14 decimal 5.1 5.2 0.1 0.2 9!:11 ]15 decimal 5.1 5.2 0.0999999999999996 0.2 9!:11 ]16 decimal 5.1 5.2 0.09999999999999964 0.2000000000000002 You may need to use fmt (8!: x) to produce a specified format to avoid the system rounding display. Rob Hodgkinson ---------------------------------------------------------------------- For information about J forums see http://www.jsoftware.com/forums.htm ---------------------------------------------------------------------- For information about J forums see http://www.jsoftware.com/forums.htm
