Dan Bron wrote: > > > This is probably be due to J's tolerance. Which, according to: > > http://www.jsoftware.com/help/dictionary/d000.htm > > defaults to 2^_44 . > Thanks, I wasn't sure where this constant was coming from.
Dan Bron wrote: > > But I don't know why J's answer changes at two^53 yet Lisp's at 2^54 . > Maybe the FP representation of 1%0.5 in J isn't the same as 2.0d0 in > Lisp. > This is definitely mysterious a bit. I think that 1%0.5 and 2.0d0 should have exactly the same representation (2 in double precision) in both languages, but in any case I don't know why there's this difference. -- View this message in context: http://www.nabble.com/Format-fractional-hexadecimal-tf4895825s24193.html#a14131094 Sent from the J Programming mailing list archive at Nabble.com. ---------------------------------------------------------------------- For information about J forums see http://www.jsoftware.com/forums.htm
