Comparison tolerance cannot be more than 2^_34.
(So that integer comparisons on 32-bit machines do not have to worry
about tolerance)
Henry Rich
On 2/19/2014 7:03 PM, Ian Clark wrote:
I'm trying to construct an example using Fit (!.) to customize a given
primitive (e.g. =) to set its tolerance.
Try as I might I cannot get variants of this to work:
T=: 0.001
2 =!.T 2.0001
|domain error
| 2 =!.T 2.0001
What am I doing wrong?
----------------------------------------------------------------------
For information about J forums see http://www.jsoftware.com/forums.htm
----------------------------------------------------------------------
For information about J forums see http://www.jsoftware.com/forums.htm
