I suspect the value printed as 0.05 is actually a little off, by more than the comparison tolerance but less than the print precision.

Henry Rich

On 8/19/2021 7:24 AM, Pablo Landherr wrote:
Have encountered the following unexpected:

#data

6226

#~.data

36

50{.data

0.05 0 0 0 0 0 0.05 0 0 0 0 0 0 0 0 0 0.25 0.05 0 0 0 0.1 0.05 0 0 0 0.2
0.35 0 0 0 0 0 0.1 0 0 0 0 0 0 0 0.05 0.05 0 0 0 0 0 0 0

countfreq

3 : '(~.y),.#/.~y '

10{.countfreq data

0.05 1161

0 2886

0.25 165

0.1 371

0.2 145

0.35 139

_0.05 119

0.1 100

_0.05 93

0.15 317

  +/0.25=data

165

NB. Looks fine

*+/0.05=data*

*0*

*  NB. What is going on?*

9!:18 ''

5.68434e_14

JVERSION

Engine: j807/j64/darwin

Release-d: commercial/2019-03-18T16:07:14

Library: 8.07.26

Qt IDE: 1.7.10/5.9.8

Platform: Darwin 64

Installer: J807 install

InstallPath: /applications/j64-807

Contact: www.jsoftware.com

Two observations:

0) I expected +/0.05=data to yield 1161

1) _0.05 occurs twice in the first column (print precision etc are all
default values)


What explains this?


Kind regards,

Pablo Landherr
----------------------------------------------------------------------
For information about J forums see http://www.jsoftware.com/forums.htm


--
This email has been checked for viruses by AVG.
https://www.avg.com

----------------------------------------------------------------------
For information about J forums see http://www.jsoftware.com/forums.htm

Reply via email to