@xidulu Thanks a lot for your user experience comment. In this case, using 
`np.finfo('float32').eps` returns the machine epsilon which is far from 
denormal number. Therefore, these 2 flags shouldn't affect your clipping. To 
create denormal number from machine epsilon you have to take it to ~6th power.
```Python
import daz
daz.set_ftz()
daz.set_daz()

np.power(np.finfo('float32').eps, 5, dtype=np.float32)
>>> 2.4074124e-35

np.power(np.finfo('float32').eps, 6, dtype=np.float32)
>>> 0.0
```

-- 
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub:
https://github.com/apache/incubator-mxnet/issues/19361#issuecomment-713356876

Reply via email to