Ola Antonio,



I set DEFAULTPRECISION=8 but it doesn't work as expected. For example...









Just focusing on Compressive Strength in the 3rd column, I see 7.239494, which
is the result of converting 0.00105 psi to Pa, but the max value is 0.00124
psi and that doesn't work out so well for the conversion since it isn't
exactly representable in floating point...









So DEFAULTPRECISION fails to limit the numbers of digits displayed to 8
because apparently it is NOT counting zeroes as digits so instead of
displaying 8.618446 or even 8.6184460, it is displaying 8.618446000000001 (the
"exact" value for the conversion).




Is there some other workaround for that so it can work as expected?




Thanks,

Andrew



╔═══════════════╗
║  Environment  ║
╟───────────────╢
║ IUP   v3.30   ║
║ IM    v3.12   ║
║ CD    v5.11.1 ║
║ Win10 v21H1   ║
╚═══════════════╝
_______________________________________________
Iup-users mailing list
Iup-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/iup-users

Reply via email to