...@webcontrolltd.co.uk]
Sent: Sunday, May 03, 2009 1:01 PM
To: u2-users@listserver.u2ug.org
Subject: Re: [U2] Unidata calculations incorrect
I think on Universe there is a parameter called 'WIDEZERO'. Not sure
about the setting.
regards
Martin Hutchinson
Eric Armstrong wrote:
Wally,
Would
-Original Message-
From: Wally Terhune [mailto:wal...@us.ibm.com]
Sent: Friday, May 01, 2009 6:00 AM
To: u2-users@listserver.u2ug.org
Subject: Re: [U2] Unidata calculations incorrect
look up the ECL statement FLOAT.PRECISION
Folks are often happiest with FLOAT.PRECISION 4
Wally Terhune
U2 Support
look up the ECL statement FLOAT.PRECISION
Folks are often happiest with FLOAT.PRECISION 4
Wally Terhune
U2 Support Architect
IBM Information Management Software
Tel: (303) 773-7969 T/L 656-7969
Mobile: (303) 807-6222
Email: wal...@us.ibm.com
Yes, this is a long running feature of UniData. With a simple statement you
can change the results of many of your calculations. Which setting should you
use? Well that depends on your data and your calculations. Look at the
PRECISION and FLOAT.PRECISION statements (if you don't believe that IBM
INT
Syntax
INT(num.expr)
Description
The UniBasic INT function returns the integer value of numeric
expression
num.expr.
Note: This function does not round num.expr, but truncates decimals.
Example
In the following example, the program segment prints 1, which is
the integer part of the
Thanks Wally and Colin,
That works a treat. I am surprised though that Unidata 'out of the box'
has this problem and you have to work round it.
regards
Martin Hutchinson
Wally Terhune wrote:
look up the ECL statement FLOAT.PRECISION
Folks are often happiest with FLOAT.PRECISION 4
Wally
@listserver.u2ug.org
Subject: Re: [U2] Unidata calculations incorrect
look up the ECL statement FLOAT.PRECISION Folks are often happiest with
FLOAT.PRECISION 4
Wally Terhune
U2 Support Architect
IBM Information Management Software
Tel: (303) 773-7969 T/L 656-7969
Mobile: (303) 807-6222
Email
__
From: Horn, John jh...@healthlink.com
Sent: 5/1/2009 7:11 AM
To: u2-users@listserver.u2ug.org
Subject: Re: [U2] Unidata calculations incorrect
Interesting. This works as expected on our system. Unidata 6
: [U2] Unidata calculations incorrect
look up the ECL statement FLOAT.PRECISION
Folks are often happiest with FLOAT.PRECISION 4
Wally Terhune
U2 Support Architect
IBM Information Management Software
Tel: (303) 773-7969 T/L 656-7969
Mobile: (303) 807-6222
Email: wal...@us.ibm.com
http
