http://en.wikipedia.org/wiki/IEEE_floating_point
Cheers Ben -----Original Message----- From: Action Request System discussion list(ARSList) [mailto:[email protected]] On Behalf Of Misi Mladoniczky Sent: January-23-13 00:36 To: [email protected] Subject: Re: Real number fields and the Precision property.. Hi, A real number precision is just a display property. The would be stored as a floating point number in the database. This means that the number might or might not be able to store the exact value you intend it to store. Decimal fields can not stores the exact digits you enter, and you can not store any other precision than the one you specified for the field. It is stored as a string in the database. I use decimal fields a lot, as they are exact. When using Real values, you have to use the ROUND-functions much more. In you rexample. Try to store 0.1234567891. I would be that it will store more decimal digits as you have fewer significant digits in total. Best Regards - Misi, RRR AB, http://rrr.se > I've barely (if at all) used real or decimal fields in a long time, so > I do not recall if this was ever working like how I would expect it > to, bearing in mind the true mathematical meaning of the term > precision used with decimal or real numbers. > > > > How does the AR System store Real Number fields when a certain > precision level is selected as its property? For e.g. if I choose a > Real Number field to have a precision of 10, if I stored a number > 2341.1234567891, I would expect Remedy to display 2341.1234567891 as > the value that was stored after the commit. However it displays > 2341.1234570000 after rounding up, which I find to be strange. And in the > database, it stores only 2341.123457. > > > > Precision, thus I have noticed is the total count of digits BOTH > before and after the decimal point in Remedy AND NOT the count of > digits after the decimal point which according to me would be a > traditional definition. Is this a bug? > > > > I am messing around with AR System 7.6.04 Patch 003 installed on > Windows > 2008 and using Ms-SQL 2008 R2 as the underlying DB for those who want > to know my environment. > > > > Cheers > > > > Joe > > > ______________________________________________________________________ > _________ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org > "Where the Answers Are, and have been for 20 years" > Best Regards - Misi, RRR AB, http://www.rrr.se (ARSList MVP 2011) Products from RRR Scandinavia (Best R.O.I. Award at WWRUG10/11/12): * RRR|License - Not enough Remedy licenses? Save money by optimizing. * RRR|Log - Performance issues or elusive bugs? Analyze your Remedy logs. Find these products, and many free tools and utilities, at http://rrr.se. _______________________________________________________________________________ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org "Where the Answers Are, and have been for 20 years" _______________________________________________________________________________ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org "Where the Answers Are, and have been for 20 years"
smime.p7s
Description: S/MIME cryptographic signature
