LabVIEWers,

One of my instruments returns readings as strings of fixed point numbers without any decimal point. That is, the instrument returns strings of integers and separately indicates where the decimal should be, same place for all readings. In my case, the decimal point is three places from the right end of the integer.

If I use "Decimal String to Number" with an I32 zero as the default, convert "To Double Precision Float", and then "Divide" by 1000, everything works fine for positive and negative numbers.

To save the conversion, I tried using a DBL zero as the default. For unsigned number strings, this works fine as well, but if the string starts with a + or a -, the string doesn't convert and I get the default value (LV5 to LV7). Does anyone know why this happens? Is it a bug?

Using the "Frac/Exp String to Number" also works, but my input string is more limited than what that allows and I'd rather do the tighter parsing imposed by converting to a decimal integer.

--
        EnWirementally,
        Paul F. Sullivan

----------------------------------------------------

        SULLutions              (781)769-6869
        "when a single discipline is not enough"

visit http://www.SULLutions.com

----------------------------------------------------




Reply via email to