hi @all,
i wanted to ask for some concrete help, not to start again long discussions about the inaccuracy of fp-math, IEEE, gnumeric, Excel and Calc.
is there anyone reading here who can help me to make the following snippet fit into gnumeric? i'm not a programmer, i've put it together
thank you John,
> I assume you are trying to emulate the C function frexp().
almost, what I really want is to use this function 'in the code' to construct a function 'bin_range' which is available in the code and in sheets. I had found it in the meantime, but reaped compiler errors again ...
thank you, accurate analysis and nice visualization,
exactly such inconsistencies I would like to clear up.
This one may be a bit less inaccurate than it appears at first glance, 'int()' rounds positive and negative values 'towards negative infinity', while the granularity of floats /
On 7/8/21 10:52 AM, b. via gnumeric-list wrote:
> is there anyone reading here who can help me to make the following snippet
> fit
> into gnumeric? i'm not a programmer, i've put it together and tinkered with
> it a
> bit, in LO Calc it gives me the exponent of an IEEE 754 'double' value as
On 7/7/21 3:16 PM, Morten Welinder wrote:
> Gnumeric's rounding here is indeed done with
>
> round_to_int(x * 10^d) / 10^d
>
> except that round_to_int deliberately misrounds 0.5-1ulp to 1.
I observe that it's not quite that simple.
I assume the intent is the following:
If the input
