2012/2/16 Maksym Veremeyenko :
> Hi,
>
> during working with line compositing function i faced a strange value for
> *weight* parameter - 65534
>
> that value is a rounding problem that flag fast-math used.
>
> i prepared small code:
>
> #include
> int main()
> {
> float mix = 100.0f;
> int
16.02.12 19:50, Maksym Veremeyenko написав(ла):
[...]
> [root@dev-5 core]# gcc -o q -ffast-math q.c
> [root@dev-5 core]# ./q
> r1=65534, r2=65535, r3=65534
>
[root@dev-5 core]# gcc -o q q.c
[root@dev-5 core]# ./q
r1=65535, r2=65535, r3=65535
--
Maksym Ve
Hi,
during working with line compositing function i faced a strange value
for *weight* parameter - 65534
that value is a rounding problem that flag fast-math used.
i prepared small code:
#include
int main()
{
float mix = 100.0f;
int r1 = ((1 << 16) - 1) * mix / 100;
int r2 = (
