[Mlt-devel] rounding problem

2012-02-16 Thread Maksym Veremeyenko
Hi, during working with line compositing function i faced a strange value for *weight* parameter - 65534 that value is a rounding problem that flag fast-math used. i prepared small code: #include stdio.h int main() { float mix = 100.0f; int r1 = ((1 16) - 1) * mix / 100; int

Re: [Mlt-devel] rounding problem

2012-02-16 Thread Maksym Veremeyenko
16.02.12 19:50, Maksym Veremeyenko написав(ла): [...] [root@dev-5 core]# gcc -o q -ffast-math q.c [root@dev-5 core]# ./q r1=65534, r2=65535, r3=65534 [root@dev-5 core]# gcc -o q q.c [root@dev-5 core]# ./q r1=65535, r2=65535, r3=65535 -- Maksym