Re: [FFmpeg-devel] [PATCH] tests/checkasm/float_dsp: Increase allowed difference for float_dsp.vector_dmul

2017-11-26 Thread James Almer
On 11/26/2017 8:09 PM, Michael Niedermayer wrote: > On Sun, Nov 26, 2017 at 12:47:22AM +0100, Michael Niedermayer wrote: >> On Sun, Nov 26, 2017 at 12:10:38AM +0100, Michael Niedermayer wrote: >>> On Fri, Nov 24, 2017 at 11:37:36PM -0300, James Almer wrote: On 10/29/2017 11:57 AM, Michael

Re: [FFmpeg-devel] [PATCH] tests/checkasm/float_dsp: Increase allowed difference for float_dsp.vector_dmul

2017-11-26 Thread Michael Niedermayer
On Sun, Nov 26, 2017 at 12:47:22AM +0100, Michael Niedermayer wrote: > On Sun, Nov 26, 2017 at 12:10:38AM +0100, Michael Niedermayer wrote: > > On Fri, Nov 24, 2017 at 11:37:36PM -0300, James Almer wrote: > > > On 10/29/2017 11:57 AM, Michael Niedermayer wrote: > > > > The choosen value is the

Re: [FFmpeg-devel] [PATCH] tests/checkasm/float_dsp: Increase allowed difference for float_dsp.vector_dmul

2017-11-25 Thread Michael Niedermayer
On Sun, Nov 26, 2017 at 12:10:38AM +0100, Michael Niedermayer wrote: > On Fri, Nov 24, 2017 at 11:37:36PM -0300, James Almer wrote: > > On 10/29/2017 11:57 AM, Michael Niedermayer wrote: > > > The choosen value is the lowest power of 2 that allows 1000 iterations of > > > fate-checkasm-float_dsp

Re: [FFmpeg-devel] [PATCH] tests/checkasm/float_dsp: Increase allowed difference for float_dsp.vector_dmul

2017-11-25 Thread Michael Niedermayer
On Fri, Nov 24, 2017 at 11:37:36PM -0300, James Almer wrote: > On 10/29/2017 11:57 AM, Michael Niedermayer wrote: > > The choosen value is the lowest power of 2 that allows 1000 iterations of > > fate-checkasm-float_dsp > > to pass on x86-32 > > Ticket #6848 reports this value is still not

Re: [FFmpeg-devel] [PATCH] tests/checkasm/float_dsp: Increase allowed difference for float_dsp.vector_dmul

2017-11-24 Thread James Almer
On 10/29/2017 11:57 AM, Michael Niedermayer wrote: > The choosen value is the lowest power of 2 that allows 1000 iterations of > fate-checkasm-float_dsp > to pass on x86-32 Ticket #6848 reports this value is still not enough. Maybe something like 1.0e-12 or 1.0e-13 instead? > > Signed-off-by:

[FFmpeg-devel] [PATCH] tests/checkasm/float_dsp: Increase allowed difference for float_dsp.vector_dmul

2017-10-29 Thread Michael Niedermayer
The choosen value is the lowest power of 2 that allows 1000 iterations of fate-checkasm-float_dsp to pass on x86-32 Signed-off-by: Michael Niedermayer --- tests/checkasm/float_dsp.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git