Re: [FFmpeg-devel] [PATCH] avcodec/mlpdsp: Fix signed integer overflow, 2nd try

2017-11-26 Thread Michael Niedermayer
On Mon, Nov 20, 2017 at 09:26:48PM +0100, Michael Niedermayer wrote: > The outputted bits should match what is used in the lossless check > > Fixes: runtime error: signed integer overflow: -538697856 * 256 cannot be > represented in type 'int' > Fixes:

[FFmpeg-devel] [PATCH] avcodec/mlpdsp: Fix signed integer overflow, 2nd try

2017-11-20 Thread Michael Niedermayer
The outputted bits should match what is used in the lossless check Fixes: runtime error: signed integer overflow: -538697856 * 256 cannot be represented in type 'int' Fixes: 4326/clusterfuzz-testcase-minimized-5689449645080576 Found-by: continuous fuzzing process