Re: [FFmpeg-devel] [PATCH 3/6] avcodec/shorten: Fix signed 32bit overflow in shift in shorten_decode_frame()

2018-08-15 Thread Michael Niedermayer
On Mon, Aug 13, 2018 at 02:24:20AM +0200, Michael Niedermayer wrote: > Fixes: runtime error: left shift of 1 by 31 places cannot be represented in > type 'int' > Fixes: > 9480/clusterfuzz-testcase-minimized-ffmpeg_AV_CODEC_ID_SHORTEN_fuzzer-6647324284551168 > -rss_limit_mb=2000 > > Found-by:

[FFmpeg-devel] [PATCH 3/6] avcodec/shorten: Fix signed 32bit overflow in shift in shorten_decode_frame()

2018-08-12 Thread Michael Niedermayer
Fixes: runtime error: left shift of 1 by 31 places cannot be represented in type 'int' Fixes: 9480/clusterfuzz-testcase-minimized-ffmpeg_AV_CODEC_ID_SHORTEN_fuzzer-6647324284551168 -rss_limit_mb=2000 Found-by: continuous fuzzing process