Re: [FFmpeg-devel] [PATCH 2/2] avcodec/hevc_cabac: Check prefix so as to avoid invalid shifts in coeff_abs_level_remaining_decode()

On Tue, Jan 23, 2018 at 07:44:24PM +0100, Michael Niedermayer wrote: > On Tue, Jan 16, 2018 at 12:37:28AM +0100, Michael Niedermayer wrote: > > I suspect that this can be limited tighter, but i failed to find anything > > in the spec that would confirm that. > > > > Fixes:

Re: [FFmpeg-devel] [PATCH 2/2] avcodec/hevc_cabac: Check prefix so as to avoid invalid shifts in coeff_abs_level_remaining_decode()

On Tue, Jan 16, 2018 at 12:37:28AM +0100, Michael Niedermayer wrote: > I suspect that this can be limited tighter, but i failed to find anything > in the spec that would confirm that. > > Fixes: 4833/clusterfuzz-testcase-minimized-5302840101699584 > Fixes: runtime error: left shift of 134217730

Re: [FFmpeg-devel] [PATCH 2/2] avcodec/hevc_cabac: Check prefix so as to avoid invalid shifts in coeff_abs_level_remaining_decode()

On 1/15/2018 9:33 PM, Ronald S. Bultje wrote: > Hi, > > On Mon, Jan 15, 2018 at 6:37 PM, Michael Niedermayer > wrote: > >> I suspect that this can be limited tighter, but i failed to find anything >> in the spec that would confirm that. >> >> Fixes:

Re: [FFmpeg-devel] [PATCH 2/2] avcodec/hevc_cabac: Check prefix so as to avoid invalid shifts in coeff_abs_level_remaining_decode()

Hi, On Mon, Jan 15, 2018 at 6:37 PM, Michael Niedermayer wrote: > I suspect that this can be limited tighter, but i failed to find anything > in the spec that would confirm that. > > Fixes: 4833/clusterfuzz-testcase-minimized-5302840101699584 > Fixes: runtime error:

[FFmpeg-devel] [PATCH 2/2] avcodec/hevc_cabac: Check prefix so as to avoid invalid shifts in coeff_abs_level_remaining_decode()

I suspect that this can be limited tighter, but i failed to find anything in the spec that would confirm that. Fixes: 4833/clusterfuzz-testcase-minimized-5302840101699584 Fixes: runtime error: left shift of 134217730 by 4 places cannot be represented in type 'int' Found-by: continuous fuzzing