Re: [FFmpeg-devel] [RFC]libswscale: Sanitize isRGBinInt() and isBGRinInt()

2017-08-02 Thread Carl Eugen Hoyos
2017-07-25 21:27 GMT+02:00 Michael Niedermayer : > On Mon, Jul 24, 2017 at 08:00:51PM +0200, Carl Eugen Hoyos wrote: >> Attached is a PoC for a code simplification that imo makes a logic in >> libswscale easier to read and also fixes the Big Endian fate failure. >> If this approach is preferred, I

Re: [FFmpeg-devel] [RFC]libswscale: Sanitize isRGBinInt() and isBGRinInt()

2017-07-25 Thread Michael Niedermayer
On Mon, Jul 24, 2017 at 08:00:51PM +0200, Carl Eugen Hoyos wrote: > Hi! > > Attached is a PoC for a code simplification that imo makes a logic in > libswscale easier to read and also fixes the Big Endian fate failure. > If this approach is preferred, I will try to fix the five affected asm > funct

[FFmpeg-devel] [RFC]libswscale: Sanitize isRGBinInt() and isBGRinInt()

2017-07-24 Thread Carl Eugen Hoyos
Hi! Attached is a PoC for a code simplification that imo makes a logic in libswscale easier to read and also fixes the Big Endian fate failure. If this approach is preferred, I will try to fix the five affected asm functions. Please comment, Carl Eugen diff --git a/libswscale/rgb2rgb.c b/libswsca