On 12/5/25 10:33, Peter Maydell wrote:
On Thu, 4 Dec 2025 at 19:34, Jim MacArthur <[email protected]> wrote:
If both frame and element count are 65535, which appears valid from my
reading of the OMAP5912 documentation, then some of the calculations
will overflow the 32-bit signed integer range and produce a negative
min_elems value.
Raised by #3204 (https://gitlab.com/qemu-project/qemu/-/issues/3204).
The real hardware is surely not doing 64-bit arithmetic though.
It's presumably working with elements * frames as unsigned 32 bit
multiplication.
-- PMM
I agree it's unlikely that the hardware would use 64 bit maths, but
without any spec (that I've found so far) or real hardware to test on, I
can't be sure what the expected behaviour is.
If we think that uint32_t is a more likely situation than the current
`int` then I'm happy to change it to that.
Jim
