In the Linux kernel, the following vulnerability has been resolved:
drm/radeon: fix integer overflow in radeon_align_pitch()
radeon_align_pitch() has the same kind of overflow issue as the old amdgpu helper: both the alignment round-up add and the final aligned * cpp calculation can overflow signed int.
If that wraps, radeon_mode_dumb_create() can end up returning an invalid pitch or creating a zero-sized dumb buffer.
Fix this by using check_add_overflow() for the alignment round-up and check_mul_overflow() for the final pitch calculation, returning 0 on overflow. Also reject zero pitch and size in radeon_mode_dumb_create().
Found via AST-based call-graph analysis using sqry.
References
- https://git.kernel.org/stable/c/415bb9893e249e46aa5159f7363a11512cf06fa9
- https://git.kernel.org/stable/c/b7b44937c548c2c987fcdd129f8896741004bed6
- https://git.kernel.org/stable/c/ce3b24eb3ee8f82de851535f516bf21f83e82259
- https://git.kernel.org/stable/c/d9dfa176899d488e48bb7342d2c43ddd36e66318
- https://git.kernel.org/stable/c/dfc7b5b5599472277e71e5bd2712740651c7c5be