a=lerp(a,b,n) is heavily framerate dependent
and while a=lerp(a,b,n*dt) helps a lot its still not accurate
ive seen a lot of people use this method of lerp smoothing but there is a better one (ik cuz ive had to deal with a similar problem before lol)
for it to be truly consistent across framerates it has to follow an exponential curve so the frame time is proportional to the amount the value moves
see: https://x.com/FreyaHolmer/status/1757836988495847568 / https://youtu.be/LSNQuFEDOyQ
a=lerp(b,a,-2^(-dt/h))
a=lerp(b,a,-p^(-dt/t))
if this still doesnt fix the problem then the lerping method likely isnt the issue…?