Looks like the physics engine working as intended…
This is a feature called “physics throttling”. If the physics engine detects that it can’t keep up with realtime it starts stepping the world less frequently and everything appears to move ~4x slower. Some bodies, like Humanoids are never subjected to throttling.
We do this to prevent going into a death spiral, getting further and further behind realtime.