It has to do with some widget panel causing lag spikes?
This does NOT happen with a gamepad, Moving around with a gamepad is smooth and responsive, this seems like mouse input only issue.