Characters Flinging on collision

Hello everyone, I’ve been playing around with the character’s scale and came across this physics glitch that sends you to space whenever you collide with something and you are big.

https://i.gyazo.com/6addc68af0ac923c7328655f297558b9.mp4
https://i.gyazo.com/9ac819b9173faefbfca4ebe44601013a.mp4
(Sorry for bad quality)

Is there any fix or workaround for this thing?
Any help is really appreciated, Thanks!