Using AlignOrientation on objects causes them to drift on slopes

Hi all!
Ive been making a skating game and decided to make a new movement system.

I started working on it an decided to use “AlignOrientation” to make the board more stable.
I made it so it does NOT affect the Y axis(aka the part can spin freely on the Y axis).
Here is the config:

It works great until i go on a slope, then it starts to drift and spin, this however DOES NOT happen when i disable the AlignOrientation.

Here’s a clip of the issue:

My hands are off the keyboard when im on the slopes.

Also here is how I align the part to the ground (pretty standard)

board.AlignOrientation.CFrame = CFrame.new(hitPos, (hitPos + normal)) * CFrame.Angles(0, math.rad(90), 0)

“hitpos” and “normal” are both from a raycast i shoot down.

Now before i finish this i want to mention that NO, the maxForce is not the issue, as this bug accours even with it set to a lower number

Thanks a lot for reading, any help is appreciated!