First person camera rotating

I am currently making a first person game and I got stuck.
It works fine when I walk or just stand there,

Picture


This is a random screenshot I took when I was walking.

but when I rotate my camera, it gets weird.

Picture


I have AutoRotate set to false and my CameraOffset is 0,0,0.5. I want the camera to rotate like a part. Currently, the camera is revolving around a certain point but parts rotate around a certain point which is what I want to achieve.