Shadow Delay Issue During Skybox/ClockTime Transition

I want to get rid of that delay on the shadows. I think it has to do with the Atmosphere. Right now I’m replacing the Skybox with a darker one like this:

But i’ve already tried to use TweenService to make a clean transition from the ClockTime, but it has to be fast and has the exact same issue.
Inside Lighthing i have: Atmosphere, Sky (skybox), Bloom and DepthOfField

I think it has to do with Atmosphere, but I have no idea how to fix it.
image
image
image
image