Weird issue with spatial audio

So I don’t know if it’s something with my specific speaker configuration, but what I’m noticing is when I turn away from a brick emitting a sound, I can pretty much no longer hear it at all, which doesn’t really make sense.

Is this possible to address?

Thanks.