That would indeed solve the weird artifacts, but would also remove the desired shadows I made in the first image
The first image was taken in studio, the second in studio while testing
Is the Part casting the shadow a Union? If it is then it may be an issue with the fidelity as @SharkyDev_Official said. Setting it to PreciseConvexDecomposition may help.