This is most likely due to Network Ownership.
I suggest you reading this article: Network ownership | Documentation - Roblox Creator Hub
What you can do is that when a player obtains the ball, make him that ball’s network owner so that the client could apply physics locally.