How to stabilize stacked bricks?

I built a jenga tower by just stacking bricks but when start test the tower starts slowly twisting and wobbling on its own, it’s so weird. Not only that, but I have a copy of it in ReplicatedStorage to respawn it when a round ends, and only about half the time will it respawn without falling apart. I’ve tried keeping it welded until the game starts which helps, but then the issue continues when the game starts and I break the welds. I don’t know how to keep it stable.

Increase their density property and try spacing the adjacent bricks more.

That does help initially, but when I take out a brick it starts twisting on the section above where I took out the brick. It’s weird, I don’t think it used to act like this. I’m not altering the bricks in any way except for giving them drag detectors.