After some more digging, I found a solution!
I found a post showcasing how to “change gravity” of certain parts and it works nicely. All of the structures are very stable now 
Here was the post: How to change the effect of gravity on only certain parts?