UIGridLayout Oversizing elements

I have been working on making a simple inventory system for a game I am working on. I setup a quick scrolling frame with a grid layout in it and it seemed to work fine until I added some elements. I works until there are more than 3 rows of elements:

Working (2 rows)

Broken (4 rows)

Broken (5 rows)

All elements are using scale and I have no UI constraints. The only thing I have are the elements, UIPadding, and a UIGridLayout. I tried fixing this with a aspect ratio constraint but it only worked until I rescaled the screen. I am updating this out of a playtest session so no script is interfering with the layout. I have no idea what is going on so any help is appreciated!

Was able to solve this myself after playing around more with aspect ratios