Making my own AutomaticCanvasSize?

Yes. It should fix your issue.

I’ll try when I get the chance, how come this should fix the issue?

When increasing the canvas size, the scale is relative to the canvas size so the padding increases as you increase the size.

is there a way i can avoid this with math that removes that canvas padding offset?

You could, but I’m unsure how.