How to fix mouse changes when "Active" property is disabled for ScrollingFrames?

I am making an inventory system. It uses a ScrollingFrame and will adjust the CanvasSize when needed. The issue I have is that when the CanvasSize is {0, 0},{0, 0} (which acts as a normal frame), your mouse turns black when you scroll even though there is nowhere to scroll.
image
I have the “Active” property disabled and it still does this.

Any idea on how to counteract this? Should I just make a custom mouse system for mousebutton1, mousebutton2, and scroll events?