There is no way to disable the backpack CoreGui without disabling the number row hotkey functionality afaik.
It was claimed otherwise in this post:
but that appears to be false. Your best bet if I’m right is to write custom backpack hotkeys. You could probably just fork whatever CoreScript handles the standard backpack.