Good question.
Yes, it would sadly be against roblox ToS and could land you in trouble.
I suggest you take on a game like Vestarias approach where there is a message from an NPC in-game saying that there is a reward for anyone who uncovers a bug/issue.
My only other advice is to be responsive with the roblox team before you do something which may cross the barrier, reach out to the team over there who’ll be more than happy to help you out.