ROBLOX AI Moderation Tools Allow Inappropriate Content

ROBLOX’s AI Moderation is significantly flawed. It seems that I can easily search up and find illicit material from searching “bathroom” or “con” or anything like that. It seems that I can find illicit material from just scrolling a bit in the UGC catalog. It seems that this has just flown under the radar for an extremely long time.

AI Moderation also shows no regard for when actual arrests occur.


(Please Skip to 0:15)
https://x.com/RoCatchers/status/1905589357089530015

Expected behavior

What should happen is that these games should be off of the platform, and that moderation should be a lot better with catching this kind of thing.

2 Likes

I know this seems like a complaint, but this is a genuine issue, and a genuine bug with ROBLOX’s AI Moderation. It has to do with something on the website, and in-game, and it has to do with the technology ROBLOX uses. So, please take this as it is, a bug. An issue. Not a complaint.

1 Like

For this to be treated as a bug report and not just a general complaint, it really needs more specifics.

Right now, there aren’t any links, examples, or clear steps for how someone could reproduce what you’re seeing. If you’re trying to highlight a flaw in the AI moderation system, try pointing to actual content that slipped through (like links to UGC items, games, or users), explain how it violates ToS, and how you’ve tried reporting it.

Otherwise, it’s extremely hard for engineers/moderators to act on it. Just giving a heads up in case you want this to be looked at seriously.

Hey, this isn’t really a bug report, but thank you for the feedback :slight_smile: since this part of the forum is just for bug reports, I’m going to close this out.