AI Moderation SUCKS and is going ROGUE and we can't do anything about it!

:warning: I know there is probably somebody who has reported this before.

This post will get closed (because of the similar post = bad policy), just like all of the other ones, but this is a HUGE issue, and I don’t see anybody actively talking about it.

I take responsibility to address this issue because not everybody affected by this has access to the Roblox DevForum.


:puzzle_piece: Part 1 - False Bans are Off the Charts and This Issue Needs to Be Addressed More

The title says it all. It is no exaggeration.

I don’t know what kind of systems are in place to moderate accounts and assets, but there is obviously something that is not working.
For years, Roblox’s AI Moderation has been absolutely horrible.

Add a free model into your game? Terminated.
Appeal denied. Can’t do anything about it.
Talk in chat? Banned for saying “hello.”

These kinds of things sound so stupid on paper and almost nonsensical. Surely in Roblox’s entire existence, they have been able to address these issues, and unban those who have been falsely banned?

No.

Navigating Roblox nowadays is like navigating through a field full of landmines. You touch one thing, and your entire IP address is banned off of the platform.
For years, this has been bugging me. Even I was affected by Roblox’s horrible moderation, and each day I am afraid I will be affected by these many issues. (I will get into specifics later.)

It feels like Roblox has been ignorant of many of these issues. They try so hard to “improve” their moderation, but it never works.

Fixing these issues isn’t unreasonable either - look at any other online game.
Now sure, every now and then somebody is going to get banned on accident. It happens.

Compare that to Roblox’s false bans?
That’s like comparing a puddle to an ocean.

Each day, thousands of users are banned for absolutely NO reason. Every account - WIPED.

“But they can just appeal!”

No. They can’t.
As if AI moderation wasn’t bad enough, they implemented AI appeals. People barely get unbanned from these, and it is typically useless.

The moderation system that Roblox runs is HORRIBLE.
At the most, people flagged by this AI should be temporarily banned, not fully terminated off of the platform. Leave that part to the humans, at least partially - or just fix the entire thing itself.


:brain: Cases of False Bans

Proof of Concept #1

In the case of this user (Kits), he uploaded a Fall Damage script to the Roblox marketplace.
This script wasn’t malicious at all. However, he was banned on EVERY SINGLE ONE OF HIS ACCOUNTS for “Child Exploitation.”

To pour pure sodium into the wound, the “evil child exploitation script” was UNBANNED, while his accounts STILL REMAIN TERMINATED.

Now, I hate to be critical here. But when a multi-billion-dollar company can make a mistake this large, you can’t forgive them.
It is absolutely mind-boggling how Kits is still banned, even after all of the attention he has gotten on social media. (Over 300,000 views.)

image


Proof of Concept #2

This Twitter post by the developer Dynabroth briefly describes some of the issues I have mentioned, and also notes that his friend, Fede, was banned for a game Fede made in 2007.
The reason it was banned?

A bed model.

Do I need to even say anything about this?

Fede’s Case

There are many, many more of these stupid bans even though I only listed two.
Look anywhere and you will find them. They are everywhere.

This isn’t a one-time rare thing - this is extremely common.
And we can’t do anything about it.


:prohibited: Part 2 - Things That Should Be Moderated Aren’t Being Moderated

As if false bans and asset takedowns were not enough, let me introduce you to the countless copyrighted assets, inappropriate games, and more.

I want you to go to Roblox right now and click the Marketplace. What do you see?


(Sorry for all of the annotations - I crossed some text out and highlighted some notable evidence here.)

By the way, this is the first page. I didn’t even have to scroll down.

Look at this and tell me this is appropriate for all ages.
First off, we have a low-quality slop item (which isn’t too bad), but then we have the “I <3” (you know what, I don’t want to be flagged by moderation).

Although these are pretty weird and should NOT BE ON THE PLATFORM, the “read the back of this sign” and the Helluva Boss item are far worse.



Note how this image has 50,000 favorites and how it is uploaded by a verified creator.

Although both of these are questionable, you could debate that they aren’t that bad (even still, they should not be on the platform at all), but the Helluva Boss item is where things get BAD.

Helluva Boss is a MATURE-RATED SERIES.
It includes adult content, gore, and more that should not be referenced on Roblox.

By the way - all of these items popped up right as I clicked on the catalog button.
There are worse items out there, and these are probably just the tip of the iceberg.

So while people are being banned for uploading ragdoll death scripts and old 2007 games including official bed models, these creators get to post suggestive content that references adult media.


:joystick: Games. Oh No.

These are literally so bad that I can’t annotate them enough to be appropriately viewed.
All I can say is that by looking up simple words, you can get crazy results.

I found multiple suggestive icons when searching these terms up, and some of these games have been up for months.


:compass: Conclusion

Roblox. What are we doing?

Enforcement bans for no reason, moderation going rogue, assets being misflagged, and more.

It isn’t fair that we as a community have to deal with things like this on a constant basis.
We are all fighting for our accounts to not get banned for no reason, while this “moderation” of yours is banning people left and right for no reason.

We shouldn’t have to do these things to protect our accounts - that is your job.
And it is time that we as a community call these issues out and fight for change.

Thank you for reading this post.
If there is anything you found interesting, concerning, disagreeable, or if you want to share your own personal experience with Roblox’s moderation, please feel free to leave a comment.

For now, we all have to deal with these issues.
Hopefully, somebody at Roblox sees this post, and instead of ignoring it and closing it for being too similar to others, they take some of this into account and do something - anything - please.
Thank you.

Note: I am not slandering any engineers at Roblox in this post.
You guys work very hard to fix these issues; I just need to say what has been on my mind for years.

A private message is associated with this bug report

26 Likes

Then why did you feel the need to make the 1000th version of this? If you know that this post will get closed “just like all other ones,” then why did you even feel the need to make this? There are numerous moderation posts with hundreds of replies & likes that Roblox has seen and acknowledged, they aren’t taking down posts to censor, they’re taking down duplicate posts (like yours)

You contrast your own statement above by saying “I don’t see anybody actively talking about it” when you and I both know good and well that there are hundreds of posts monthly on these exact same issues that you’ve highlighted.

Here’s a post with 5000 Replies, 2000 likes, covering the topic of AI Moderation and examples of failures in Roblox moderation:
https://devforum.roblox.com/t/roblox-moderation-needs-to-be-addressed/1709732

4 Likes

I never said they were censoring anything. In the cases of the users I have addressed (like Kits), there are more specific issues than just “ai moderation bad!” That in itself is already true, but when you give Roblox these specific cases, they are more likely to fix things like this.

This post was made in 2022. Things have changed since then. And even before this post, there were probably numerous other posts about AI moderation.
Similar ~= bad in some cases, like this one. I am sure that we both know Roblox moderation sucks and needs to be addressed. I am willing to take the risk of getting this post deleted if it means that I can spread more awareness about this issue.

And sure, this post isn’t perfect. It is probably controversial, but it is what has been on my mind for years. Roblox only reads bug reports most of the time. If I can help any of these people get unbanned, or create change, I will take my chances, even if it seems stupid and irrational.

7 Likes

The devforum policy that prevents similar posts is also really bad for topics like Moderation, because there is obviously going to be an abundance of them that get deleted, even if they go over different issues.

2 Likes

Honestly I don’t blame OP for making the 834753498678534875th thread about it. Desperate times call for desperate measures.

9 Likes

It doesn’t matter how many posts were made on the same topic. Roblox has had safety and moderation issues ever since it became popular. I don’t get why people say “Oh this post has already been made”. Like I said, it doesn’t matter. Honestly Roblox needs to step in and actually do what they’re supposed to do.

10 Likes

I think that it’s best to keep pressuring Roblox by making more reports about it. It shows how important this is to fix if it’s not just one individual suffering from it

This isn’t just a bug, but a major problem that hasn’t gone away

6 Likes

Yo really quick… REAL QUICK! Buddy, I’ve done some deep digging.

This is something I found that an admin said…
"
Proof 74
"
I’ve also been trying to contact Roblox about these games too… and both times, they’ve either ignored me or wanted to put my YouTube channel in risk of being banned… even though I game them enough evidence (Although, I get it’s a template response, it’s still not good)

Gave them links too.

Just so you know you’re not going crazy… these are also search recommendations… that aren’t really recommendations…




And if you really think it’s not just happening to you and me… Trust me, inappropriate games have shown up on my recommended (Which it seems now, Recommended is LITERALLY just popularity and not actual recommended)

Most the games I’ve found too… ARE 5+!




Most the other things I’ve found, I don’t think I would like to share, well, because… the poor moderation on this would probably ban me.

Thinking about it, it’s like Roblox pushed all it’s moderators to the forums, instead of keeping them on the website

But also… let’s just say… even on the lowest settings for safety… these games still show up… well… more graphic games show up, that’s all I’m gonna say.

I recommend reading this for more info… just to go over it.

3 Likes

More change of “similar post = bad policy” when it’s AI generated. Tut tut tut.

I made a topic about some of those, feel free to add more example to it

1 Like

I am leaving Roblox for the time being. Consider the AI moderation fail the anvil that broke the Camel’s back.

2 Likes

Although I possibly interpreted your message to be more than it seems, you might be right… Yeah… why not leave Roblox for a while and just… go outside for once instead of staying depressed in an artificial environment?

I would go outside now, but it is January and cold and windy.

The only thing I used AI for was formatting (like titles and bolding text, etc), I wrote the text by myself.

1 Like

Got terminated for so called “Child Exploitation” because someone pressured me into trying out the tabbing exploit. Go to hell, Roblox. It took you 6 months to get my appeal, only for it to have been invalidated just because your stupid staff team took it’s pretty time to REACH OUT TO ME LIKE YOU SHOULD HAVE DONE SIX MONTHS EARLIER!!!

1 Like

We found Roblox’s Strongest Soldier here in the comments :joy:

2 Likes