AI moderation falsely issuing Child Endangerment violations

The automated moderation system appears to have incorrectly enforced multiple Child Endangerment violations on an account without any corresponding violating behavior. This looks like a potential false positive generated by the moderation system.

What happened

The Roblox account “fvrnweh” was permanently moderated with three separate enforcement reasons:

Voice Chat: Child Endangerment
Asset’s Description: Child Endangerment
Sending Messages: Child Endangerment

However, to the best of our knowledge, none of these violations actually occurred.

The account did not create or upload any assets that could have resulted in an “Asset: Child Endangerment” violation.
The account did not violate the Community Standards through Voice Chat.
The account did not send messages that violated the Community Standards.

Receiving three different Child Endangerment enforcement reasons simultaneously, including one for asset creation despite no asset being uploaded, suggests there may have been an error in the automated moderation system.

Request

Could the moderation team please investigate the moderation actions applied to the account fvrnweh to determine whether these were false positives generated by the automated moderation system?

If this was caused by an error, we would appreciate the account being reviewed and the incorrect enforcement being reversed.

Thank you for taking the time to investigate this issue.

Expected behavior

If no violating content exists, the moderation system should not issue Child Endangerment violations. The account should only receive enforcement when there is verified evidence of a policy violation.

A private message is associated with this bug report

6 Likes

To my knowledge, I think metadata or benign text was possibly exposed into the chat that wasn’t seen at all by other users and flagged that as child endangerment. It could be a metadata parsing issue in the moderation system internally, specifically a username could’ve been parsed incorrectly and causing the ban getting triggered.

1 Like

Bump

(haven’t received a response yet, hopefully this issue gets fixed and the account get reinstated.)

2 Likes

bump, issue was not resolved neither have received a response..

bump, after 17 days no response was received + account is still terminated.
This issue should be resolved as fast as possible other may have been affected by this..