Hey everyone! For the past few days, I’ve been developing a script to detect NSFW avatars based off keywords in accessories and uses points to determine a kick or ban for the offending user. I am mostly finished but I’ve recently ran into a problem where I cannot find avatars or accessories to use to test (which is a good thing). That is why I am here to ask for help.
Here is what I am looking for
IDs to accessories that would trigger moderation (basically something NSFW)
Tips on sourcing questionable accessories
Optional
Any methods you feel would be best for testing this system
Also please correct me if this is the wrong category to be asking this in or if I’m formatting this wrong, I’m new to the devforum and am still learning.
A section on this article outlines an example where a hypothetical shooter game is facing an issue where people utilize bots to kill other people quickly. What happens if you try to stop this by adding botting detection? Cheaters want to cheat, your detection will be circumvented sooner or after, and botting will continue. You realize that trying to fend off bots in such a manner is a futile task and will end up in a cat-and-mouse game where you’re constantly working to adapt to new ways of botting, until you cannot do so without incurring false positives.
The same thing goes to your NSFW avatar detection. What happens if I make an item that does not include blacklisted keywords in its name, yet it still contains suggestive content? What if I take an item and clone it on another throwaway account, which in effect will have a new ID? These issues are something that you have to consider while making this system. Although it will be effective at first, as soon as people realize, you’ll have people bypassing your detection (which, from your description, doesn’t go beyond checking blacklisted IDs and keywords, as far as you can go with such detection I believe), and you working around the clock to stop them, and possibly harming the experience for others along the way.
This is why I wouldn’t go this route. From my experience, the people who use, as you describe, NSFW avatars, make up only a minority of all players on Roblox, and you’re only bound to find, at best, about 1-3 per month on the games I normally play.
And even then you have the people who act like freaks in the Roblox chat and still get away with it.
Thank you for the feedback, and you are correct that people will eventually find a way to circumvent it. After putting some more thought in after your reply I’ve realized that it would be a lot of work to be constantly searching for accessories to blacklist as I am doing this solo. Not only that when going through my scripts its likely to be bypassed because the scripts don’t account for names meant to evade systems like these. I think that I will pivot away from this project and focus on other development projects I have set aside. I’ll keep this thread open though in case anyone else has any insights I could use.