Roblox’s Algorithm Changes Are Killing Our Game

[IceyDevv (Icey)]

I couldn’t agree more. The latest algorithm change has severely impacted a few of my games that were performing exceptionally well and has also hindered the progress of other promising titles.

It feels like ROBLOX keeps rolling out these algorithm changes without warning. These changes are KILLING and DESTROYING new & upcoming games that could greatly benefit the community and generate significant returns.

How are new game developers supposed to succeed in such a volatile and constantly shifting market? We just launched a game with PERFECT stats, on the verge of peaking, and this new algorithm completely derailed our success.

We lack control over our own games, so why would new developers want to stick around and deal with this instability?

I’ve seen it and experienced it firsthand, and it is NOT fun because it feels like success is being taken away from you, regardless of how hard you work to improve your stats. And I tell you, we had great stats, and our game got kicked off the algorithm by the seams of it.

I know I am not alone in facing this issue. I’ve spoken with numerous developers and friends who have also seen their games ruined by these changes. We can’t seem to vocalize our concerns effectively, leaving us feeling helpless. How are we, as developers, supposed to trust a platform that keeps disrupting the algorithm?

This will only scare newer developers away.

[CiAxe]

I second this! It is very upsetting and aggravating.

[cr_unchy (Matthew)]

This is definitely the case and it sucks for developers who actually care about the quality of content they create, games you could have spent months to years creating will only last a month or so before getting sidelined by the algorithm and choked of all it’s players. It seems that nowadays all they want is a constant stream of rushed and copy-pasted experiences.

[Ovon30650]

This explains a game I released recently. (fireman tycoon) I promoted it for about 2 weeks(and another tycoon I released a year before. It boosted both of them up to about 300 average for the two weeks and despite updating one of the games the home recommendations have dropped both games back down to 0 just because the game is 3 weeks old and the updates to the older game did nothing… Again I updated the older game “Space tycoon” for months before hand updates that did nothing. Only releasing a new “tittle” helped shortly…
Nice going roblox with that “new game only period”. roblox, yeah great job caring about games quality and long term growth?!

[Ovon30650]

Similar situation for me. I released a new game which promoted my old game for no reason doubling the home recommendation only for BOTH of the games to then die for no reason(they all keep the same stats) having the home recommendations half and drop to 0. (in less than 3 weeks)

[LegendaryDeIta (Delta)]

I’m currently developing my own driving game inspired by some of the older Need For Speed games (and several games in the genre of that era), and with how unstable the algorithm currently is, it becomes hard to even feel motivated to work on a project like this.

I’ve witnessed games that have released, yet are shoved out of the algorithm in favour of the same simulators, obby-type games or some weird cashgrab-type games that are poorly designed, created and lack the polish and personality of smaller, well-made games. It seems that Roblox cares for this mediocre mass of games that kids enjoy solely for containing the same “skibidi ohio toilet” thing that’s just plastered on top of completely unoriginal gameplay or concepts.

This becomes worse when these “games” are shoved to the top of the algorithm solely because they give Roblox money (through micro-transactions, gamepasses and other bought content), rather than being well-made with lots of these games often not working as intended and somehow attracting more players (mostly clueless kids) than a lot of quality games.

If you’re reading this and you and your game has been affected by this mess, bless your soul and I hope that Roblox recognises your game soon

[Du_cen]

It’s been nearly a year since the creation of this post. Although Roblox has continued to apply changes to their game recommendation algorithm in favor of newer games, they’ve removed the requirement to have other stats such as Session Time, Retention, and so on.

Now, all that seems to matter is the games thumbnail and the qualified-play through rate rather than the other KPIs. Roblox will give a game more impressions per day with this stat increased compared to a game that has amazing Average Session Time, Day 1 Retention, D7, Payer Conversion, and other metrics.

The image above is an example of a game that has stats below the benchmark but is still getting pushed by Roblox.

This change removes the entire process of game designing, and feeds players games that fall short in terms of their benchmarks.

Now, imagine having a game that has great stats but the qualified play through rate is around the 50th percentile in it’s genre. The current system is sabotaging experienced developers and gives chances to games that shouldn’t be given their impressions.

If you’re experiencing the same issue, please reply to this.

[Alkan]

It seems my game is being killed again.

Specifically, my game is no longer really getting Home Impressions.

My game, 8.5 years old with a dedicated playerbase(poor retention, good session time, and great monetization):

Compared to my newish mining game(good retention, good session time, bad monetization):

An average of 7,000 Home Recommendations for an established and successful game vs. 70,000(I ignored the recent upwards spike) Home Recommendations for a newish game that’s just a tech demo?

Observe the Home Recommendation impressions vs Search impressions as well. The first graph is completely unnatural compared to all other graphs I’ve seen; home recommendation should be much higher than search. Also something happened on September 3, my impressions got cut from 20k to 7k.

I’ve asked other developers, one of a competing RTS game and another of some quick clickbaity game with bad metrics; both had stupendously higher home impressions than my game, and their data looked normal; home making up the lion’s share, search way lower, and the other impressions at rock bottom.

And heres data from September 2023:.

My home impressions are down 93%, meanwhile Search is down 22%, for context

I can’t do anything with this level of impressions, it doesn’t add up to the size of my game.

Is there a hidden metric that’s being pushed now? How do I turn this around?

[Ovon30650]

Similar situation for me. Ive pushed away from updates and into basically baiting players to get a higher click rate to avoid being thrown out of recommended. Almost all popular ish games are now cycling their thumbnails most with low quality to stay on recommendations. This is a horrible system.

[RoamingDev (abr)]

Felt like sharing my recent issues with the algorithm.

We released a game during late august. Advertised for 3 days to test it’s initial stats.

After the test sponsor had finished, we optimised the game and sponsored it for 2 weeks with a reasonably high ad credit amount. Just as the sponsor was nearing it’s competition date, we started to see a rise in players coming from home recommendations, and a steady incline with our home impressions too.

We kept a steady CCU of ~300 players hitting ~600 on a peak day. This was purely organic. The sponsor had ended and we were running solely off our impressions from the home page and the search terms. Not even 48 hours after we felt like we had a steady player-base and could start working on another game to get a pipeline going, our game was struck down and our impressions were cut and continuing to be on a steady decline by the looks of it too.

We went from having a stable ~300 CCU to now only having ~50 CCU.
I guess the only thing I can do now is wait and hope the algorithm helps us out. Good luck to everyone else.

[photonavius (photon)]

My game also suddenly started decreasing (in the middle of sponsors) in impressions despite stats improving everyday:

right now my returning users are higher than my new users

Update, this is another game:

[Ovon30650]

I have compared my stats on my game Space Tycoon with another Tycoon (dragon merge) and have higher in almost all places including session time and monetization yet the game won’t be featured anymore? (because its older?)
Its unfair that the home algorithm is obviously reflecting HUGE upticks(like from youtube video spam with millions of views or a recent release) Seems its 100% features “quickly rushed experiences”

It was a very POOR idea to release this algorithm without the genre update and making adverting so costly in the same year.

If the genre update is a bust were all cooked.

[Alkan]

My 13 year old game is reaching breaking point now; I dont have enough players at night to facilitate lobby creation, and even at peak hours players sometimes have to wait to be able to play. Getting very few players a day compounds the issue of new player retention and player activity. This is basically a soft shadowban.

[Ovon30650]

Roblox is really limiting and CUTTING off search results over like 30? (If you didn’t know roblox there are more than 30 tycoons or simulators!!!) Are we just done lying now and outright killing small games? This search system is literally awful maybe stop making it worse or even pretend to care!!!
Roblox to care about the top 300 and not just 50 in each category: impossible

[PyroIdentity]

Had to bump mine, It happened around October 29. Game

[imonurspeeddial]

This just happened to me as well, it’s really getting frustrating watching the algorithm change so often. It gives me less of a sense of stability on Roblox. Tomorrow my game could be on the front page, or it could die off completely.

[FlyingFrets (daniel)]

For some reason the algorithm changes weekly? One week my game is absolutely popping off, then dying, then popping off, and now dying again. It’s unfair to everyone and the top Roblox games aren’t affected by this at all, it’s all the small developers, goes to show how much Roblox cares.

[imonurspeeddial]

Can we seriously stop doing this? Almost weekly or biweekly algorithm tweaks have been going on for over a year. I’d like to remind the algorithm team that changing the algorithm can put people out of jobs, and having seemingly A/B testing every week is not very reassuring that I’ll be able to put food on the table next month.

[SnowdustDev]

Absolutely dealing with the same issues mentioned above.

Just recently we’ve been pushing out consistent, high quality updates every 2 weeks for both gameplay and monetization, and we’ve had literally #1 on average session time for several weeks. Nothing changed. In fact – our position got worse after making both the game and its monetization substantially better, and despite our metrics being at all-time-highs.

Despite this, our new user impressions have rapidly and substantially dropped over the past few months. In particular, a change to the description on Nov 3-4 triggered a 50% drop in home recommendations that never recovered, even after the description was changed back to what it was before.

Hope this can be addressed.

[puinn]

This is happening to 2 devs i know personally, what in the world is going on with roblox right now.