On 5/24, my team and I celebrated our recent success - we had achieved 1M+ home recommendations in a single day for the first time in all of ours careers.
However, our success was short lived. Soon after, our recommendations would completely TANK, plunging nearly 85% in the past few days.
Our team hasn’t made any changes to the game whatsoever, our recommendations seemed to just have vanished into thin air.
Help would be greatly appreciated, thanks for reading.
I don’t think it should become common practice to submit bug reports when your game is kicked out of the algorithm. Time and time again similar reports have been filed, and every single one has been marked as intentional behaviour. The algorithm is always fluctuating and re-evaluating games’ rankings, it’s completely normal. I’d recommend looking at which of your stats on the “Overview” page decreased at the time you experienced the drop in CCU.
At this point these reports are not bug reports but rather a way to ask engineers for an explanation on why your CCU dropped, which is not what the bug reports category is for when plenty of resources/documentation exists to help you figure this out yourself
This impression chart you’ve shown looks normal - your game was launched, gained traction and the algorithm explored it, had a really good day, and now it’s still stabilizing.
Impressions are a “platform level” metric - Even if nothing changes within your game, the performance of other games and the platform as a whole impacts it (e.g. on weekends there are more users so it’s higher on average; or if other games are highly retentive, users might not scroll down their homepage looking for something else to play).
To give your experience the best chance at success, we recommend using your Home Recommendations dashboard to see what metrics might be lower than before / lower than your benchmarks and trying to improve those. The algorithm does not directly compare your game to your benchmarks but it will give you a good idea of how other experiences on the platform are performing.
I do want to mention that investigating individual experiences’ fluctuating performance does create thrash for our team and doesn’t fall into the bounds of general bug reporting. We provide transparency into the complete list of signals that the algorithm uses, so we’re actually just looking at the same dashboard as you
I will close this report. Thanks for understanding!
I won’t be submitting this again, but this was much more of a learning experience for me. The clarifying information I received from the team at Roblox was helpful to solving my perceived issue.
