Our game suffers the issue with Benchmarks, specifically the cohort in the “Benchmark experiences with similar players” are showing either too huge, or dead/too small games (literally unavailable ones that you can’t even enter). This change completely killed our game and we still struggling to manage the change after game started to be benched with similar players cohort. You could see tendency since the similar players benchmark change that games gradually dying. But not only this, we are benched against completely irrelevant projects that do not fit our cohort.
In fact, game went from almost 3k CCU down to 100 after the benchmark changes.
Expected behavior
We hope that benchmarks could be fixed or tweaked.
Page URL: https://create.roblox.com/dashboard/creations/experiences/8418842748/analytics/acquisition?tab=homeRecommendations
1 Like
Similar experiences in your benchmark doesn’t impact your discovery on the platform. Benchmarks are only provided to give you a point of comparison to understand other experiences your users also play.
You will see benchmark switch to similar experiences when we have enough data on your game. Think of this as a new goal; you’ve been performing well in your own genre and now you get insights into a wider range of experiences. However, switch or the benchmarks are not used in the home page algorithm and can’t impact your impressions. You can learn more about how discovery works from our recent webinar: https://www.youtube.com/watch?v=tUz_OekIIiU. After our recent update, you can also see your benchmark scorecards by genre or similar experiences using the dropdown on the overview page.
Separately, we’ll look into why unavailable experiences are part of your benchmark.
We couldn’t find any private experiences in your benchmark now. If you see that again, please let us know as that is not accepted.
