Hello,
My team at Novaly are creators to several top games on Roblox amounting to ~10 mil monthly players and 1.5B plays in total
One of our “Top Bug Reports & Feature Requests” is: expanding dev analytics benchmarks to show comparison to all other games (Top 50, 100, 250, 500, 1000, 2500)
One sentence summary: Benchmarks don’t tell us what metric(s) to focus on, we need to know how our game performs across all games and/or what metrics the Roblox platform values most.
Current problem
Genre based benchmarking (without info on how big the genre is or what it is) wastes dev resources.
Common example: our game B might be classified as part of a small niche genre, and in that genre, we lack in playtime. Our team would then focus on lifting playtime and see no result, because a) the genre is small and b) the game is far behind in retention against all games and that’s the metric more impactful to the algorithm (since recommendations are based on performance in-genre and against all games)
It’s especially bad when our games experience random reclassifications and all of the sudden a metric we thought we were behind in, pivotal to our next 2 quarters of effort, suddenly changes to stellar (95th+ percentile) & it’s an entirely different metric that we should have been thinking about this whole time (does not happen often, but about x1-2 a year, per game, which is enough to frustrate the team)
Quick alternative
A quick alternative complementary to the suggestion above: showing vaguely which metrics Roblox prioritizes the most on its platform to help devs align (without revealing too much and becoming prone to abuse)
Example:
Adding stars as rough indicators of importance, where 3 = most important
Can be applied to the overview section as well
Hoping to see all game tiered benchmarks + metric ranking system become present on the dashboards, it would meaningfully help us in informing roadmap, marketing and hiring decisions.
Thanks!
NoAlias