This is great to hear. Hopefully this gets announced somewhat soon! It will help devs a lot. Looking forward to it’s official announcement!
8 Likes
Correct, or the opposite, 68% of the experiences you are being compared to are doing better than you in this metric so you probably have a lot of things that you can do to improve in the short-term
This benchmark provides you knowledge of what’s possible and where you stand
This is dynamic based on player behaviour, when your similarity group changes you will see an annotation in your charts
6 Likes
We launched similar experience benchmarks in June - see devforum post for more details. Benchmark scorecards use the same benchmarks on your graph. In your example, they both use all experiences benchmark because our model didn’t identify similar experiences for your experience yet.
5 Likes
I’m also looking forward to using custom analytics. I’d appreciate if we could also be filtering regions using it. Such as being able to see all the countries that own “Green Paintball Gun” and how much, etc.
Just an example.
7 Likes
Would love to be able to see a randomized basket of experiences that you are being compared against. Is it by genre, popularity on device, overall KPIs? It really doesn’t mean much if I am being compared against games that are monetized completely differently with an entirely different audience. A better breakdown of what goes into picking “similar experiences” at the very least would be better.
I say this as someone who owns a game relatively unique to Roblox so I am curious what would be considered similar.
6 Likes
Similar experience benchmarks compare you to other experiences that your users also play. You usually have a large overlap in playtime with them. You can see some of these experiences on your Experience Details page’s Recommended Experiences Section.
7 Likes
Yeah it would be so cool for example, you create a total money entry and whenever someone gain/lose money, you add/remove money from the entry with the analytics service. On your dashboard you can then see the money graph and the total money currently
6 Likes
You mean this?
4 Likes
Yes I think. (I’m mobile didn’t see it fully, just took a short look)
3 Likes
What does that 50th, etc mean? In the stats at the botten.
2 Likes
that’s so cool! :OO
oh well… there’s nothing to view since barely anyone plays my games…
1 Like
I really needed this tbh, this gives a better feeling of progression in your games, thank you, this is a very cool feature!
1 Like
This is amazing. Now if only we could see USD / local currency beside the Robux figures…
3 Likes
I love this new dashboard! It’s really helpful, however:
-
I’ve heard that the algorithm considers client crash rate, but we currently have no benchmarks to indicate whether we need to work on improving it or not
-
I’ve had this new dashboard for a few weeks already, and when my weekly revenue was up 100%+, the card under the title “Insights” was still suggesting how I can improve my monetization
-
This one is a little unrelated but the switch to new “similar experiences” benchmarks is comparing my game to others with seemingly unachievable D1 retention statistics as well as quite a considerable increase in average session time- a few days after this change and my game has dropped from 500+ CCU to ~150 CCU
2 Likes
One of the games I am collaborating on have reached 40k visits, yet it still hasn’t been assigned a genre for similar experiences (Says All Experiences). It’s been a couple weeks. How long does it take, considering this isn’t really a new genre.
1 Like
The Similarity Benchmarks tell you what is possible for other similar Experiences that your users are visiting. For better or worse, your users are deciding between visiting your Experience or one of those in the similarity benchmark.
It might seem unachievable, but somehow those other Experiences are able to do it.
1 Like
could you provide more detail on the ‘achievement’ feature?
1 Like
I understand what the new benchmarks represent, but regardless, would you agree that this change in D1 Retention (as a result of the benchmark change) is quite drastic?
Average Session Time is even worse. It’s an increase of almost 10 minutes at the bottom line:
My game has gone from being fairly successful (by the other benchmark standards) to barely touching the bottom lines of these new benchmarks.
Could we at least have some insight into how these “Similar Experiences” are being matched with our games?
3 Likes
This is also somewhat the case for me. We have a game which we think has been doing moderately well, but all of our stats on this new page are either orange or red - not one is green. I really don’t know how these other games are achieving these kind of stats, or if they’re even somewhat similar to my own, but if this is what the algorithm sees when choosing whether or not to promote a game, I guess I’m all for it 
IMO, any analytic being green should indicate you’re doing well and if all of them are green, I’d assume your game would be pushed into the algorithm at a decent rate? It’d be really nice to get some info on how these color-coded stats actually correspond to the algo.
My game has everything from playtime rewards to daily login streaks to keep users from leaving but our session time and retention stats are still horrible (according to the colors). It’s not any fault of the team’s, but I can’t help but think these (seemingly) unrealistic stat goals are just going to employ developers to use more sneaky and scummy tactics to keep players in games
I mean, a 15 minute average session time? Really?
2 Likes
Your numbers are still the same, your experience is still successful by the other benchmark standards. The absolute values have not changed.
If you want your Experience to get to the next level then you’re able to see how the other Experiences your players play are also doing.
1 Like