Analytics: New Experience Overview with Insights, Benchmarks, Realtime

Updates Announcements
#1

Hi Creators,

Today, we’re excited to launch a major upgrade to your Experience Overview page to help you focus on the right actions to take to grow your creations. The page includes:

  1. Insights that highlight major week-over-week metric changes.

  2. Benchmarks that help you focus on the right metric to improve compared to similar experiences.

  3. Real-time that lets you monitor up-to-the-minute performance.

  4. Achievements to help you celebrate new milestones.

1600×1180 211 KB

Note: Numbers displayed here and in the following images are illustrative

Insights

Your new insights highlight major weekly changes in key metrics compared to your benchmarks.

For example, the insight below shows that your revenue declined 21%, but similar experiences’ revenue increased by 15%. This is a sign that you’ll want to take action and look deeper into your monetization to diagnose potential issues. You can click “Explore this metric” to slice and dice your revenue by platform, country, and more. These insights are updated daily and are available for experiences with 100+ DAU.

1920×633 32.4 KB

Benchmarks

Your new benchmark scorecard helps you focus on the right metrics to improve compared to similar experiences. At a high level, the key metrics to focus on are:

  1. Engagement: Average session time, D1 retention, D7 retention

  2. Monetization: Payer conversion rate, average revenue per paying user

  3. Acquisition: Qualified play through rate

For example, in the scorecard below, engagement (average session time and D1 retention) looks to be the problem. As a result, you may consider using funnel analytics to improve your onboarding funnel.

Your similar experience benchmarks are updated daily. Note that we do not use these benchmarks as a direct signal in our discovery algorithm. Instead, they’re meant to give you a point of comparison as you work on improving your engagement, monetization, and acquisition. Learn how discovery works.

1600×771 133 KB

Realtime

Your new realtime panel lets you view up-to-the-minute metrics like concurrent users, session time, client crash rate, and more. You can click “See more” to view more real-time metrics on your performance page.

789×1325 74.3 KB

Achievement

Last but not least, our new achievements panel highlights key metric milestones that you’ve reached over the past 6 months. Growing an experience takes dedication so don’t give up!

More insights coming soon

We’re working to bring you more useful insights on performance and other soon-to-be-announced products. Please let us know if you have any questions or suggestions in the comments.

Thank you.

140 Likes
What Does "Benchmark" Mean?
#2

This topic was automatically opened after 9 minutes.

#3

Nice!! It would be so cool if you could integrate custom analytics within Roblox creator page. Like you could go to the custom analytics page of your game, create an entry and within Roblox engine you could have a service like analytics service and a method a bit like this:

AnalyticsService:UpdateEntryAsync(entryName, value)

No need to implement custom mongo dbs etc…

26 Likes
#4

While this is nice and all, we still have not seen a successor to the visits developer stats nor even had a reason from Roblox as to why they were deprecated, despite being a well-used metric for developers to measure their games performance over time.

Its also dissapointing that most of the new analytics tools have such a huge limitation on time period, often not allowing us to see more than a month into the past, when it would be crucial for us to see the entire game’s timeline data to compare past performance with present performance.

23 Likes
#5

Great! I hope this will help us a lot, thank you! :slightly_smiling_face:

6 Likes
#6

These are some great improvements to an already-great page! It feels like there’s an update to analytics every other week, so thanks a lot to the team for their hard work here :smile:

Still patiently waiting on like/dislike stats :pray:

8 Likes
#7

Yeah, like I’m more interested in tracking gameplay-related data, like “Which gun has the most precision kills?” or “Which specialization class is chosen the most?” Metrics unique to each experience are critical for rebalancing scripts if there’s something under or overperforming. AAA studios like Bungie chart this out all the time for multiplayer sandbox tuning.

Which brings me to my next point: I’d love some way to graph all these analytics in-game. Some friends of mine are interested in a GUI we can present during meetings for investors, conventions, or post-mortem breakdowns. Some sort of API that can retrieve the latest stats and load it as an array of numbers and strings. I’ve seen some people here do neat things with graph visualizers, but a dedicated chart service could do wonders.

12 Likes
#8

So may you explain what does the 32nd, 35th, 50th, 90th means again?

Is something that always confuses me, same for other stats, when you choose 50th or 90th percentile for example, what does it actually mean?

7 Likes
#9

That feature isn’t that bad, to be honest. I’m looking forward to it.

7 Likes
#10

Good update. With a game I am working on releasing soon, improvements to analytics are absolutely critical to making sure I’m optimizing the game as much as possible! Good to see more improvements coming to the analytics features!

This is a big thing for developers ^.

8 Likes
#11

I think this is the best part of the entire update, so the developers can have the motivation to keep updating their games.

9 Likes
#12

If you are ranked 92-percentile, it means that you are better than 92%/Top 8% of the other experiences you are being compared against

Percentiles are also colour coded - Green=Good

11 Likes
#13

Thanks @XenoSynthesis! Spoiler: We’re actively working on custom analytics right now.

In the meantime, have you tried using our new event types to track and improve your onboarding funnel and in-game economy? Let us know if you have any questions!

10 Likes
#14

Thanks for the reply, so in the sample image provided, for example:
image

There is a 32, this means that game is better than 32% of the experiences is being compared to?

Also when are games started to be compared to similar experiences, right now the other stats in my game are comparing me to Top/All experiences instead of Similar.

7 Likes
#15

As someone with 0 players daily, I can confirm this is a great feature.

11 Likes
#16

This is great to hear. Hopefully this gets announced somewhat soon! It will help devs a lot. Looking forward to it’s official announcement!

8 Likes
#17

Correct, or the opposite, 68% of the experiences you are being compared to are doing better than you in this metric so you probably have a lot of things that you can do to improve in the short-term

This benchmark provides you knowledge of what’s possible and where you stand

This is dynamic based on player behaviour, when your similarity group changes you will see an annotation in your charts

6 Likes
#18

We launched similar experience benchmarks in June - see devforum post for more details. Benchmark scorecards use the same benchmarks on your graph. In your example, they both use all experiences benchmark because our model didn’t identify similar experiences for your experience yet.

5 Likes
#19

I’m also looking forward to using custom analytics. I’d appreciate if we could also be filtering regions using it. Such as being able to see all the countries that own “Green Paintball Gun” and how much, etc.
Just an example.

7 Likes
#20

Would love to be able to see a randomized basket of experiences that you are being compared against. Is it by genre, popularity on device, overall KPIs? It really doesn’t mean much if I am being compared against games that are monetized completely differently with an entirely different audience. A better breakdown of what goes into picking “similar experiences” at the very least would be better.

I say this as someone who owns a game relatively unique to Roblox so I am curious what would be considered similar.

6 Likes