Home recommendations conversion rate shows you the percent of users who play your experience after viewing it on Home recommendations.
You can see recent icon changes on this and other acquisition charts to see if they had an impact. Note that we only have icon update data since October 9, 2023.
You can filter by platform to see how this conversion rate changes.
Remember that your Home recommendations conversion rate is just one of many signals that drives the discovery of your experience. It’s also important to monitor if users stick around (Engagement and Retention) and invest in your experience (Monetization) using Insights and your other analytics pages.
Please see our documentation for more details on how discovery works on Roblox.
Focusing on new users on the acquisition page
We’ve also updated the rest of the page to show you new user data only for these charts:
Thumbnails will probably be difficult to analyze even if you’re given analytics for it. The reason being is because you can have several thumbnails, and as a result it becomes near impossible to pick which thumbnail contributed to the playercount. Even if one thumbnail is bad, you can still have several good thumbnails.
For thumbnails I recommend asking the game’s community and reaching outside of it for feedback. That will more likely be meaningful than analytics for thumbnails.
The UX for the dropdown boxes is a bit confusing - the box on the left lets you multi-select, whereas the box on the right does not. I think for best utility they should all be multi-select on all the dashboards!
It would be great if you could define “Home recommendations” more precisely. Does that refer to the “Recomended for you” sort only, or any impression on the Home page? Are the impressions in the “Continue”, “Sponsored”, and “Favorities” sorts counted? How about the Discover page, is that inexplicitly included in Home impressions?
Also, can pls shed light on what is a New User With Impression, and how can we get a new user without an impression. And if they did not actually play the game (since New Users With Play are shown separately) I would not call them “users” from the point of view of my game.
It is great that Analytics data tools are growing, but many of them are poorly defined or decsribed, so it is hard to grasp and work with.
The only place you see thumbnails would be on the game page itself.
I’m pretty sure the reason why they use icons here is because that’s one of the first things of your game a player would see (e.g. on the Home and Discover pages).
The image that shows the usage of icons in the data even says “Home”
These new analytics updates have been great! These help tons with understanding more about how our experience performs to others. To add onto these recent analytics updates, a personalized discover page or an improved recommendation page would help tons of getting our games to the correct audience, would allow for these analytics to be expanded more as well.
One issue I’m having with it right off the gate though is it only displays 1 icon per day.
Often times I will switch to an icon and then switch back (whether that be for an update or because the icon I switched to wasn’t performing the best).
This new system only indicates 1 per day (and it’s not even the latest one or the longest one set for the day).
This essentially makes it useless for me unless I set 1 icon in a given day and don’t touch it after that.
I took a look at Harbor Havoc and see multiple icons being shown for a 1 day change. So you will see the multiple icon annotations, but the metric itself is only calculated once per day.
wrt changing your icon multiple times per day, for many experiences you might not see a statistically significant change if you’re changing your icon every few hours.
Ohh, I may have misdiagnosed here, the problem I’m having is that the latest icon change shown doesn’t reflect the latest (on the example game you mentioned my latest change is a Thanksgiving icon rather than the current one which I’ve had set for weeks [I set it the same day I set the thanksgiving one])
Last Shown
Latest (Set the same day as the last shown one)
There are also occurrences like this one below, where I went:
Icon A [Original] - > Icon B [Test] (set for ~1hr) - > Switched back to Icon A
and the panel only displays the Icon B (not the revert to Icon A after)
This icon below was only set for a brief period (1hr or less) and then reverted, however the panel makes no indication of the reversion.
You can zoom into the chart by picking a time period doing a left click and then dragging to the right to zoom in even more in the case of multiple icons that overlap
Please see our documentation for definitions for each source (e.g., Home Recommendations, Friends, Search).
New users with impressions means they saw your experience icon and new users with plays means they played your experience. This data helps you monitor how your unique user conversion rate (plays / impressions) changes if you test different icons as an example.
I do agree we can make all this simpler so will discuss more with the team.
