Analytics Inconsistencies & Significant Algorithm Bug?

Bug Reports Creator Hub (create.roblox.com) Bugs
1

This is one of my first few posts. Let me know if I’m doing anything incorrectly! :slight_smile:

When looking at home recommendation impressions from “Unique users with impressions by source”, you will notice there is a mismatch compared to “Users with home recommendation impressions”.

Steps:

  • Click the Acquisition tab for a game’s analytics
  • Look at Home Recommendation impressions from: Unique users with impressions by source
  • Next, click “Home Recommendations” at the top
  • Look at: Users with home recommendation impressions
  • Compare the two impressions from each source, and you will notice an inconsistency. This has happened on ALL of my games. Incorrect data?

image
image720×538 33.8 KB

image
image718×545 52.4 KB

Expected behavior

I expect the reported data on Unique users with impressions by source for Home Recommendations to be consistent with Users with home recommendation impressions. This is not the case.

Page URL: https://create.roblox.com/dashboard/creations/experiences/6243984455/analytics/acquisition?tab=homeRecommendations

A private message is associated with this bug report

2

If you look closely at the metric names, these are different metrics

  1. Users with Home Recommendation Impressions is NOT unique, the same user seeing the same metric 4x is counted 4x
  2. Unique Users with Impressions for Home Recommendations only shows unique users the same user being shown an impression 4x is counted as 1
3

Thank you! I appreciate the clarification.

Could you take a look at the private message associated with this post?
I have over 500M visits under my belt, and yet, I am still stumped with that one. There seem to be odd inconsistencies with the recommendation algorithm.

Once again, thanks!