Overview page benchmarks showcase inaccurate retention data

Despite the numbers for retention being correctly displayed on the overview page, the colored bar highlighting your percentile is pulling data from a different day. This issue only appears to occur on my newest experience (released 8 days ago) and I suspect this is due the lack of d7 data prior to yesterday resulting in any other day it attempts to pull from returning effectively 0 which is consistent with the 22nd percentile.

Expected behavior

The bar in the provided image should obviously be above the 90th percentile benchmark but falls short and is displayed as the 22nd.

Page URL: https://create.roblox.com/dashboard/creations/experiences/7955256018/overview

A private message is associated with this bug report

Greetings! Due to limitations on our end, the values used to compute the benchmark percentiles are slightly different from the values shown in the charts, therefore the percentile displayed is based on a D7 retention of 0%.

The difference is more obvious when the sample size is small. (In this case, your new users count on 7/7).

We’ll look into ways to improve this, but in the mean time this should resolve in tomorrow’s run. Apologies for the confusion!

1 Like

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.