As a plugin developer and consumer, it’s currently very difficult to get an accurate grasp on a plugin’s true ratings because the create.roblox.com page currently clamps the values to specific ‘milestone’ increments.
For example: Below you’ll see the plugin rating for Moon Animator 2 on the old plugin page. As you can see, the plugin has over 27k total ratings.
However, the endpoint on the create.roblox.com site clamps to the ‘milestone’, and when calculating ratings, only considers it to have 10k
Now for big plugins like that it doesn’t exactly make too much of a difference; however let’s look at the following plugin.
This plugin has 382 reviews, with a total rating of 79.85%
On the create page however, it’s only taking into account 100 votes, giving it a rating of 62%
As you can imagine, an 18% discrepancy from 62% to 80% could make it difficult for consumers to make an informed decision when determining to purchase a plugin or not.
Hey, thanks for posting! The ratings in Studio and on create.roblox.com/store now reflect more accurate rating counts. The new score take into account more signals to ensure we are representing accurate feedback from real users of the assets. We’ll continue improving the new Creator Store website to make it easier for creators to determine which assets to use
Thanks for the response! Can I just get more clarification on this part?
The ratings in Studio and on create.roblox.com/store now reflect more accurate rating counts.
I’m unsure if you’re saying this was a mistake and has been corrected, or if you’re ensuring me the discrepancy I’ve noticed in the ‘total review’ numbers and the actual displayed percentage is intentional.
Good question, the discrepancy is intentional. The accurate rating count that should be used is the one on create.roblox.com/store. I know this is confusing, but since we’ve migrated off the library page for Creator Store assets, in the long run this discrepancy shouldn’t be visible anymore and users will only see the more accurate count on the Creator Store.
Will you plan to add an info tooltip near the review giving more insight on how the reviews are calculated?
It might be a little confusing seeing a plugin with thousands of downloads and over 3x the reviews it shows, and doesn’t expand on “most recent 100 reviews” or “updates percentage every 500 reviews”
If not, do you mind adding that here?
Edit: One of the things confusing me is why one of the plugins in my example has nearly 400 reviews, and only 100 are calculated. Just curious what numbers it clamps to, and why.
We take into account safety signals that help us ensure we are representing accurate feedback from real users of the assets instead of any spam from less reliable sources. Unfortunately, I can’t give more info without compromising the trustworthiness of our ratings system since bad actors would take advantage of any info given
