Thanks guys for all the tips! Update on this:
We implemented a remote event to track bots based on this thread → Place botting explanation & ways to combat it
We detected bots for about 20.4% of our visits each day for the three days we tracked. And looking at a number of those player profiles, quite a few were only created on the day the player played our game.
This is pretty scary. Now it does feel like our game was dislike botted. Not too sure how to fix our ratings tho…