Google seems to index DevForum posts incorrectly, encountering Human Verification on the DevForum:
In this example, the DevForum topic in the Bulletin Board called The Art Museum Information and Copyright Policies is not indexed correctly.
This may be an issue with the way that the DevForum blocks bots on the DevForum. The DevForum should be allowing Google web crawlers.
As shown on the Google Search, site:devforum.roblox.com human verification - Google Search, hundreds of DevForum pages are blocking Google Search from crawling them. Meanwhile, if Microsoft Bing is given the same query, it will not show these results (as of now).
Reproduction Steps:
- Search Google for site:devforum.roblox.com human verification
- Scroll down and click “view 8 omitted results”
- See hundreds of falsely indexed Human Verification results show up from the DevForum.
First Occurred: 8/16/2023, shown here
Last Occurred: 12/3/2023
Although the previous topic mentions that this error occurs when topics cannot be loaded, it may be an issue with the way the DevForum reacts to crawlers or the DevForum robots.txt. Plus, this error seems to only occur with the Google Web Crawlers, meaning that it is most likely unrelated to the error that occurs when the DevForum cannot load topics.
This topic is associated with a private message, visible to @Bug-Support.