DevForum Human Verification Interfering with Google Crawl Bots

Forum Help Forum Bugs
#1

Duplicate Post Posted by Bug-Support-Ignore

Google seems to index DevForum posts incorrectly, encountering Human Verification on the DevForum:

image

In this example, the DevForum topic in the Bulletin Board called The Art Museum Information and Copyright Policies is not indexed correctly.

This may be an issue with the way that the DevForum blocks bots on the DevForum. The DevForum should be allowing Google web crawlers.

As shown on the Google Search, site:devforum.roblox.com human verification - Google Search, hundreds of DevForum pages are blocking Google Search from crawling them. Meanwhile, if Microsoft Bing is given the same query, it will not show these results (as of now).

Reproduction Steps:

  1. Search Google for site:devforum.roblox.com human verification
  2. Scroll down and click “view 8 omitted results”
  3. See hundreds of falsely indexed Human Verification results show up from the DevForum.

First Occurred: October 2023
Last Occurred: 12/3/2023

1 Like
#2

Duplicate of DevForum Human Verification Interfering with Google Crawl Bots

#3
#4