How to get every gear with the Catalog API

[rick2809]

Hi Everyone! I need to get access to every gear with the API from the roblox catalog. There are many gears in catalog heaven that are not visible on the Roblox catalog Catalog Heaven - Roblox.

For example there is a golden football in catalog heaven

but not in catalog

We’ve already tried it with the normal v1 Roblox catalog API by fetching all the gear IDs including the off-sale gears, but we only got the ones that are visible from catalog, so we think catalog heaven gets access to them with a custom API or the catalog v2 API (Catalog Api).

[Forummer]

[NinjaFurfante07 (iKingNinja)]

https://catalog.roblox.com/v1/search/items?category=All&includeNotForSale=true&keyword=golden football&limit=120

The search endpoint is hidden on the documentation but you can find it by inspecting network traffic

[Forummer]

Catalog/Library search APIs are documented here.

[NinjaFurfante07 (iKingNinja)]

I was talking about this API documentation

[Forummer]

I know, I was just sharing its official documentation.

[Rae3504]

The golden football item does not appear in the response

I haven’t checked every single one but I’m pretty sure all of the items that URL gave back are on sale items.

[NinjaFurfante07 (iKingNinja)]

@NinjaFurfante07

https://catalog.roblox.com/v1/search/items?category=All&includeNotForSale=true&keyword=golden football&limit=120

The item may not be in the first returned page so you will need to move to the next page using the returned nextPageCursor value

https://catalog.roblox.com/v1/search/items?category=All&includeNotForSale=true&keyword=golden football&limit=120&cursor=returnedCursor

[Rae3504]

I can see that the golden football does indeed appear on the second page.

I had originally thought that the IncludeNotForSale parameter did not work on the Catalog v1 API but apparently it does (FYI I am working with the creator of this topic on this problem)

Regarding the title of the topic, as you are probably aware @NinjaFurfante07 the API will stop returning the nextPageCursor after 1000 items which makes you unable to simply get every single gear on the catalog

My plan was to search through each genre of gears separately (Naval, RPG etc), if I did this and then combined all my results together it should give me a list of all the gears (assuming there aren’t over 1000 gears in a single genre)

I put together a simple python script to scrape these IDs

https://catalog.roblox.com/v1/search/items?category=11&subcategory=5&includeNotForSale=true&limit=120&genres=6
(Genres = 6 is the Naval genre and checking all those IDs they are indeed part of the Naval genre so that part is working properly)

But when I perform these more precise searches, off-sale items are no longer showing for some reason, take this gear for example:

It is nowhere to be found on this list despite me including the IncludeNotForSale parameter.

Do you have any ideas as to why this is? Or should I be using a different url to do this?

[NinjaFurfante07 (iKingNinja)]

using this URI https://catalog.roblox.com/v1/search/items?category=Accessories&includeNotForSale=true&keyword=red%20pirate%20juice&limit=120&subcategory=Gear&genres=Naval i could receive the item in the JSON response, it only seems to work when a keyword is specified though. (Not saying that your query params values were wrong, my URI is the one that roblox uses)

[Rae3504]

Yeah so it seems it only shows the off-sale items when a keyword is specified, which is a bit of a bummer. It should show up in the first search that I made, the API is not working properly

[rick2809]

A workaround described here worked How I made Catalog Heaven. If you’re not familiar with it, Catalog… | by Seranok | Medium