[Resource] RbxHttpService - Async HTTP requests with built-in batching for Roblox

Resources Community Resources
1

Hey everyone!

I built and am releasing RbxHttpService, a free open-source HTTP client
module for Roblox that makes working with external APIs much easier.

Roblox’s default HttpService is barebones, it’s synchronous and hits
rate limits fast if you’re firing a lot of requests. RbxHttpService fixes
that with async coroutine handling and automatic request batching built in.

What it does

  • Async requests via coroutines — the thread suspends and resumes
    automatically, no callbacks needed
  • Automatic request batching to stay comfortably under Roblox’s
    500 requests/minute limit
  • Simple drop-in API — just call RequestAsync and get your response back

Source code:

Feedback and contributions are welcome!

5 Likes
2

If you have questions you want to personally ask me, my discord username is @string.sub

3

Does this work on top of HttpService? I’ve been looking for ways to do free unlimited web scraping, to pull web results and stuff like that in pure luau. Do you have any suggestions? Very cool module though (I’ll be using it).

4

Can you give me an example? Like as in like fetching body’s and what not or long pooling? can you abbrviate?

1 Like
5

Also Read the Github repository Readme aswell so you understand how to use it, and I suggest going to configurations it’s under the module’s helpers folder and then change the configuration as you will ofc but also, change the MAX_BATCH_SIZE accordingly. What that does it tells the batcher when to start flushing requests early

6

By default you’ll be going through my backend so I will mabye add rate limits sense I’m only on the free tier if enough people are using this of course but we’ll see.

I’m also considering making it so you can have discord intergrations through this module aswell
but also if you want to make the limits to your own desire Make your own cloudlfare worker as pleased, the source code for mine is here: RbxHttpService/Cloudflare/rbxhttpservice-relay/src/worker.js at main · requestint/RbxHttpService · GitHub

You could add serveral workers also as you please sense You just put string values in an array in the configuration called “CloudFlareWorkers”

7

Like say I wanted to fetch data from: Apple - Wikipedia. That’s what web scraping is. Getting data from a website. However with traditional httpservice, you’re not allowed to get data from a direct url.

8

Never done Web Scraping before so I wouldn’t have an exact Idea, Only thing I done mabye remotely close was getting data from something like github’s api page and constantly looking for new information via long pooling but In my case it was a blank js container page which a discord bot would post to and I’d constantly wait for information on it. What happens exactly when you do it with traditional HttpService:GetAsync() / RequestAsync’s GET Method?

9

You get an error, since roblox has set places you can access. You can access API’s (via api keys), and a small amount of websites that I’ve never touched.

10

Never realized roblox has limited sites you can request too. When you mention it I never had that issue, why do you think they limit you from reaching certain websites?

1 Like
11

Safety issues from Http. Anybody can get dangerous or explicit content via the expansive, never ending internet. So I guess it would make sense to limit it, but it’s a huge downside to devs.

12

Well mabye I can find a way around it. Gimme some sites you want to be able to request to.

1 Like