In-Depth Information about Roblox's RemoteEvents, Instance Replication, and Physics Replication (w/ sources!)

Updated 8/21/2023 to clarify wording and add physics replication rate

Updated 2/28/2023 to correct terminology

Updated 10/27/2022 to reflect more accurate information

I hate the lack of centralized knowledge when it comes to things like how Roblox does networking, so I am going to do my best to share my knowledge with others when it comes to this.

Prerequisite Knowledge

  • Low-level networking knowledge (packets, ping)
  • networking reliability and ordering.
  • Roblox’s RemoteEvents
  • Throughput, bandwidth.

Just a bit of information to start off with: You can press Shift F3 and then Shift 1 to view more networking data.

Roblox does networking per frame- this means that networking is not handled instantly, but rather when a packet arrives, it’s deferred to the next frame. Most games use end-to-end latency when they show ping (csgo, Minecraft, etc.). It’s not RTT (round trip time).

Shift F3:
image
The ping you see in this image (62.56ms) is after processing delays- it factors in your framerate, pretty much. And yes, this means when the client/server drops below 60fps, ping will increase. It also means that using an FPS unlocker will decrease ping.

Shift F3 + Shift 1:
image
The ping you see in this image (25ms) is without processing delays in mind.


RemoteEvents

When you fire a RemoteEvent, the data you sent into the remote event is added to a queue. This queue gets emptied per frame, and all the data gets sent out. The Roblox client receives this information with a ~9-byte overhead. It is important to keep in mind that remote events are reliable, meaning that there are mechanisms in place to prevent packet loss.

It is also important to keep in mind that RemoteEvents, alongside a lot of other things, are ordered, meaning extra steps are taken to make sure that all important data (property changes too) is ordered and fired in the same order they were fired on the server.

Another important thing to keep in mind, that Roblox will throttle networking if you fire too many remote events too fast. I don’t know the metrics, but I have had it happen to me.

Invocation queue

There’s a queue for RemoteEvents when a RemoteEvent is fired, but there is no listener. This is a small queue, and it should not be relied upon as you can lose important data. It does drop remote events, and fast-firing events will fill this queue, dropping events.

Sources:
image
(quick note, while it does say it “doesn’t happen every frame” this is not my experience. I’ve taken microprofiler logs a lot, and it has happened every frame. so please keep that in mind. However at the same time, I may be wrong. )


Physics

Physics networking is unreliable and unordered, and it is replicated at 20hz. An important note is that physics is interpolated at 60hz. This means that it, under normal circumstances, has less latency than RemoteEvents. This also means that physics will not care about packet loss or the order of events that happen. It doesn’t have to. Part positions can come out of order, and packet loss doesn’t affect positioning much as the position is replicated per frame.

Another thing to keep in mind is that CFrames are expensive to set. You should avoid CFraming a lot of parts at once.

Physics data is also replicated: if you have a visual moving part on the client, not only will this be visually affected by unstable ping and whatnot, but it will also take up needless bandwidth.

As a quick footnote for this category, humanoids are expensive to replicate/use. You should always try to reduce the number of humanoids in your projects.

Instance Replication

Properties are not replicated from client/server network ownership, only physics data. This is extremely important to note. Only positional/directional data is transferred,

I haven’t found that much information on how instances are replicated, how much it impacts networking, and whatnot, but I would imagine that it takes a notable amount of data to replicate instances. So I would not recommend relying on Roblox instance replication for entire instances, as it could impact your game and make things worse on low-throughput players. I would recommend creating said parts on the client to save all the wasted data. For example:

-- Server
EffectsRemote:FireAllClients(position, "fireballEffect")

-- Client
EffectsRemote.OnClientEvent:Connect(function(position, effect)
     local Clone = EffectsFolder[effect]:Clone()
     Clone.Position = position
     Clone.Parent = workspace
end)

purely an example, I would not recommend taking from this.

Another noteworthy behavior of instance replication is the fact that only the most recent property value is replicated. This basically means that if you change a property 3 times in one frame, only the last value will be replicated.


A table that describes the amount of data it takes to replicate values (rough, potentially inaccurate):

Blank remote call: ~9 bytes

string: length + 2 bytes

boolean: 2 bytes
number: 9 bytes (IEEE-754 signed doubles)

table: 2 bytes -- (There is no overhead for table indexes)

EnumItem: 4 bytes

Instance: 4 bytes

Vector3: 13 bytes

CFrame (axis-aligned): 14 bytes
CFrame (random rotation, non-axis aligned): 20 bytes

(by Tomarty: ORE (One Remote Event) - #33 by Tomarty)

Another very important thing to note is that Roblox will halt all network traffic if a packet is lost. This is what causes ping spikes.
8/21/2023: Roblox seems to have improved this, unreliable data seems to not be stopped when a packet is dropped. not fully tested and inconsistent

Roblox uses RakNet (http://www.raknet.com/, GitHub - facebookarchive/RakNet: RakNet is a cross platform, open source, C++ networking engine for game programmers.) to manage networking, which implements reliability and ordering.

While your target for bandwidth should be completely relative to your player cap, I always try to get the client receive below 100 kbps and the client send below 20 kbps. Although, it completely depends on the game and the player cap for said game.

Thanks for reading! I hope this has helped you in some way.

96 Likes

Great community tutorial! I do have a question though.


However there are other comments like this that say it is not expensive. And modules that utilize CFrames mainly because of how inexpensive they are.


Could you clear this up? Are these completely different subjects and is unrelated to your topic? Sorry if they are, I’m just curious.

4 Likes

What zeux is referencing is time to set it. He is disregarding anything related to networking because that’s not the point of the post. He’s right in that it’s the fastest property to set, as it doesn’t trigger heavy code (re-rendering, clustering, all that) while other properties like transparency do. However, the CFrame-setting still has to get replicated across the client/server boundary, which takes bandwith up.

I’ll definitely clear this up, thanks for pointing it out!

5 Likes

Great read!

I wish Roblox would add unreliable and unordered remote types already. Networking is extremely limited as of now

6 Likes

This is something I really, really want! It’s extremely important, and I am disappointed that there’s only a few people pushing for it. Thanks for the compliment!

3 Likes

I really appreciate this post. Thank you

1 Like

Great post as always, this gives a clear vision of networking and performance which is certainly important for developers to be aware of. Also so Roblox can take notice of some of the flaws and technical problems they can reduce. Thumbs up!

1 Like

Thanks for the compliments! I’ve updated the post to remove some inaccurate information and add some more information I’ve picked up over time.

Great post learned a lot however I do have one question. I have been working on an obby game and wanted to create moving parts like tower of hell has them. The issue is that even with just one moving part it causes the whole server to lag.

So what I did was put the moving parts in replicated storage and move them to the workspace using a local script. The issue now is that I can’t make any moving kill parts because a local script can’t move a server script to the workspace. So kill parts just don’t work.

So how do you think tower of hell is able to make these moving kill parts that don’t lag the whole server out.

Your issue is probably that you’re manually setting the CFrame. Try using physics constraints to move the parts instead of setting it via script

I use hinge constraints to make the parts spin. Without using hinge constraints players wouldn’t be able to stand on a moving part it would just fly out from underneath them.

Updated this post to reflect more accurate information.

Can anyone add their experiences of Roblox packet loss and it’s interactions w/ networking? through my own testing, it hasn’t been consistent

1 Like

This has been added very recently.

2 Likes

Very insightful, thank you! I appreciate the time you put into this :grin: