I’ve been receiving a large influx of server crashes lately in my game, particularly in the subplace average plate gaem - Roblox. I have no in-depth traces of the crashes, or error logs that could relate to the crashes. The crashes typically occur in servers that have been running for several hours (ranging from 2 to 16 hours). When the server crashes, all players/physics freeze, and players are met with the following error:
The crashes has added a lot of friction to players and have resulted in multiple instances of data loss.
These crashes have still been occurring since *October 1. It has become impossible to find the root of these crashes. However they can be identified through a dip in CCU; for example:
Multiple users reported another crash in the subplace just 5 minutes ago (October 15 22:52 PDT). This can be seen represented by the following CCU chart:
The crashes are not occurring on the client. The servers themselves are crashing, causing everyone in the server to disconnect so unfortunately I do not have access to log or dump files of servers.
If there is anything else I can do, let me know. The most recently tracked crash was on November 5 at 20:16 PST
This is an ongoing issue and must be resolved. It can’t be an issue with memory because I’ve made automatic shutdown systems after a certain threshold is met. Any information regarding the source of the crashing or what I can do to prevent the crashing would be greatly appreciated.
We have recently released a pathfinding fix that appears to have resolved the crashes in your game. Could you please confirm if your players are still experiencing this issue?
We are actively looking into this issue. It looks like the crash rate significantly decreased since November, but we are still seeing several out of memory instances.
I don’t think your are doing anything wrong, the error is likely on our side.
But would you mind providing a short description of how you are using pathfinding service?
Are you using multiple agent settings or is it always the same configuration?
@colmidy can you confirm whether you are still seeing an issue with these latest fixes and let us know how this experience is using pathfinding (@portenio’s questions above)? Thank you!
I am still experiencing crashing issues in my game.
No idea why these are occurring; the servers can’t seem to stay up for more than 5 minutes. This is extremely detrimental to my game’s playerbase.
My game does not use pathfinding, but clients have been experiencing extremely high memory usage (it quickly climbs past 2000 MB) and crashing nonetheless. I have optimized scripts to the best of my ability, and have confirmed that all scripts run at < 2% (via Script Performance).
While the game has a sum total of 34,957 instances, the client has access to only about 4,583 (2,969 of which are stored in ReplicatedStorage). 21,241 of these instances are parts belonging to maps (which are stored in ServerStorage).
Would love any and all help on this game-breaking issue.
Hi @rezrift , from our logs it seems the server is getting overloaded with memory consumed by these instances at the runtime. You could use Stats | Documentation - Roblox Creator Hub to get real-time performance information about the running game instances.
Thank you! It ended up being a bug with our datastore system - we were using a folder hierarchy & duplicating it/filling in objects that could be referenced by the client. This put a large strain on the replication service, causing the servers to crash as people piled in.
