Data stores started returning "502 invalid universe"

[EncodedLua (Juniper)]

I pushed a hotfix to our production game a few minutes ago and after migrating the servers seemed to be working fine. About 10 minutes later I went to check player counts and they had plummeted. Joining the game and looking at the server log showed me this for every single data store call

Was this a botched FFlag of some sort? I need confirmation that this wasn’t from something I changed on the developer side.

UPDATE: this is still ongoing as of 12:40pm CT.

Universe ID: 11765402359

More context: we are not abusing the rate limits of the data store API per this chart

[cKolmos (Viento)]

we’re having the same problem out of the blue; it happens on the Production place but not on the Test place, beign the 2 places copies

[ReiKonoe (ReiKo)]

Hi! Datastore is working now?
We had a moment of panic just now.

[KnightGaladeld]

Urgent Game Breaking Bug - InvalidUniverse

Thank you for the bug report. Our engineering team is actively investigating. If your experience is impacted please share the following information: Experience Link Time the issue started What action you took before the issue started Error Logs

[EncodedLua (Juniper)]

Data stores seem to be working in new servers for us! I can’t tell if they’re working in old servers that were broken, but I ended up going through and manually shutting them down.

[SrWildernessXplorer]

Hi All,

Our team has rolled back the change that caused this issue. This issue is now fully resolved.

SrWildernessXplorer