Studio was able to be run offline until around 2018. You could easily use a 2016 studio without internet access today.
They were loaded into memory since they were cached.
I remember that as well, and a few updates later you were unable to start studio offline. This brings me to think that maybe single player games would benefit if Roblox added an install option for a game which would Play Solo on your computer, since they can be used offline.