OpenCloudTools - Open Source Datastore/MessagingService Tools

I’m away travelling for christmas right now so I can’t help too much with debugging, but I have a guess.

Are you downloading and uploading to the same universe? If they are different, make sure your key has access to the new universe as well as the old one.

If that doesn’t help, can you post the full log from the failure? First go to “Preferences” and make sure “Less verbose bulk data operations” is not checked, then try the upload again and post the whole log. That should help me figure out which specific part of the upload is failing.

You’d be correct I believe. We switched groups, but kept the game. We have a ban datastore with many people and I’m trying to transfer it from the old group to the new one, which is under different universes yeah.

Yeah just had a look at the interface for making keys and it looks like this when you add a new universe. “Datastore Test” was the existing universe on that key and “Datastore Test Small” is the one I added.

So just putting a new universe on an existing key won’t copy over the existing permissions. You need to add the new universe and then add all of the permissions one-by-one to the new one.

Anyway to filter through the datastores with like a search bar or anything?

Not at the moment but I’ll look into adding it. You’ll still have to download the full list of datastores because the API doesn’t support searching, but after the whole list is downloaded filtering by name should be pretty doable.

I honestly didn’t think i would use this tool as often as i do. Thank you for making this!

My only slight caveat is that i can’t view ordered datastores (or at least I think I can’t)

This reply isnt very helpful but i just wanted to say I appreciate your work.
image

1 Like

Unfortunately ordered data stores aren’t available through the OpenCloud API yet. The Super Biz Data Store Editor has the same limitation. Hopefully Roblox adds this soon

1 Like

I do plan on supporting ordered datastores and hopefully even memorystores as soon as they are available through open cloud. Just waiting for that to happen :slight_smile:

1 Like

Do you know why it is, that whenever I attempt to do a bulk download, the ‘Downloading’ gets stuck? I only have 960 players, however, when I set the ‘filter’ to specific scope in the bulk download, it goes as far as 450 players or so, and then it seems to freeze in ‘Downloading’ status.

Is there anything I can do to make it download all 950 players?

Thank you.

Not sure what could cause that, sounds like the program is running into some sort of API error that it doesn’t know how to deal with.

If you can, make sure in the “Preferences” menu make sure you have the option “Less verbose bulk data operations” not selected and try the bulk download again. If it fails, copy the whole log output and send it to me in a DM. That should let me figure out where it is going wrong.

Another small new release is here. This one adds a 20 second timeout so requests can be retried even if no response is received and also adds the datastore name filter requested by @abcxomisgood which can be activated in the Preferences menu.

Download on Github

Win-Install is an installer containing both Qt5 and Qt6 versions of Open Cloud Tools.
Win-Qt6 is the build users of Windows 10 and newer should use.
Win-Qt5 is the build users of Windows 7 and 8 should use.
Mac supports recent versions of MacOS but I’m not actually sure which. To use the Mac version you must run xattr -cr /Applications/OpenCloudTools.app in the terminal after installing to make it runnable.

Changes:

  • Added an option to filter the list of datastore names
  • All http requests will now time out and resend after 20 seconds

Distribution changes:

  • Mac build now uses Qt 6.4.2
  • Windows Qt6 build now uses Qt 6.4.2
  • Windows Qt5 build now uses Qt 5.15.8

Hia, had a question for you! When all the USER id’s are enumerated, would be possible to save it to a file? That way you could skip the enumerating process entirely if it where to fail.

It aborted when it was just about to finish with a 503! Hitting the retry button did nothing sadly.

OpenCloudTools_ECxTBlEyLn

Sorry about that, looks like the cause is probably me not handling multiple errors in a row correctly. Any time you see a message that ends with “aborting” the retry button should work. Will look into this and hopefully get a fix out soon.

edit: Oops didn’t answer the other question.

The next step for improving how the download works would be to make it resumable like that, but it will take me some design work to get there. I need to make sure all of the relevant state that currently only lives in memory gets stored in sqlite database and updated accordingly as new stuff downloads.

I’ll see if I can get that together quickly or if it will take a bunch of work, offhand I’m not sure how simple the implementation will actually be. I’ll post an update here within a few days to either fix the 503 problem or let you know if it looks like I can get this added short-term.

1 Like

A new version is here again, now with resumable bulk downloads. If you stop a download or it gets interrupted for some reason, you can now just load the in-progress database into OpenCloudTools and it will resume downloading right where it left off.

Download on Github

Win-Install is an installer containing both Qt5 and Qt6 versions of Open Cloud Tools.
Win-Qt6 is the build users of Windows 10 and newer should use.
Win-Qt5 is the build users of Windows 7 and 8 should use.
Mac supports recent versions of MacOS but I’m not actually sure which. To use the Mac version you must run xattr -cr /Applications/OpenCloudTools.app in the terminal after installing to make it runnable.

Changes:

  • Bulk downloads can now be stopped and resumed later. See the bulk download documentation for details.

Lots of Open Cloud fun lately, looks like Asset Management and Ordered Datastore support was just added.

Will probably be working on supporting ordered datastores first because the interface for that will mostly just be copy of the existing datastore interface. Asset support will also be coming but I need to spend some time thinking about the UI for it.

This post is not just an excuse to bump the thread.

4 Likes

After over 2 months a new version is finally here. This one includes read-only support for Ordered Datastores. Support for writing to Ordered Datastores will be coming in the future but this release has already taken long enough.

Download on Github

Win-Install is an installer containing both Qt5 and Qt6 versions of Open Cloud Tools.
Win-Qt6 is the build users of Windows 10 and newer should use.
Win-Qt5 is the build users of Windows 7 and 8 should use.
Mac supports recent versions of MacOS but I’m not actually sure which. To use the Mac version you must run xattr -cr /Applications/OpenCloudTools.app in the terminal after installing to make it runnable.

Big features:

  • New ‘Ordered Datastore’ tab allows you to view information about your game’s Ordered Datastores. This is currently read-only and cannot edit Ordered Datastores. Editing functionality will be added in the future.

Changes:

  • Add ‘global’ placeholder text to all ‘scope’ fields. This is not a change in behavior, just clarification that an empty input will act the same as ‘global’.
  • Fix some universe-level settings not applying properly when switching universes within a single API key.
  • Reordered Standard Datastore results columns to match Ordered Datastore.

Distribution changes:

  • SQLite upgraded to version 3.42.0
  • Qt 5 upgraded to 5.15.9
  • Qt 6 upgraded to 6.5.1
1 Like

is this can make you get banned or something?

Shouldn’t be, this uses the Open Cloud API that Roblox specifically made to allow for this. I’ve personally been using it for a year with no trouble.

1 Like

hello, ahy cluet why this won’t work?

I believe that is the error that comes up from not having enough permissions. Make sure that for the API key you are using, the permissions section looks like this:

That is:

  • Messaging Service API is listed
  • The universe you want to send a message to is listed
  • If you click the button to copy the universe id, it should match the one you put into OpenCloudTools1
  • ‘Publish’ is listed as a supported operation