OpenCloudTools - Open Source Datastore/MessagingService Tools

First I should say that this ended up taking longer than I expected so I’ve switched over to working on Memory Store support first, so there will still be a memorystore-compatible version with the older interface. Hopefully will be ready in no more than a week at this point.

Most of it will be staying exactly the same, the big change is that instead of having the universe drop-down on top and then tabs under it, those will both get combined into a single list on the left that lists all of your universes and the different tools available under them. The gui for each individual tab will also be separated into its own subwindow, so you can have more than one up at once.

It is still only half-implemented but here is my mspaint concept.

Edit: Should add the subwindows will also have a title that shows which universe they are for so you don’t accidentally mix them up.

4 Likes

Looking good! I already like the UX, but I think it could be even better with the new tweaks. :sunglasses:
By the way, have you seen the new Open Cloud update? You can read more about the devforum post here.

With this update, it’s now possible to create Data Store snapshots. The new CreateUniverseSnapshot endpoint is available on Open Cloud, and you can find the details in the documentation here.

Could this be integrated of somesort inside the tool?

I’ll look at getting that into the next release, looks like it should be pretty easy to add.

My current plan is:

  • There is a new release right now, more on that below.
  • Next release should happen within 2 or 3 weeks, it will include the datastore snapshot thing as well as more memory store support. This will still use the old GUI.
  • At some point following that the new GUI will be ready, more on that eventually.

Latest release: Release Release 2024.08.11 · jlwitthuhn/OpenCloudTools · GitHub

This release brings partial support for Memory Store Sorted Maps, read-only for now. More will come in the next version.

Changelog:

Big features:
- Added support for reading from a memory store sorted map. More memory store functionality will be coming in the future.

Changes:
- Increased default window size to better support the amount of data available in memory stores.
5 Likes

Hey is there any news on the update? :smiley:

New release today, but the only new feature is Datastore snapshotting. This one also has an important fix for a mac-only bug that made it impossible to close some dialogs.

Win-Install is an installer containing both Qt5 and Qt6 versions of Open Cloud Tools.
Win-Qt6 is the build users of Windows 10 and newer should use.
Win-Qt5 is the build users of Windows 7 and 8 should use.
Mac supports recent versions of MacOS but I’m not actually sure which. To use the Mac version you must run xattr -cr /Applications/OpenCloudTools.app in the terminal after installing to make it runnable.

Features:

  • Added support for datastore snapshots.

Bug fixes:

  • Fixed some dialogs that were impossible to close on MacOS.
  • Several internal changes to better support the upcoming new GUI.

Next priorities for me are still more memory store stuff and the new gui. Not sure when I’ll have it done, though.

1 Like

Hey, is the bulk data download supposed to save the file as a .sqlite3? i need this data to transfer over to firebase and i don’t know how to convert it.

I see it looks like you got an answer in that other thread. I would also recommend the python interface if you want to manipulate the format of that data. I don’t know exactly what firebase expects so I can’t help you too much there.

If you’re feeling more adventurous you can also build sqlite yourself and use the C API but python would be much simpler since sqlite support is already built-in.

2 Likes

Can I use this plugin to download a full game’s Datastore and save it to my disk as backup, and whenever I need to retrieve it, upload it to roblox?

I support this idea. It would also be really cool if we could do actions on entire data stores such as deleting all entries.

1 Like

Yes, you can! You can also delete all entries, as @FlikterIsLinked mentioned he wanted to do. It’s just gonna take very very long if you have 1000+ entries lol.

1 Like

Hi! Thank you so much for this. I’d also like to ask if there’s a way to bulk download datastores with specific names? For example, I want to download datastores that includes the name “PlayerInventory” only. I don’t want to download everything that I do not need. I would like to know if that’s possible at the moment. Thanks!

As you can see, I am using datastore2 so there would be lots of datastores. I don’t want to download all entries that has the word “PlayerEquippedItems”. The numbers you see are the player’s user ID and I can’t hide it manually because there’s a lot. Please help. :frowning:

image

Hey @Skrateboard
I’m not sure if you’ve seen this new change that was introduced for Roblox groups.

It introduces some new opencloud api additions.

Post: Introducing Roblox Communities
"
Open Cloud API Updates

  • New Open Cloud endpoints to automatically assign a member’s role and update their membership in your community.
    "


Could this be added to OpenCloudsTools at some point?

Multiple Errors when trying to launch. I have tried just the standalone Qt6 and the WinInstall.

image
image
image
image

Hey all, wasn’t watching this thread for a month or so, so I fell behind on responding. I’ll reply to the people who still have open questions one-by-one in some follow-up posts so they all individually get a notification rather than doing it all in one post.

Also, I wanted to say that I’m just about ready with the new GUI and should have a beta version out by this weekend. As far as I know everything should work exactly the same as the old version but I’m calling the first one a beta just in case something ends up broken.

Not possible at the moment but I can look into adding that. Right now the whole datastore browsing interface is really built around the idea that you will have a smaller number of datastores with per-player keys in each rather than creating a separate datastore for each player.

This will take some thinking on how I need to make the interface work for that, so I probably won’t have it particularly soon but I’ll add that to my todo list.

Like the above post I can check this out but right now the interface is very much structured around managing places rather than groups. The actual work to implement the API itself won’t be much but building an interface to support it will be the hard part.

That said, it looks like Roblox will be adding more ‘things’ you can manage other than universes so this is something I will need to address at some point. This one will be first on my list for suppoting managing non-universe stuff. Realistically I won’t be able to get to it until some time early next year probably.

Looks like I messed up the pre-built packages for Qt6 in the latest release. Right now you can either use the previous version or select the Qt5 version in the installer. I’ll have a fixed version out in a day or two so that doesn’t happen anymore.

Thanks for reporting the problem.

Thanks! I’ll just wait for you to fix it :slight_smile:

A new version is now available. This has minimal changes from the previous release but importantly it fixes the windows qt6 build.

Important: This will likely be the last release using the current GUI. The first release with the new GUI will be made available soon.

Bug fixes:

  • Fixed being unable to edit the details of a universe.
  • Other miscelaneous internal changes to better support new GUI, which is currently inactive.

Distribution changes:

  • Fixed Windows Qt6 build so it actually runs.
  • Windows Qt5 upgraded to 5.15.16
  • Windows Qt6 upgraded to 6.8.1
  • Mac Qt6 downgraded to 6.5.3 (from 6.6.3)
    • This is the last LTS release which supports MacOS 11, which is my build machine’s OS. Reverted from 6.6 because it will not be receiving any further support patches and 6.5 will.

Versions:
Win-Install is an installer containing both Qt5 and Qt6 versions of Open Cloud Tools.
Win-Qt6 is the build users of Windows 10 and newer should use.
Win-Qt5 is the build users of Windows 7 and 8 should use.
Mac supports MacOS 11 and newer. To use the Mac version you must run xattr -cr /Applications/OpenCloudTools.app in the terminal after installing to make it runnable.e’s OS. Reverted from 6.6 because it will not be receiving any further support patches and 6.5 will.

1 Like