OpenCloudTools - Open Source Datastore/MessagingService Tools

Lots of Open Cloud fun lately, looks like Asset Management and Ordered Datastore support was just added.

Will probably be working on supporting ordered datastores first because the interface for that will mostly just be copy of the existing datastore interface. Asset support will also be coming but I need to spend some time thinking about the UI for it.

This post is not just an excuse to bump the thread.

4 Likes

After over 2 months a new version is finally here. This one includes read-only support for Ordered Datastores. Support for writing to Ordered Datastores will be coming in the future but this release has already taken long enough.

Download on Github

Win-Install is an installer containing both Qt5 and Qt6 versions of Open Cloud Tools.
Win-Qt6 is the build users of Windows 10 and newer should use.
Win-Qt5 is the build users of Windows 7 and 8 should use.
Mac supports recent versions of MacOS but I’m not actually sure which. To use the Mac version you must run xattr -cr /Applications/OpenCloudTools.app in the terminal after installing to make it runnable.

Big features:

  • New ‘Ordered Datastore’ tab allows you to view information about your game’s Ordered Datastores. This is currently read-only and cannot edit Ordered Datastores. Editing functionality will be added in the future.

Changes:

  • Add ‘global’ placeholder text to all ‘scope’ fields. This is not a change in behavior, just clarification that an empty input will act the same as ‘global’.
  • Fix some universe-level settings not applying properly when switching universes within a single API key.
  • Reordered Standard Datastore results columns to match Ordered Datastore.

Distribution changes:

  • SQLite upgraded to version 3.42.0
  • Qt 5 upgraded to 5.15.9
  • Qt 6 upgraded to 6.5.1
1 Like

is this can make you get banned or something?

Shouldn’t be, this uses the Open Cloud API that Roblox specifically made to allow for this. I’ve personally been using it for a year with no trouble.

1 Like

hello, ahy cluet why this won’t work?

I believe that is the error that comes up from not having enough permissions. Make sure that for the API key you are using, the permissions section looks like this:

That is:

  • Messaging Service API is listed
  • The universe you want to send a message to is listed
  • If you click the button to copy the universe id, it should match the one you put into OpenCloudTools1
  • ‘Publish’ is listed as a supported operation

Hey @Skrateboard, hate to necrobump this topic. But I’m curious if you’ve had a chance in the last 10 months to take a look into Asset Management :eyes: :stuck_out_tongue:

Currently overhauling game data and assets!

Hey, just saw this message now.

So far I don’t have a good plan for assets but it is something I’m considering adding now if it would be useful somehow. The thing I need to understand to make it work well to is know why you’re looking to handle assets in a tool like this rather than just doing it in Studio. What are the shortcomings of the Studio interface that make you want something else? Is it just for being able to let people upload based on API keys you can hand out or more than that?

In other news, I have been very slowly working on a new release that I hope to have ready soon. If I get it done by tomorrow I’ll hit my goal of technically less than a year between updates. This one is focused on cleaning up the interface in a few places as well as rounding out support for interacting with ordered datastores (and also fixing reading from them because Roblox changed the API :upside_down_face:). Expect more details soon.

2 Likes

Thanks so much for your response.

We were overhauling our game experience from one group to another - which presented the issue of asset transfer for asset textures that were originally uploaded to the first group (from multiple people/sources). For a couple hundred textures, we were hoping to export them out of Roblox (via your plugin) and reimport them via tarmac (as that was our new preferred format of asset management).

I realized pretty quickly after making that post that we could do this on our own! So not a problem at all! But thanks for your response - and this tool - really appreciate you!

1 Like

Finally, after just over a year a new release is ready. This one is focused on completing support for Ordered Datastores but it also has a few other improvements.

Win-Install is an installer containing both Qt5 and Qt6 versions of Open Cloud Tools.
Win-Qt6 is the build users of Windows 10 and newer should use.
Win-Qt5 is the build users of Windows 7 and 8 should use.
Mac supports recent versions of MacOS but I’m not actually sure which. To use the Mac version you must run xattr -cr /Applications/OpenCloudTools.app in the terminal after installing to make it runnable.

Big features:

  • Added support for creating, incrementing, modifying, and deleting ordered datastore entries.
  • Added button to automatically fetch universe name based on ID.

Changes:

  • Fixed failure to list contents of ordered datastores after the API changed.
  • Fixed being unable to rename API keys.
  • Added more tooltips to explain functionality.
  • Improved ‘in progress’ messaging for most API calls.
  • Miscellaneous UI cleanup.

Distribution changes:

  • Qt 5 upgraded to 5.15.14
  • Qt 6 upgraded to 6.6.3
3 Likes

when are you planning on adding memory store service support?

Working on it now but I’m not sure how long exactly it will take. Right now my attention is split between that and re-working the interface to be less cluttered with the increasing number of APIs that are being added.

Not sure which will be ready first, but I’d guess probably a few weeks until I can release a version with memory store support.

1 Like

Excited for this!
Will the interface have a major change, Or small changes?

First I should say that this ended up taking longer than I expected so I’ve switched over to working on Memory Store support first, so there will still be a memorystore-compatible version with the older interface. Hopefully will be ready in no more than a week at this point.

Most of it will be staying exactly the same, the big change is that instead of having the universe drop-down on top and then tabs under it, those will both get combined into a single list on the left that lists all of your universes and the different tools available under them. The gui for each individual tab will also be separated into its own subwindow, so you can have more than one up at once.

It is still only half-implemented but here is my mspaint concept.

Edit: Should add the subwindows will also have a title that shows which universe they are for so you don’t accidentally mix them up.

4 Likes

Looking good! I already like the UX, but I think it could be even better with the new tweaks. :sunglasses:
By the way, have you seen the new Open Cloud update? You can read more about the devforum post here.

With this update, it’s now possible to create Data Store snapshots. The new CreateUniverseSnapshot endpoint is available on Open Cloud, and you can find the details in the documentation here.

Could this be integrated of somesort inside the tool?

I’ll look at getting that into the next release, looks like it should be pretty easy to add.

My current plan is:

  • There is a new release right now, more on that below.
  • Next release should happen within 2 or 3 weeks, it will include the datastore snapshot thing as well as more memory store support. This will still use the old GUI.
  • At some point following that the new GUI will be ready, more on that eventually.

Latest release: Release Release 2024.08.11 · jlwitthuhn/OpenCloudTools · GitHub

This release brings partial support for Memory Store Sorted Maps, read-only for now. More will come in the next version.

Changelog:

Big features:
- Added support for reading from a memory store sorted map. More memory store functionality will be coming in the future.

Changes:
- Increased default window size to better support the amount of data available in memory stores.
5 Likes

Hey is there any news on the update? :smiley:

New release today, but the only new feature is Datastore snapshotting. This one also has an important fix for a mac-only bug that made it impossible to close some dialogs.

Win-Install is an installer containing both Qt5 and Qt6 versions of Open Cloud Tools.
Win-Qt6 is the build users of Windows 10 and newer should use.
Win-Qt5 is the build users of Windows 7 and 8 should use.
Mac supports recent versions of MacOS but I’m not actually sure which. To use the Mac version you must run xattr -cr /Applications/OpenCloudTools.app in the terminal after installing to make it runnable.

Features:

  • Added support for datastore snapshots.

Bug fixes:

  • Fixed some dialogs that were impossible to close on MacOS.
  • Several internal changes to better support the upcoming new GUI.

Next priorities for me are still more memory store stuff and the new gui. Not sure when I’ll have it done, though.

1 Like

Hey, is the bulk data download supposed to save the file as a .sqlite3? i need this data to transfer over to firebase and i don’t know how to convert it.

I see it looks like you got an answer in that other thread. I would also recommend the python interface if you want to manipulate the format of that data. I don’t know exactly what firebase expects so I can’t help you too much there.

If you’re feeling more adventurous you can also build sqlite yourself and use the C API but python would be much simpler since sqlite support is already built-in.