Expanding Assistant to Modify Place Content [Beta]

this is a great feature that will the Assistant better and more useful !

6 Likes

i agree but i think eventually it will be able to make entire games. that’s the direction we’re going, it can already make code, change things in the game world, and generate textures and materials. the thing is, the industry is moving forward whether we like it or not because ai is a powerful new technology. if roblox doesnt implement it, some other platform will and then would have a good chance of becoming bigger than roblox. so honestly theres really no ignoring it. its kind of like when iphones starting getting big screens. steve jobs thought all iphones should be small and usuable with one hand, but the industry had to move forward or apple would fall behind, now all phones are big

9 Likes

Oh my god, I love this. So many things will go much faster and look much better because of this! I really, REALLY look forward to seeing what people might do with this

5 Likes

It’s more like they use chatgpt’s API to find tune either gpt-3.5-turbo or gpt-4 but most likely gpt-3.5-turbo

Roblox most likely uses OpenAI to do the dirty work of running the AI as running a custom llama model requires a lot of resources and a lot of A100 or T100 nivida server gpus working in unison.

Roblox most likely doesn’t have these resources even though that they are a multi billion dollar company.

The training dataset when open sourced could leak a lot of games’s source code

5 Likes

not only is it a waste of time, it’s incentivizing the laziness of beginner devs
instead of learning to code, an awesome skill that helps you in a lot of ways, beginners now feel inclined to simply abuse this integrated gpt chat because it feels more efficient
I really hope roblox learns their lesson about AI and eventually shifts their priorities to something more important (there are lots of things fellow devs would love to have, AI is not one of them).

6 Likes

They for sure aren’t using gpt-3.5-turbo, that model is pretty much depreciated and replaced by 4o-mini. The reason I am pretty sure it uses a llama model is on the Assistant located on the docs site it previously used to state that the model was powered by Llama and Llama models have been mentioned in Roblox blog posts and by David Baszucki.

There are plenty of cloud providers who will host your custom models for you on their hardware.

It’s already open source:

6 Likes

They spent some money on a proprietary model and forced us to let them harvest our development data

If this is innovation, I’m gonna make the switch to Godot or UE5 lol

7 Likes

Damn, I do already have experience in this field as I used to train and run generative AI models.

Also that completion can give context but diving through the dataset, some of the data given is kinda bad data and can confuse the AI, as transformer models perform better with better context, this could be why there are issues with Roblox’s assistant models

6 Likes

what LLM does this use?

strong text

3 Likes

Llama V3 by Meta, meta-llama/Meta-Llama-3-8B · Hugging Face

6 Likes

I haven’t used the assistant much in the past but this is amazing for the workflow of developers, especially builders. Looks very useful. Thank you for this feature!

5 Likes

This is super useful for selecting lots of parts and changing their color. Simple and sometimes even tedious tasks. But for anything that is complex you must be very very very specific with it which is super annoying. Overall cool update.

4 Likes

what a beautiful dataset.

oh my god
edit:

5 Likes

ye that’s what im saying because i think this might the most ugly dataset i have ever seen on huggingface.

roblox was lazy and just took all random comments from random code to get it to work

no wonder the assistant is as bad as it is

6 Likes

i can see why you would think that way, but you can turn off ai training on your games

go to https://create.roblox.com/settings/data-collection?tab=experiences
then scroll down and turn off this setting:

but its not the worst. personally i think this will be useful to me, but i will do most things in my game myself because thats the fun part, but say for example i make new palm trees and i want to replace all existing palm trees with my new models, this would be a good way to do that

5 Likes

it looks pretty interesting

Surely I Will use it

4 Likes

oh I had no idea you could opt out, thanks!

this could be useful, true, but integrating an AI assistant for simple commands isn’t what roblox is aiming to do, they want you to be able to automate anything, including large-scale systems.

5 Likes

Wonderful job. This is the type of stuff that AI should be automating for us, and makes our lives a lot easier.

Much better to type a few lines of text than to spend 20 minutes figuring out a solution for a problem that would’ve taken 5 minutes in the first place :joy:.

Great change.

9 Likes

This is a very smart application of LLM code writing. I often find myself writing code to do repetitive and/or tedious operations around studio, so it’s very cool to see this doing it automatically.

A lot of the code I write is for common tasks, but not common enough for to bloat the studio interface with it, so it’s pretty interesting to have stuff like this behind a text prompt that can describe any number of operations.


currently, the Assistant does not have direct access to your DataModel. Therefore, it’s essential to provide it with the necessary context. Assistant does not know the contents and hierarchy of your workspace

I don’t think it has access to what the actual models are, so the code it generated probably had to look at the bounding boxes and placed the stuff based only on that. Still surprisingly good though, it would have taken a long time to be that chaotic manually :sweat_smile:

12 Likes

Not sure if this is just for the example, but there’s no reason why this shouldn’t be undo-able.

4 Likes