Diving into Generative AI

Can the AI understand how wood grain works to get rid of bad wood grain in-games?

24 Likes

Reviewing the video over and over again, as well as the blog, both are absolutely incredible! It is the first time that Roblox is going to have a powerful artificial intelligent being available for creators.

For those that are understanding Roblox and/or creating experiences, but don’t know how to apply their own ideas, this is a great start to analyse the Generative AI and get the powering imagination all the way up! :bulb: I personally see this upcoming feature pretty good, flexible, and save time while developing.

As there are two AI tools available (for both to generate codes and materials), this quite brought my attention and made me curious to know if some day, we are going to have more specialised to especificy things such as generate unique skyboxes and weapons, and create environments while using available packs of Roblox:

@AndroidYouth Very, but very curious to know if we are going to have further tools available at Roblox Studio! :telescope: :astonished:

4 Likes

I think thsi is a pretty bad update, but if it’s used in the right camps it can be useful, I would use it for the tasks taht are almost impossible for me to do:
Creating materials, I’m still trying to figura out how you do thsi…
Generating an effectively good terrain BASE
Getting ideas/getting a base for a Game idea
Maybe doing LOW-LEVEL scripting/maybe building

But if they keep updating it (and trust me, they will) thsi is just soemhtign very bad, as this will make (i dotn want to list everything again look at my previous posts for my opinion)

1 Like

Heya @Dede_4242,

I took the opportunity to see a few of your replies a little bit above as the rest are a bit lost in the reply section, making a puzzle to locate all… Yet, don’t worry, I got the context!

Roblox is going to keep updating indeed the tools in order to make them more flexible and capable to comprehend how you can use them in functional ways, and sure enough, can hurt developers and their jobs. If we take this into a historical moment, we are going to experience the same thing as the population during the industrial revolution.

However, the thing is that AI, while being a format to easily help everyone, it won’t pass from the knowledge of humans in the context of providing masterpieces and ordinary methods of ideas you can create, such as a development of a game, book, film, etc. I see AIs as just to help you with the little basics and/or simply answer all your questions based on FAQs that people do consistently, but not looking into the realistic perspective of us.

Overall, this is just my opinion. Everyone has their own thoughts about it and we should respect them. :+1:

8 Likes

Roadmap, you say? I am excited to see it.

Tbh I see a lot of people extrapolating the whole AI thing, spreading fear, gatekeeping and making it look worse than it might be.
New technology always comes with a set of pros and cons.
Lots of people are so pessimistic, but I understand that fear of the unknown is a natural response.

I mean, I’m a independent 3D artist and programmer. According to others I can be replaced and should be worried about my future but quite frankly… I’m not.

Before I start worrying and fearing, I first see where this whole thing is going.
Look at it with a more open-mind, try to see the pros and cons rather than just looking at the cons.
Look at the applications and use cases, dig a bit deeper into it’s inner workings and what it does under the hood.

But keep your head cool, do a little bit of research, watch some videos on it.
The future may not be as dark and grim as you may think.

I really recommend this video by Benn Jordan.
After watching it I got a lot less worried about it, and the bit of knowledge and experience I already have with AI and machine learning (I did experiments in Python, read lots of papers and I sometimes design stuff) allowed me to understand things much better.

Anyways, take care and stay safe out there people. I hope this helps a bit.

4 Likes

At first I was like why such a background and you would accept to work for Roblox of all things. Then I realized that you’re the new Head of Studio Engineering which changes everything. I’ve noticed that studio has been getting some interesting updates lately, maybe because of you?! I really hope that you’re able to change the course of this platform because I recently switched to Unreal Engine after 5 years of Roblox Studio and I do not regret it a single bit.

Yes, AI autocompletion and materials are amazing, but it would be much better if you can also improve the way materials are imported as well as add a mesh editor for vertex adjustments without the need to reimport the entire thing (yes, I know how many problems this will cause because of the mesh asset system). One feature I’ve been craving for a long time is render layer clipping, what this means is for example a boat is in the water and the water looks like it’s in the boat. With render layer clipping you can make that water in the boat look like it’s invisible as if the boat displaced it similar to how UI clipping works.

2 Likes

This is just amazing. I’m sure this can easily replace ChatGPT in Roblox.

This is the best update Roblox Studio will have done in my opinion! I’m really excited to use this for fun and for my game. Though, I’ve got some questions.

  1. Is it going to be able to make good and modern UIs?
  2. Will it be able to make large or medium sized systems based on scripting?
  3. Will it be able to make a whole map or just small buildings?

Most important question for me is: When is it going to be released?

Finally, based on what @tomsterBG said, are you and your team going to make the UI creation system more advanced? I think the UI system needs an update.

1 Like

To any scripters wondering, you aren’t gonna lose your job any time soon.

Employers will expect you to learn this feature and create more scripts with the same amount of work for the same amount of pay, that’s economics.

How is a non-scripter going to organize and structure the generated code?

And in 20 years, when your job might be fully replaced, you must learn to adapt.

Mail marketers became digital markers. That’s adaptation.

4 Likes

While I understand this feature’s potential I believe there’s more ways it can go wrong than it can go right, the platform will end up being saturated with content that is very similar due to AI’s very nature, while beginner developers will find it much easier to create experiences using AI there won’t be any incentive to develop various sets of transferable skills valuable in the industry, why learn to 3D model when you can enter a prompt and call it a day? It’s already difficult enough to transfer one’s experience on Roblox to other game engines or even be taken seriously as a developer given Roblox’s reputation as a breeding ground for cash grabs and rampant poor professional practice. The inevitable overreliance on AI for the execution of even menial tasks will turn Roblox into a closed ecosystem in the game dev industry.

AI is chaotic, we’ve all seen how the results of AI generation have a particular unmistakable look that give the result’s origins away and also mess up fine details, the overall quality of the platform’s games will decrease with time and so will the number of games that are visually unique. AI also sparks debate on the nature of ownership and copyright, and we all know about Roblox’s dismal enforcment of copyright.

AI should be nothing more than a learning tool, an interactive helper to people who wish to enter the industry to any extent, I do see its potential in attenuating the sharp, often daunting learning curve that comes with learning a new skill.

1 Like

While I do think the Generative Ai may be a decent thing to add, I don’t think ROBLOX should be investing their resources into what it looks like is just internet trends. I am 100% sure that if Chat GPT and Stable Diffusion never became a public thing, then those Generative Ai features would have also never been implemented otherwise. I also don’t believe that this sort of ai will just “unleash the creative potential of this community”. The ai itself cannot just make games more better or creative, all it can do is just try to understand and generate a piece of code based on your input that may or may not be 100% stable (I am 100% sure that what ROBLOX offers and would offer would be way more stable/reliable than anything Chat GPT could produce my itself but the point still stands). All the ai will realistically do is just accelerate (maybe even) the workflow of more experienced developers and for the people that aren’t experienced at all? They will most likely just make half coherent experiences with seemingly a combination of random scripts and code, if these people don’t know any game development then i can’t expect any sort of ai to just magically make them “unleash the creative potential”.

Also sadly i cannot believe that those are actually just “high-value” areas at all. Seems to me like just this is all the Ai designed to generate images and text are like the most wide spread, easiest to use and free unlike any other current audio, mesh, vfx, etc… sort of ai. Stable diffusion runs on almost practically anything that is a gpu (not integrated) and was made in at least 7 years and still be able to generate an image within seconds. Chat GPT just by the nature that its just text, should be able to run alone on even more hardware. My point being with this one is this is all tech that almost everyone can already use because again, its all widely available (stable diffusion even has sites dedicated to sharing different models made by other people), its all easy to use and its all free, unlike again, any other asset type with ai’s designed for said asset. Also this may be a more dumb response but I don’t see many developers actually worrying or carrying too much about really custom textures. Maybe you can make the argument about coding/programming sure, but for materials not really. Like most developers just make their games still using the standard material kit roblox uses, maybe at BEST sometimes a few might use a handful of textures they got either from the marketplace or some other third party site. Witch also makes me question of how much “high-value” those fields actually are, or if there was just simply no better excuse to say that image and text generation are the only popular things right now, or if those two are the only widely and free available ai models.

I think that ROBLOX should more focus into investing time, people and resources into optimizing the entire engine, fixing issues with the engine (c’mon man even after closing roblox and studio, half the time they still remain active in the background unless closed via task manager. And you sure bet that they keep wasting pc resources too), making the engine less restrictive, and adding more features that to like any other 3D game engine would be considered something basic or maybe even the “bare minimum”, one example would be Shaders, maybe even let developers access a players system storage in order to store temporary assets on their own systems instead, could be used for a lot of performance benefits. But that’s what I think at least.

3 Likes

I think in the future it probably will, users will just have to have a idea and then ask AI to make it.

2 Likes

It’s funny how these people have to disagree, feels so good.

1 Like

Looks like good update, but I have 1 question: will we be able to use it for clever NPC’s dialogues?

1 Like

I’ve been working heavily with chatGPT and copilot since they came out.
They are multipliers - they make what I can already do faster and more efficient - like having an extra pair of hands when putting together ikea furniture.
They’re also excellent teachers - and can make you much better at what you do.

Eventually, programming itself is going to get replaced with AI prompting, but while things are still made out of code and models, there is no fear of AI replacing anything.

3 Likes

Some of you have to stop worrying about AI taking your job, at least for now. It’s impressive tech, sure, but look at the human input it relies on and think logically. At its current stage, it appears that it lacks the ability to understand pre-existing systems and work with them directly. Look at the video Roblox posted and see the examples. If it doesn’t understand how your game already works and how it is built, then what good is it going to do? You can see, for example, that when they ask it to make some weather effects, it’s clear it doesn’t really bother to think about networking or integrating with other systems (e.g., rainy weather affecting car movement and being synced across all clients). In terms of the material generation I saw, that is pretty impressive too, but I still definitely wouldn’t take it over an actual artist’s work as it just seems sub-par right now.

3 Likes

Honestly, Chad is right.
A.I isn’t some dark magic machine that takes lead and turns it into gold. Would A.I be able to do most of dev work at some point? Yea, Definitely. Would it replace anyone? Of course not.

ChatGPT took a year just for its training phase (meaning a year to run it on a single iteration).
And considering the size and complexity of the model, It’s not something that could really create new ideas.

But that’s not the point I’m trying to make. What I’m wondering now, After reading all of this, Is about the big picture of AI. Will we ever see the light of being able to create deep neural networks ourselves?

And before ANYONE comes up and says “that requires a lot of computing power”. Even if we have the option to load in the weights from somewhere else and just apply them to the model in roblox it won’t require as much computation power.

You want to see the power of imagination? That’s the way to do it.
so? @AndroidYouth

3 Likes

I don’t think this is powering imagination, as it’s not you that create the thing, t but the AI “Yes btu you give the prompt to the AI” yes but its still the AI that does the work, and as we’ve seen from ChatGPT what it can create isn’t even working 50% of the time, I think if it would be better if you could use it as a teacher or something like that, so people effectively know how the code works and don’t make the AI do everything for them

1 Like

I think that you missed the point I was making entirely. When I say “AI for powering imagination”, By no means am I coming here asking roblox to create their own ChatGPT as It’s absurd to think that they would put the resources into such a thing.

What I AM trying to say is that giving more tools to work in CREATING AI. More specifically for Dialogues, NPC interaction and maybe even enemy AI? There are libraries on the platform that do put some general idea but it will never be as optimized as what roblox can release as they literally develop the platform.

2 Likes