Diving into Generative AI

looks great, just wonder about the limits.

As someone who’s been personally experimenting with ChatGPT to help create code, I can say this could be a cool idea for people learning how to code. In my experience, I’ve realized that I still need knowledge on coding for this, so I can tell it what to do. Trying to do things on a whim doesn’t go far.

I’d love to know where is the AI getting the data from? For example the scripting-AI from where does it get the code? Same for the material generation.

Is it taking the data from the DevForum or popular games?

One thing I just realized that would make this very useful is if AI can be used within the an experience during runtime. Now I’ve already mentioned generating stories and natural speech in a previous post of mine, however another useful feature would be image interpolation. This would be useful for many things, including animation. It would also be useful for uploading videos to Roblox as a video could have half of its frames removed, and then generated back with AI. I think these more technical uses for AI would be far more useful than typical ChatGPT usage (outside of natural language, as that will be useful regardless).

I think you’re referring to something like Flowframes or DAIN, RIFE, etc. AI used for video interpolation, typically to smoothen frame rates, restore old camera footage or cut off render time in 3D animations since interpolation is sometimes cheaper than rendering highly complex raytraced scenes many times.

That’s exactly what I’m referring to (and I’m totally not writing this because I just saw a video about it and currently downloading it to see what it can do). However, as useful as that is, that’s all done in post. I want to see this done in runtime so that it can have the benefits that AI gives in gaming. AI generating frames is a huge one, I don’t think anyone would complain about an instant 2x in their framerate if their device supports the AI. It would also help with developer-made things, as well as reduce the cost of things like video.

One big reason I’d want this is because of something like my Gif UI element, which would greatly benefit from AI interpolation during run-time, depending on how Roblox would implement it. It would mean that fewer frames would be needed for the same result.

1 Like

Currently I don’t think using AI to double framerates is doable.

Right now it has no awareness of timing or key frames and rendering 3D graphics is actually faster than interpolating a few frames so right now it’s more useful for restoring camera footage and interpolating pre-rendered 3D animation with raytracing involved.

But I’m excited to see what’s next, you never know with how fast tech is going. Maybe one day AI-enhanced framerates will be a thing.

Some TVs already do this when watching movies although sometimes results in slightly messed up timing (especially for cartoons and stop-motion), for gaming it currently just gives too much input lag.

For games it doesn’t really make sense to go one frame back to interpolate when the next frame already exists.

This is gonna be an interesting update.

Could you explain this a bit more? I see AI interpolation working great in games like Cyberpunk 2077 using DLSS. There’s also another solution that doesn’t require AI at all, and I’m not actually sure why all games don’t use it.

1 Like

This is great! I could definitely see myself using this to generate Materials or make simple scripts that would normally take about a minute or two. Very excited to see where this goes.

If they ever do this they are most likely to use the code they made, so there’s no copyright etc.

Yes, it seems very hard, but what I meant with they will use their own code, is that they will probably use code that is form them directly, which has (hopefully) no errors, and as they made the language, shouldn’t

Also one problem with this is that as @Roblox is always updating their code, the AI will always need to be updated, which makes it actually a bad use for Programming

No, they have the code they have in the Documentation and that they written, and the AI looks at it and learns

Mostly because they are always updating their code, this the AI has to rewrite its code

But for materials it can be a good idea

Yeah, but idk.
It could be useful for materials, but its still a complicated process.

1 Like

Well, for that there’s no need to create an AI, there’s Plug-Ins for that…

Man. Imagine AI recreate Minecraft.

No, imagine AI creating Mass Effect 5

Hi again! But what if AI just recreate GTA. Also do I have to pay Robux or real money to have this AI? Do I have to pay at all?

Well, GTA isn’t very good now-a-days, only online, AI would probably create it offline, if it’s smart, that would be good

Hi again!