Introducing in-experience Mesh & Image APIs [Studio Beta]

[kevyn1020]

Really cool but it seems to think I got my Vector2s from wallmart:

[idelww]

whooo trackmania!
jokes aside, i’m very excited to try this out myself very soon! good work!

[CRASHER_ZD111 (MrCrashGoesBoom)]

We’ve had 6 Updates in 1 day… That’s just Crazy, Amazing, and Exciting at the same time.

[xKiiyoko (Kiiyoko)]

Awesome! just ported the quick 3D renderer I made to use editable images. I can’t state how cool this is.
(real time btw)

[HKcat5100 (HKcat)]

.Blend blend shapes
What do you guys think?

[cyn0x8 (cyn)]

shaderlike behavior in roblox
its beautiful

[AirtonGamer_Ytpro]

Man! i have been waiting for those APIs for so long now i can finally do things in real-time, I can’t be more happy!

The best Roblox update by far!

Although i have a question does EditableMesh support Gpu Instancing?

[MrChickenRocket]

LETS GOOOO!

Can we please please please get an API for instantiating an editable image from a viewport frame, or from a canvasGroup perhaps?

You already have the texture data there…

[TheRealANDRO (ANDRO)]

Roblox news accounts are trembling in happiness as we got 4 updates in one day. Truly one of the greatest moments of all time.

Aside from that, I’ve been waiting on this update for a long time now, thank you so much! However, I got a few questions about Image moderation and EditableImages:

• Will it automatically go through moderation when replication occurs? (For example, if I copy the EditableImage instance to the Workspace, it automatically sends the image to moderation? Or do you have to call an API like it is in the filtering system?)
• Will we ever get an API or a way to get image data from existing Images without converting them into an EditableImage? Or from ViewportFrames/CanvasGroups?

[ckdevver (CKDEV)]

This is one of the features I’ve wanted to come to Roblox for almost 8 years now, so it’s awesome that it’s finally here! One thing I’ve noticed while developing my little demo of this feature is that there appear to be memory leaks, which would cause Roblox Studio to slowly consume more and more memory as I developed it. For example, here’s after generating a few meshes, unloading that place and going to an empty baseplate, and a fresh studio instance on an empty baseplate. This did reach the point where it started to force my computer to begin page swapping which wasn’t great, hehe.

[TheGamer101]

@C_Corpze

Can we use editable images to paint onto meshes with very complex shapes, curves and with many UV islands and still get good-looking results?

For a game where a user could paint their entire car or for a paintball game you’d ideally want the images to be able to wrap around surfaces and completely encapsulate a mesh and not have paint jobs appear cut-off or cause pixels bleeding onto other parts of the mesh.

In the initial version of this, just raycasting and getting UVs from the EditableMesh won’t give you ideal results if you are painting something with a very complex UV map. This is especially true if you want to add a decal to something with a complicated UV map. Internally we have been working on a projection painting implementation that projects each individual pixel on to the texture based on the geometry of the Mesh and the UV map. This will hopefully be available early next year.

@C_Corpze

Will we be able to read pixel colors of existing non-editable images?

Would love being able to raycast onto a part and just read it’s material or decal pixel colors.
This can also be useful for games where you have toxic sludge or lava that spills on the floor and you want to raycast for green or orange pixels to deal damage to players that walk on it.

The main problem with this is that the information required to do this is not available for all textures. On the server, we never download any textures (except when you create an EditableImage). On some platforms, we download compressed versions of textures from the backend which we never decompress on the CPU side so the information isn’t easily available (especially in a scalable way).

[TheGamer101]

@MrChickenRocket

Can we please please please get an API for instantiating an editable image from a viewport frame, or from a canvasGroup perhaps?

You already have the texture data there…

The main reason why we haven’t already done this is because we also want to be able to support this use case on the server. This is necessary to make sure we are building it in a way that will allow for future replication and publishing use cases.

But I promise you we are thinking about it! (and we already have some very cool demos )

[DanTDM_Rocks999 (Dan)]

I have been waiting for months for this day…
Every week I would look at the API changelogs and read about DynamicMeshes, and how they would eventually be renamed to EditableMeshes.

And now, it’s finally here. I can’t stress how many things you can make with the ability to edit on-runtime.

YES!!!

[Shamplify (Shamplift)]

Would direct vertex manipulation perform better than manipulating a grid of bones on a large plane? I am working with skinned mesh oceans and am very curious if this would be a practical use case for EditableMeshes.

The mesh in question:

[bay30]

Regarding editable images can we please have a way to take a screenshot and then map it to a editable image.

[habahaba9]

Didn’t see this specifically mentioned but, will the 1024x1024 size limit on EditableImages be increased in the future?

[proudCdthekitten (temmie)]

please let us be able to union meshes PLEASE

[shadowflame63 (MiniiMann)]

You could make a mesh union system using this tech, might be complex and for proper use you’d have to wait for some of the limitations to be lifted, but having access to all the mesh data such as vertices means you could calculate union operations.

[ATPStorages (Cat)]

@FGmm_r2

local newImage = Instance.new(“EditableImage”)

YES YES YES WOOHOOOOO!!! WE’VE BEEN WAITING FOR ALMOST 6 YEARS!! THANK YOU!

[Ethanthegrand14 (Ethanthegrand)]

You have no idea how happy I am. We can now finally make pixel-based renderers/game engines within roblox!

I can now have a real-time raycaster engine casually running around 140FPS at 240x240 pixels

Real-time 3D Textured Raycaster Engine in Roblox | CanvasDraw Tech Demo #5