Animate your Avatar with your movement

[Update] September 25, 2023


Hello Developers,

We’re building an immersive platform for communication and connection that has safety and civility at its foundation. Every day, 66 million people connect on Roblox to explore, learn, and tell stories together. Our vision is to enhance your social interactions while reflecting the real world and even going beyond it.

Use camera to animate your avatar with your movement

Starting today, we’re rolling out another new way for users to express themselves and communicate on Roblox. Any user 13 and older will now be able to use their camera to animate their avatar with their movement. This feature is part of a series of interactive features we have available so people can communicate and express themselves like never before – in the most natural, real-time, and immersive ways. In 2021, we started this rollout of communication features with the chat with voice beta, and most recently released lip sync.

How would I benefit from enabling camera input for my experience?

We are giving you the choice to enable immersive features in your experience that can drive deeper engagement with users. We know from the chat with voice beta that there is a positive relationship between experiences that have voice chat enabled and user engagement — voice users spend more time in those experiences. Similar to chat with voice, providing users with more ways to express themselves, like camera-enabled avatar animation, is expected to lead to richer, more engaging ways for them to interact with each other in experiences.

For users, why does Roblox ask for their consent to use their device camera?

In order to animate their avatar, users will need to consent to provide Roblox with temporary device camera access. Roblox does not record or store any of the information that is captured from a user’s device camera. For more information, please review Roblox’s Facial Animation Privacy Notice.

Is any of the data stored when users enable their camera?

No, we take your privacy seriously. When you use your camera to animate your avatar with your movement, animation keyframes created by this process are deleted in real-time after they have been used and cannot be shared. Video from your camera never leaves your device. Learn more here.

How do I enable this feature in my experience?

To enable this, both the experience and the user need to opt-in. Here is how to enable your users to animate their avatars using their camera in your experience:

  • Open your experience in Studio
  • Go to FileGame Settings
  • Navigate to the new Communication tab on the left side of the Game Settings screen.
  • There are toggles to Enable Microphone and Enable Camera. You need to toggle Enable Camera input so the selector turns from gray to green.*
  • Optional: For greater communication among users within your experience, you can also enable chat with voice by toggling the Enable Microphone option.

For more information on enabling microphone usage in your experience, please see here.

Testing

  1. In order to test this update, you will need to turn on the setting to “Use camera to animate your avatar with your movement” on your user account.

  2. This can be found in Account Settings > Privacy Tab

  3. Under Inputs, toggle the “Use camera to animate your avatar with your movement” setting

  4. Testing is available using ‘Team Test’ in Studio.

While this feature is available to all developers immediately, we are gradually rolling out access for users. You may find this feature not yet immediately available for your user account. Please be patient while we enable access for everyone.

For users, how does enabling their camera impact facial animation?

For users that enable their device camera and have a head equipped with facial animation, their avatar will mirror their facial expressions in real-time when interacting with other people or having fun on their own.

For more details on how a user can enable their camera input setting, please check out the Help FAQ.

How will users know if their avatar’s head supports animating their avatar with their movement?

In the Roblox app, a user can navigate to the Avatar page, and for either Customize or Marketplace, select Heads and Body. Under the Style section they will see heads that support facial animation.

For both Customize and Marketplace, the icon on the thumbnail, a winking face, lets them know the head supports facial animation. When a head that supports facial animation is equipped, they will see their character blinking and smiling.

Left to right: Facial animation icon & Head that supports facial animation

How will users find experiences that support camera-enabled avatar animation?

The Experience details section will inform users of experiences that support enhanced communication features. In the example below, the Communication section lists “Camera” letting users know that camera-enabled avatar animation is enabled in this experience.

Updates to the in experience UI

To enhance user control of both microphone and the new camera input within an experience, we are making some updates and additions to the in-experience UI and menu. When a user joins a camera-enabled experience, they will now have a camera button appear above their avatar’s head. If they join a microphone and camera-enabled experience and they have also enabled microphone and camera inputs, they will have both microphone and camera buttons appear above their avatar’s head.

Microphone and Camera Inputs for users

Users can turn their camera and microphone on or off independently. We’ve recently released lip sync, lip syncing creates facial animation in real-time by inferring the shapes a user’s mouth makes for specific sounds during speech. If a user turns on just the microphone input, their avatar’s mouth will lip sync based on their voice input. When a user enables their camera, their full facial expressions and head movements are matched by their avatar using information from their device camera.

Self View

When a user enables their device camera, it also automatically brings up a new Self View window showing the user’s avatar. Self View helps make it easy and fun for a user to see how their avatar’s facial animation reacts to their camera input in real-time. Self View automatically moves the mic and camera icons from above their avatar’s head to a shelf underneath the Self View window.

Self View is not required for a user to use their camera. It can be repositioned or closed by the user at any time (closing the window will re-enable the mic and camera icons above their avatar’s head).

Self View for users

Microphone and camera controls are also accessible to the user by tapping the Roblox menu icon on the upper left side of the screen. Across the top bar of the menu are controls to mute all, turn on and off camera and microphone inputs, and show/hide Self View.


We hope you enjoy seeing how this new and exciting way for users to express themselves leads to richer connections and conversations within your experiences.

If you have any feedback, please let us know in the comments. Thank you for your continued support!

335 Likes

This topic was automatically opened after 10 minutes.

This UI definitely needs to be reworked. It’s very large, and the rounded corners have different sizes. The two very different colours used also make it look worse.

I created this concept

Reworked Interface
Reworked Interface.rbxm (11.3 KB)

Rate my UI concept
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10

0 voters

Developers should be able to change the appearance of this UI, allowing us to convert the over-the-head interface to simple buttons in the top bar.
Topbar Buttons

236 Likes
  • Do you have any privacy concerns?
  • What will two friends playing side by side do in this situation? Detection problem is expected to occur?
  • Doesn’t look very good at detecting faces. Also, our facial expressions are not visible to other players?
106 Likes

I have been testing this for some hours now, there seems to be inconsistency for being able to use the feature.

When launching Roblox from the site the camera UI does not appear, when launching from the beta app it appears, now after some hours it does not appear at all, rendering me unable to use it.

Some hours before when it was showing, my face was not being detected as the character remained at a default expression even thought my camera was most definitely on and I was most definitely not smiling.

Yes I do have a dynamic head equipped, yes I did enable the feature from settings, yes I did make sure my camera was working (the light was on too).

88 Likes

This is probably just me but i think you guys should remove the “microphone and camera” bubble thingy and keep it in the menu instead. (Or make it an option, user and developer) :confused:

151 Likes

Seems interesting from a technical standpoint, but I don’t really know how practical this feature would be. But anyways, I do have a few questions:

  • How many people do you think will actively use this feature?
  • Are there any privacy concerns? (EDIT: answered in this post)
  • If people actively used this feature, would it cause any performance issues?
  • Is there a way for a player to choose to disable other players’ animations on their side (might be useful performance-wise or if they just don’t like it)?
  • Why did you choose to remove the default faces? If it were just to get people to use this feature, wouldn’t at least making their dynamic head equivalents free seem reasonable?
78 Likes

How will these changes affect animations being played by the developer for various interactions? Will camera generated animations have a different priority?

72 Likes

Can the bubble chat UI be disabled by developers? I feel like it would be a massive immersion breaker in my game, but I still want voice chat in it.

83 Likes

Is there a button to disable the camera and mic bubble? If not, please implement that. I absolutely hate it. It keeps getting in my way, and I constantly keep turning on my stuff by accident without realizing it.

103 Likes

It’s impressive how Roblox is fast at implementing features their investors/nobody asked for and take years to keep their promises to the community

This is a good addition for VR players/games meant to be VR-like, but nothing else

92 Likes

I think roblox is heading in the right direction in terms of immersion between real life and the game but they’re going about it the wrong way.

Privacy is the main issue here, with roblox being able to see the camera it opens up a lot of questions such as, are they only able to see center frame (being you infront of the camera) or just the entire view.

I know some systems have it in place where the camera and feed locks around the person infront of it, although this would be quite hard to program internally I feel it’d be a better way of securing privacy for players on the platform.

Aside from the privacy, I think roblox interface has improved ALOT over the years, from the leaderboard, to the menu, to the chat bar and TCS (Text Chat Service).

I feel this update will undermine all of the interface improvements and is going to drag the “clunky” stigma back from roblox’s old days.

If any of the developers from roblox who specialise in interface read this, please rework this UI above the players head and make the default setting and UI to toggle camera and microphone hidden in the back end and switched off by default, so users can actually choose to turn their camera on.

If roblox can find a way to improve and secure all of this, I feel like this would be an amazing update.

70 Likes

It’s great that people don’t need to be age verified to use this but the problem is that you still need to be age verified to use voice chat and without voice chat it looks weird. Is there any plan for voice chat (chat with voice) to roll out to 13+ non age verified users soon considering you don’t need to be age verified to use this.

69 Likes

I think they might be just reading your camera input, and processing it on the client, and then just sending the final positions and rotations to the server.

56 Likes

Ever since this feature released yesterday I’ve been completely unable to connect to voice on my PC. This never happened prior to this update.

Whenever I join a voice-enabled game I get a warning icon on my voice bubble and I’m unable to hear anyone.

P.S. Please make some of the icons on the new voice bubble easier to distinguish. I can barely even tell what they are.

image


EDIT: Voice seems to be working now.

76 Likes

Everything is accesible on the client, which opens up the potential for exploiters?

If people can view and read the data produced by the microphone and camera on their own client, and young developers produce insecure remote events that lock into this, is this really a secure system?

47 Likes

Can anyone find where these settings are?

EDIT: This is how it looks in game:

60 Likes

This is very exciting technology! I never would have thought roblox would be a game that involves your camera! I like this since it increases player immersion

54 Likes

Exploiters don’t have access to someone else’s computer, nor they have access to the server. Additionally, those inputs are only accessible to CoreScripts, not regular scripts.

61 Likes

I was testing this yesterday in a test game I made with both communications turned on. Only I can see my head and face features moving, but other players can’t see. All they see is the eye blinking normally.

42 Likes