Animate your Avatar with your movement

Yeah, that’s essentially right.
To clarify for anyone with privacy concerns, assuming that this feature is built like similar software (Vtuber software for instance), no camera footage is ever sent outside your own computer.

The workflow is basically this:

  1. Camera reads your face
  2. Local Roblox client converts camera footage into animation keyframes
  3. Animation keyframes are sent to the server
16 Likes

My privacy concern is more that if people’s cameras are always on, they won’t know if they are on for other reasons.
Though at that point there are other privacy concerns anyway.

8 Likes

Another observation - It currently doesn’t work in playsolo which is a pain for testing.
In the process of coming up with a hacky way of making it work on R6, and testing that without play solo is a pain.

10 Likes

I see no point in using this feature in a game.
Nobody needs it. And aesthetically it does not make you want to use it.

14 Likes

https://i.gyazo.com/b8e98728bfdb68109780e2901da5186b.mp4
Created a hacky method for it to work on R6. If I can do it in half an hour, why can’t Roblox.

I make no apologies, yall should be happy I didn’t rickroll you.

13 Likes

Roblox will show a red dot :red_circle: if the microphone is being used and a green dot :green_circle: if the camera is being used. Additionally platforms like Windows and MacOs will tell you if the Microphone, Camera, and Location are being used and what applications/services are using them.

MacOS Notice:

iOS Notice:

Windows Notice

Android: Android 12+ appears (according to some replies by ppl) to have a notice when the camera and microphone are being used, though other providers (like Samsung) also appear to have this notice.

Xbox: Has no such notice at least from a quick search online.
Playstation (when Roblox releases it): Also has no such notice at least from quick search online.
Quest 2: Also has no such notice at least from a quick search online

Roblox’s Noitces

15 Likes

The overwhelming majority of users are providing feedback about the UI of the bubble over your character looking out of place and annoying.

Roblox, now it’s your turn to fix the “bubble” design.

9 Likes

RELATIVELY* fast. they said dynamic heads (a pointless mEtAvErSe feature) would be finished “in 2024”. then theres the audio stuff (something that needs fixing), which will be sorted out in 3024.

11 Likes

Exactly, Roblox is master at putting priorities on things

And they also are great at making decisions, like making pointless things nobody asked for

This is still a good feature tho, it’s just not a priority

9 Likes

Although new avatar technologies, unlike TextChatService, are one feature that I strictly refuse to concede to enabling for my experiences (including my social interaction-heavy ones), I still have feedback - why is there more disruptive UI when using these features?

Give your developers tooling if you’re going to plow ahead with these features. We as developers should be able to customise the user interface as much as possible and be able to integrate communication technologies into our own interfaces or make them more intuitive if Roblox’s don’t cut it, such as displaying this information when hovering over another visitor’s avatars.

Developers who do want to adopt new communication technologies don’t have years to wait for Roblox to finally start respecting developer tooling on features that have CoreGui basis.

15 Likes

Thank you for the feedback on the UI. We will be following up soon to improve the mic and camera toggle designs.

We also hear your concerns regarding disabling the bubble toggles. For these privacy-sensitive features, we want to respect our users’ privacy and give them consistent and quick access to turn their microphone and cameras off. We are working on some upcoming changes that will eventually allow devs to disable the bubble toggles.

22 Likes

I believe a simple microphone next to the chat topbar button would do good. I’ll give an example in a minute.

11 Likes

My point was more that lots of OS don’t specify WHICH device is using your camera.
So if you have your camera on with Roblox, something else could be using your camera without your knowledge.
Windows does not consistently give notifications for it and said notifications are easy to disable.

But all of these hypothetical scenarios are generally ones where there’s already something compromised with your computer so…

10 Likes

We take privacy seriously and understand your concern. Your camera can only be used after you give Roblox permission in your account and on your device and even then the camera will only ever be active when you explicitly turn it on. When the Roblox client accesses your camera for this feature, your video is processed entirely on-device in real time and only used to detect and track your movements. No other information from the video feed is used and your video is never stored, shared with us, or accessible by us or anyone else. Only the resulting inferred animation data from your movement is sent to the server and other players. You can read more about facial animation privacy on Roblox here.

18 Likes

Please just put it in the top-right context menu (where we can toggle emotes, backpack, and the player list) or the now nonexistent top bar. For muting other players, why did you choose a chat bubble instead of the avatar context menu? I’m curious.

I have an Android 12 device that appears to show a green dot whenever the camera is in use. Many providers seem to offer that feature.

14 Likes

Have you guys benchmarked this feature internally to get a gauge on performance impact?

I think it is important for people to understand the implications of this feature on their battery life, as I am assuming its relatively computationally intensive which can be detrimental to mobile and laptop users who are battery constrained.

8 Likes

While the camera API is available to all developers immediately, we are gradually rolling out access for users. You may find this feature not yet immediately available for your user account. Please be patient while we enable access for everyone.

15 Likes

So first of all it is on all Android 12+ phones, there’s even a privacy dashboard wich show what apps used stuff such as camera or location and when they used it.

Then, Xbox also show if the camera/microphone is enabled, however i think it might only be for Kinect.

10 Likes

Didn’t realize that at first (my quick search for such information didn’t bring that up + my phone doesn’t support Android 12+ so I couldn’t check myself). But thanks for the information anyways! (Also thanks to SubtotalAnt8185 for telling me that information as well!)

If it is Kinect only, then it doesn’t really add much significance to the point, since the Kinect was a failure that most people only have because it was forced onto them.

13 Likes

Alright, thanks. Will it be rolling out for the next month? When can we expect to get access at the latest?

11 Likes