Yeah, that’s essentially right.
To clarify for anyone with privacy concerns, assuming that this feature is built like similar software (Vtuber software for instance), no camera footage is ever sent outside your own computer.
The workflow is basically this:
Camera reads your face
Local Roblox client converts camera footage into animation keyframes
My privacy concern is more that if people’s cameras are always on, they won’t know if they are on for other reasons.
Though at that point there are other privacy concerns anyway.
Another observation - It currently doesn’t work in playsolo which is a pain for testing.
In the process of coming up with a hacky way of making it work on R6, and testing that without play solo is a pain.
Roblox will show a red dot if the microphone is being used and a green dot if the camera is being used. Additionally platforms like Windows and MacOs will tell you if the Microphone, Camera, and Location are being used and what applications/services are using them.
Android: Android 12+ appears (according to some replies by ppl) to have a notice when the camera and microphone are being used, though other providers (like Samsung) also appear to have this notice.
Xbox: Has no such notice at least from a quick search online.
Playstation (when Roblox releases it): Also has no such notice at least from quick search online.
Quest 2: Also has no such notice at least from a quick search online
RELATIVELY* fast. they said dynamic heads (a pointless mEtAvErSe feature) would be finished “in 2024”. then theres the audio stuff (something that needs fixing), which will be sorted out in 3024.
Although new avatar technologies, unlike TextChatService, are one feature that I strictly refuse to concede to enabling for my experiences (including my social interaction-heavy ones), I still have feedback - why is there more disruptive UI when using these features?
Give your developers tooling if you’re going to plow ahead with these features. We as developers should be able to customise the user interface as much as possible and be able to integrate communication technologies into our own interfaces or make them more intuitive if Roblox’s don’t cut it, such as displaying this information when hovering over another visitor’s avatars.
Developers who do want to adopt new communication technologies don’t have years to wait for Roblox to finally start respecting developer tooling on features that have CoreGui basis.
Thank you for the feedback on the UI. We will be following up soon to improve the mic and camera toggle designs.
We also hear your concerns regarding disabling the bubble toggles. For these privacy-sensitive features, we want to respect our users’ privacy and give them consistent and quick access to turn their microphone and cameras off. We are working on some upcoming changes that will eventually allow devs to disable the bubble toggles.
My point was more that lots of OS don’t specify WHICH device is using your camera.
So if you have your camera on with Roblox, something else could be using your camera without your knowledge.
Windows does not consistently give notifications for it and said notifications are easy to disable.
But all of these hypothetical scenarios are generally ones where there’s already something compromised with your computer so…
We take privacy seriously and understand your concern. Your camera can only be used after you give Roblox permission in your account and on your device and even then the camera will only ever be active when you explicitly turn it on. When the Roblox client accesses your camera for this feature, your video is processed entirely on-device in real time and only used to detect and track your movements. No other information from the video feed is used and your video is never stored, shared with us, or accessible by us or anyone else. Only the resulting inferred animation data from your movement is sent to the server and other players. You can read more about facial animation privacy on Roblox here.
Please just put it in the top-right context menu (where we can toggle emotes, backpack, and the player list) or the now nonexistent top bar. For muting other players, why did you choose a chat bubble instead of the avatar context menu? I’m curious.
I have an Android 12 device that appears to show a green dot whenever the camera is in use. Many providers seem to offer that feature.
Have you guys benchmarked this feature internally to get a gauge on performance impact?
I think it is important for people to understand the implications of this feature on their battery life, as I am assuming its relatively computationally intensive which can be detrimental to mobile and laptop users who are battery constrained.
While the camera API is available to all developers immediately, we are gradually rolling out access for users. You may find this feature not yet immediately available for your user account. Please be patient while we enable access for everyone.
So first of all it is on all Android 12+ phones, there’s even a privacy dashboard wich show what apps used stuff such as camera or location and when they used it.
Then, Xbox also show if the camera/microphone is enabled, however i think it might only be for Kinect.
Didn’t realize that at first (my quick search for such information didn’t bring that up + my phone doesn’t support Android 12+ so I couldn’t check myself). But thanks for the information anyways! (Also thanks to SubtotalAnt8185 for telling me that information as well!)
If it is Kinect only, then it doesn’t really add much significance to the point, since the Kinect was a failure that most people only have because it was forced onto them.