How do I use Facial Recognition/Camera Input to move the player's camera?

Help and Feedback Scripting Support
,
1

This is not the same as VR head tracking
My racing game does not use characters, and I would like to use this:

image
image564×184 11.3 KB

so that the game’s camera moves around based on where the player’s IRL head is facing. This would be useful for a first person cockpit camera where it could detect your head moving left, and actually move your game camera slightly left to see other cars for example.

2

I am not able to go through and do all the math/specific implementation this may require for you at this time, but I can point you in the correct direction.

You’re gonna need to play with the PlayerModule to get this functionality going.
In studio, load into the game (test play)
Go to StarterPlayer, you’ll find “PlayerModule”.

Copy the PlayerModule and all it’s decendants, then quit the test, and paste it wherever you want in order to read it more thoroughly.

Under the PlayerModule you’ll find VRCamera and other VR related stuff - that’s where all the juicy stuff you’re gonna want is.

To override the PlayerModule with your own, paste the PlayerModule back into StarterPlayerScripts and make any modifications as you want, however this might not be suitable for your use-case
If you don’t need it… it will still be very useful to see how you should implement this.

There’s also VRService - VRService | Documentation - Roblox Creator Hub
You may be able to use GetUserCFrame to achieve that

If you’re more hung up on the math and implementation, let me know specifically what you need help with.

1 Like
3

Are you sure this is the camera input system and not something to do with VR headsets, since its “VRCamera”? I was talking about the ability roblox provides to move the character’s head by tracking where your IRL head is facing by turning on a physical camera, like this

image
image443×452 48.2 KB

4

I thought I understood what you were trying to do but seems I’ve misunderstood

So to be clear, your goal is to use the Camera Input and capture that somehow in order to manipulate the player’s camera?

Try this while using your camera input thing.

local VRService = game:GetService("VRService")
local enabled = VRService:GetUserCFrameEnabled(Enum.UserCFrame.Head)

and print it out to see whether or not you can listen to input from the device this way.

5

VRService is explicitly for VR Headsets. The APIs to access facial recognition’s output information are simply not accessible to non-plugin code (at best they might be able to figure out the information they want from the CFrame of the player’s character head, however).

6

oh, thats a shame, might need a feature request post then