[Showcase] Real-Time Motion Capture in Roblox (Looking for feedback)

Hello everyone!

I’d like to share my latest project: a real-time motion capture system for Roblox. This system allows direct motion data transfer to a character in a Roblox game, providing near-instant response to real-world movements.

Key Features:

  • Real-time motion capture: seamless transfer of motion data to the character with minimal latency.
  • Flexible character support: adaptable to various models and rigs.
  • Live demonstration: showcases how motion data translates into animations in real-time.

Video Demonstration

To give you a clearer picture of how it works, I’ve prepared a video demonstration.

This project under construction, so for now rig motions not that stable as expected.

10 Likes

very unrelated but uh

But I was able to check out the video and it looks real smooth

I’m referring to the stability of how the rig’s limbs move. And I’m still looking for a way to translate the body’s movement in space so that I can rotate it 360°.

1 Like

could this be used for stuff like mirrors where it mimics nearly everything on the other side of the mirror?

1 Like

I guess so. This project was originally made for motion capture as a technical demo. In some scenarios, it could be used in such a way. But the primary goal is an animation tool for low-cost motion capture, since I’m using very cheap instruments for this. Maybe 60$ in total.

UPDATE:
Just made an almost perfect version of Motion Capture (with my avaliable resources)

:video_camera: Watch the video

And some internal stuff

IMPORTANT NOTE:
I recorded this in a small room, with almost no light, so in large rooms and with normal lighting, the results should be better!


Model/Mesh Vertex Inversion:
I discovered an interesting technique to invert the vertices of any model, mesh, or part. This could open up new possibilities for creative or technical use cases.

Summary



And I made couple of mosters while testing. lol

Summary



Help me...
236x236

3 Likes

this is great.

although i see the main issue with this is the jittery motion. how about trying out denoising motion? i mean nothing insane but I would assume it could help in at the very least reducing jitter a bit.

should check out kalman filtering for real-time applications of this.
:+1:

1 Like

As mentioned earlier, the issue seems to stem from my setup; it should perform better in a room with better lighting conditions. Regarding filtering, I plan to implement it on the server side (i.e., my PC). Thank you for the recommendation.

1 Like

Update

  • Refined Motion Capture Process: Improved for better accuracy and efficiency.
  • Smoother Motion Integration: Upgrades ensure more seamless motion translation into the game.
  • Custom Kalman Filtering: Added to reduce noise and improve motion data processing.

And first time on roblox, Just Dance but it’s roblox (lol)

P.S. Thanks to @Commersant for helping with applying motions to the rig!

2 Likes

Peak :33333333333333333333333333333

1 Like

THIS IS SOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO COOOOOOOOOOOOOOL even if its kind of broken

1 Like

i think a issue is the rig having not enough parts

Finally managed to get everything working with the standard Roblox animator. For now, I’m done. I’ve ordered a Kinect v2.0 from China and plan to set it up later. Hoping for even better results with it.


P.S. I’ve made an 15 minutes long animation for test, some how roblox managed it but…

2 Likes