Facial Motion Capture for Naughty Sandbox 2
The characters for NS2 have been completely overhauled, with a major part of the upgrade being a custom facial motion-capture system.
This isn't implemented in the prototype builds in a big way just yet, but it's gonna be used for emotion reactions + lip sync for vocalizations and voiced dialogue reactions later.
The clip above shows a playback demo of some recorded mocap-data from a basic webcam, and applied to her face.
As the virtual character performs the motion captured facial animation, she can also layer in dynamic behavior like blinks, glances, and the ability to look at the camera / player, for a much more engaging experience.
Comments (6)
There'll be plugins & mods support ?
I'd do this if I knew how, not sure what the technical process is of allowing mods
Also, once you got a VR set up, I would appreciate the option of having two physics interactive hands instead of controllers or just dots. And HMD collision too, I personally found games with this feature where physics objects or characters can be pushed away by player face are way more immersive over those games where players head can simply go into the 3D model of things. Those set up a good foundation for VR interactions in my opinion.
Yep, good idea, like virtamate !
Looking really good! I’m really glad that you think details like this should be part of the core of the program. Do you have some kind of timeline system in mind so that people can easily add motion capture and voice acting data to create a scene?
The mocap requires some processing and to be converted into an animation file within UE4, not actually sure if it's possible for players to create facial mocap, will look into that one. As for body mocap, it's high priority but I can't do anything for it until I have a VR set up myself, VR isn't supported in the new update yet, but when it is, mocap / character possession is probably the first thing I'll be adding, since it was sourly missing in the original Naughty Sandbox