Lipsync + Facial Expressions
I've been working on the lipsync and facial expressions for Melany and even though this is not the final result, I'm ready to show you a video. This has taken me multiple months, since I it's lower priority and I've only put an hour or so of work on that system during the weekends.
Keep in mind that this is not Melany's voice, I used a free text-to-speech app to generate the audio and test hard to pronounce words.
All of this is achieved with 7 visemes - OO, EE, OW, TH, T, F, W.
The other facial expressions (and some of them seen on the video) available are:
-Mouth open
-Mouth open (wide)
-Angry
-Tongue out + up / down controls
-Multiple lips controls
-Biting her lower lip
-Eyebrows movements
Now, I want to focus on making the cheeks move up and down as she's speaking, because currently they are very static.
Comments (2)
Looks good. Do you use some ready-made asset for lipsync or did you write your own system?
It's a combination of both, I use Salsa + my own system for this game specifically, since some of the dialogues will be "whispers / thoughts" and Salsa also triggers them, which isn't what I want. However, back in 2018 (I think), I've used Salsa only and was able to achieve a very decent results, but it was pure dialogues and not whispers / thoughts.