It's a real-time subtitles-based lip sync, i.e. it requires subtitles to create animation. The plugin is using provided text subtitles to generate lips sync animation for characters in real-time. Audio envelope value from the synchronously activated audio component allows to detect silent intervals and to pause animation in this intervals and adjust future animation speed. Subtitles + Sound Asset = LipSync.
Technical Details
Features:- easy setup & use
- using audio envelope value to detect pauses
- using pauses in audio for real-time animation adjustments (this allow to play quite long audio sequence using a single subtitle line)
- subtitles can be separated to blocks with in-out time marks to get better result
- information gathered from audio can be saved to file to improve future animations
- can automatically load map of phrases from data table
- sources included
- Text2LipSync (Runtime)
Number of C++ Classes: 4 (1 actor component exposed to blueprints)
Network Replicated: No
