- Версия Unreal Engine
- 5.6
Description
Note: The images with plugin examples and the demo project were created using the Runtime Audio Importer and/or Runtime Text To Speech / Runtime AI Chatbot Integrator plugins. So, to follow these examples, you will need to install these plugins as well. However, you can also implement your own audio input solution without using them.
NEW: Enhanced Realistic Model for Premium Quality!Bring your MetaHuman and custom characters to life with zero-latency, real-time lip sync! Now featuring two quality models to suit your project needs:
Realistic Model - Enhanced visual fidelity specifically for MetaHuman characters with more natural mouth movements (250 morph target changes)
Standard Model - Broad compatibility with MetaHumans and custom characters (14 visemes)
Transform your digital characters with seamless, real-time lip synchronization that works completely offline and cross-platform! Watch as your characters respond naturally to speech input, creating immersive and believable conversations with minimal setup.
Quick links:
Product website
Packaged Demo Project (Windows)
Demo source files (UE 5.6) – Requires this plugin + Runtime Audio Importer, optional: Text To Speech / AI Chatbot. Standard model requires a small extension plugin (see docs).
Documentation
Discord support chat
Custom Development: solutions@georgy.dev (tailored solutions for teams & organizations)
Latest video tutorials:
High-Quality (Realistic Model) Tutorials:
High-Quality Lip Sync with ElevenLabs & OpenAI TTS 
NEW- High-Quality Live Microphone Lip Sync NEW
- Demo video showcasing the plugin's capabilities NEW
- Standard Live Microphone Lip Sync
- Standard Lip Sync with Local Text-to-Speech
- Standard Lip Sync with ElevenLabs & OpenAI TTS
Key features:
- Real-time Lip Sync from microphone input and any other audio sources
- Dynamic laughter animations from detected audio cues
- Pixel Streaming microphone support - enable live lip sync from browser-based input!
- Offline Processing - no internet connection required
- Cross-platform Compatibility: Windows and Meta Quest
- Optimized for real-time performance on all platforms
- Works with both MetaHuman and custom characters:
- Popular commercial characters (Daz Genesis 8/9, Reallusion CC3/CC4, Mixamo, ReadyPlayerMe)
- FACS-based character models
- ARKit blendshape standard
- Any character with custom morph targets for facial expressions
- Multiple Audio Sources:
- Live microphone input (via Runtime Audio Importer's capturable sound wave)
- Captured audio playback (via Runtime Audio Importer's capturable sound wave)
- Synthesized speech (via Runtime Text To Speech or Runtime AI Chatbot Integrator)
- From audio file/buffer
- Custom audio source (including streaming)
Perfect for:
- Interactive NPCs and digital humans
- Virtual assistants and guides
- Cutscene dialogue automation
- Live character performances
- VR/AR experiences
- Educational applications
- Accessibility solutions
Works great with:
- Runtime Audio Importer - For microphone capture and audio processing
- Runtime Text To Speech - For local (offline) text-to-speech
- Runtime AI Chatbot Integrator - For ElevenLabs and OpenAI text-to-speech
