ieti - Simply excellent
5 stars on version 1.2.0. Does exactly what it says on the tin. Easy setup, great results, and no bugs so far. Five stars!
FaceSync - Audio Lip Sync & Facial Animation video
Features
What is included.
Welcome to Frostember FaceSync , the ultimate audio-driven facial animation ecosystem for Unity. Whether you are building AAA cinematic cutscenes, highly optimized VR games, or live VTubing avatars, FaceSync delivers accurate lip-sync and procedural facial movements with zero hassle.
Stop wasting hours manually animating blendshapes or fighting with heavy real-time CPU loads. FaceSync bridges the gap between high-end realism and perfect optimization.
DOCUMENTATION + ROADMAP | FORUM | YOUTUBE
WE HIGHLY RECOMMEND INSTALLING THE TEXTMESHPRO ASSET TO VIEW THE DEMO SCENE TEXTS!
THE PLUGIN DOES NOT CURRENTLY INCLUDE FULL MAC OS SUPPORT!
🔥 Key Features
Zero-CPU Offline Baking: Real-time audio analysis kills frame rates on Mobile and VR. Our built-in Baker simulates the audio at 60 FPS in the Editor, baking visemes, procedural head noise, and blinks into a highly optimized FaceSyncAnimationAsset. Play it back at runtime with absolute zero CPU cost!
Native Timeline Integration: Drag and drop your baked data into our custom FaceSync Track. Smoothly blend animations, scrub through time, and dynamically override eye and head behaviors directly from the Timeline Inspector.
Procedural Eyes & Head Motion: Bring dead stares to life. FaceSync automatically calculates realistic blinking, saccadic eye darts, and micro-jitters. The head and neck procedurally react to the character's voice intensity using Perlin noise.
1-Click ARKit & CC3/CC4 Setup: Stop manually assigning dozens of blendshapes. Our VisemeMappingProfile features 1-click auto-generation for standard ARKit (52 blendshapes) and Character Creator rigs, creating highly accurate mouth shapes instantly.
Live Microphone (VTuber Ready): Switch to Live Mode and use the included Frostember_MicrophoneInput component to drive your character's face in real-time using any connected microphone. Perfect for multiplayer voice chat and VTubers.
Setup Wizard: Get your character fully rigged and talking in under 30 seconds using the automated Setup Wizard.
Emotions profiles: A dedicated, robust module inside FaceSyncController that allows developers to seamlessly blend custom facial expressions (e.g., Happy, Sad, Angry) with active lip-sync data.
IK Look Tracking: Automatically make your character track any object or player in the scene! The robust inverse kinematics system seamlessly blends with procedural speaking noise and animations, giving your character a dynamic focus without unnatural rotation snapping.
💻 API & Scripting
Triggering dialogue dynamically via code is incredibly easy using the FaceSyncPlayer component. Just assign the baked asset and call .Play(). Perfect for custom RPG dialogue and quest systems.
Questions?
contact@frostemberstudios.com
Audio Processing: Utilizes the Oculus LipSync engine for highly accurate real-time FFT phoneme detection (15 core visemes).
Offline Baking System: Custom Editor Window (FaceSyncBaker) bakes complex audio analysis and procedural animation at 60 FPS into a lightweight ScriptableObject (FaceSyncAnimationAsset).
Zero-CPU Playback: The FaceSyncPlayer component reads baked assets, eliminating runtime CPU cost for audio analysis, making it highly optimized for Mobile and VR.
Native Timeline Integration: Custom Playable API implementation (FaceSyncTrack, FaceSyncClip, FaceSyncTrackMixer) supports smooth blending, editor scrubbing, and dynamic state overrides.
Procedural Animation: Mathematical real-time generation of saccadic eye darts, micro-jitters, and voice-energy-driven Perlin noise for head and neck rotations.
Auto-Mapping Profiles: VisemeMappingProfile includes algorithms to auto-generate mapping for ARKit (52 blendshapes) and Character Creator 3/4 standards.
Live Input: Included Frostember_MicrophoneInput script captures system audio for real-time processing (VTubing/Multiplayer).
Performance & LOD: Built-in distance-based Level of Detail (LOD) and frustum culling automatically disable processing when the mesh is off-screen or far away.
GC Optimized: Runtime playback loops and Timeline mixers are built using array-based iterations to prevent Garbage Collection allocation spikes.
Requires the free Oculus LipSync Unity Integration package (Meta SDK). => Included in package
Compatible with Built-in, URP, and HDRP render pipelines.
Reviews
Product review notes.
Customer feedback, setup notes, and production impressions from Unity users.
LoRaWAN - FaceSync
5 stars on version 1.2.0. What I like most is not only lips but eyes movement. Those tiny eye darts and head motion make character feel shy or nervous sometimes, it is funny. Also Timeline support helps to control scenes better, like making small movie inside Unity. I didnt expect to care about face animation this much but now I do.
THEREALIZATION - Great asset
5 stars on version 1.2.0. Ive been looking for something that can easily create facial animations and this asset is exactly what I was looking for. It's super easy to use, It generates lip sync at runtime directly from an AudioSource and feels natural without much setup. Tbh I was surprised how easily this asset creates lip sync animations at runtime. It just works without much setup and looks natural, definitely recommend it.
Similar products
More Unity tools.
Other Frostember assets for production workflows, editor tooling, and Unity project pipelines.
LiveTools/Utilities
FrostBoard - Kanban Task Management
FrostBoard brings a native Kanban board into the Unity Editor.
View product
LiveTools/Utilities
FrostNote - Project Management & Wiki
FrostNote is a Unity Editor notebook for project notes, task notes, documentation, team docs, Markdown import/export, and optional Nostr sync in Unity 6.
View product
LiveTools/Audio
FrostSpeech TTS - Offline Text-to-Speech (TTS) & Voices Plugin
Generate high-quality voiceovers directly in the Unity Editor for free.
View product