Video-Retalking
Audio-based lip sync editing for talking head videos.
About
VideoReTalking edits the lip movements in an existing talking-head video so they match a new audio track, which suits dubbing, translation, and post-production fixes. It works on real-world footage through a pipeline that aligns expression, generates a synced mouth region, and refines the result with pretrained models. A Colab notebook and Replicate demo are provided. Developed by researchers at Xidian University, Tencent AI Lab, and Tsinghua University.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Animation & Motion
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- Minimum VRAM
- 6 GB
- Added
- Apr 3, 2026
Related Tools
Animates a still human photo with 3D SMPL parametric motion guidance extracted from a driving video.
Free markerless motion capture system that works with ordinary cameras and no special hardware.
Audio-driven Tencent model that animates avatar images into emotion-controllable dialogue videos.
ByteDance's audio-conditioned latent diffusion model for lip-syncing video to new speech.
Audio-driven talking head animation from a single image.
Effective whole-body pose estimation with few-shot keypoint detection.