This repo has been deprecated and will no longer be updated. The new repo is at https://huggingface.co/ByteDance/LatentSync.

The checkpoints of LatentSync

This repo not only stores the pretrained U-Net and SyncNet checkpoints of LatentSync, but also stores the whisper checkpoints, auxiliary checkpoints for detecting face, calculating syncnet confidence score and so on. They have covered all you need for both inference and training of LatentSync

Paper: https://arxiv.org/abs/2412.09262

Code: https://github.com/bytedance/LatentSync