OpenTalker/SadTalker

Public

[CVPR 2023] SadTalker:Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation

  • Stars14.2k+23 tuần này
  • Forks2.7k
  • Watchers164
  • Issues628
  • Ngày tạo23/11/2022
  • Cập nhật gần nhất26/06/2024
  • Ngôn ngữPython
  • Giấy phép—
README.md32.6 KBRaw

    Open In Colab   Hugging Face Spaces   sd webui-colab  
Replicate Discord

Wenxuan Zhang *,1,2   Xiaodong Cun *,2  Xuan Wang 3  Yong Zhang 2  Xi Shen 2 
Yu Guo1   Ying Shan 2   Fei Wang 1  

1 Xi'an Jiaotong University   2 Tencent AI Lab   3 Ant Group  

CVPR 2023

sadtalker

TL;DR:       single portrait image 🙎‍♂️      +       audio 🎤       =       talking head video 🎞.


Highlights

  • The license has been updated to Apache 2.0, and we've removed the non-commercial restriction

  • SadTalker has now officially been integrated into Discord, where you can use it for free by sending files. You can also generate high-quailty videos from text prompts. Join: Discord

  • We've published a stable-diffusion-webui extension. Check out more details here. Demo Video

  • Full image mode is now available! More details...

still+enhancer in v0.0.1 still + enhancer in v0.0.2 input image @bagbag1815
still_e_n.mp4
full_body_2.bus_chinese_enhanced.mp4
  • Several new modes (Still, reference, and resize modes) are now available!

  • We're happy to see more community demos on bilibili, YouTube and X (#sadtalker).

Changelog

The previous changelog can be found here.

  • [2023.06.12]: Added more new features in WebUI extension, see the discussion here.

  • [2023.06.05]: Released a new 512x512px (beta) face model. Fixed some bugs and improve the performance.

  • [2023.04.15]: Added a WebUI Colab notebook by @camenduru: sd webui-colab

  • [2023.04.12]: Added a more detailed WebUI installation document and fixed a problem when reinstalling.

  • [2023.04.12]: Fixed the WebUI safe issues becasue of 3rd-party packages, and optimized the output path in sd-webui-extension.

  • [2023.04.08]: In v0.0.2, we added a logo watermark to the generated video to prevent abuse. This watermark has since been removed in a later release.

  • [2023.04.08]: In v0.0.2, we added features for full image animation and a link to download checkpoints from Baidu. We also optimized the enhancer logic.

To-Do

We're tracking new updates in

Nội dung README thuộc về OpenTalker và cộng đồng đóng góp, giấy phép Không có giấy phép. Nguồn: github.com/OpenTalker/SadTalker