Disclaimer:
The installation package used in this case is provided free of charge without any profit purpose.
Hello everyone, I am rain or shine.
Presumably you often see that whether it is in product marketing or brand promotion, many people often create wealth for themselves in the form of digital people. However, the fees for digital people on the market are relatively expensive, ranging from a few thousand to tens of thousands.
So how can you have a free digital human generation tool?
In fact, it is very simple. You only need to install the sadtalker plug-in on stable diffusion to easily generate your own digital human.
And it only takes 3 easy steps!
Everyone follow my steps, hurry up to practice, and see the effect.
Note: This tutorial applies to the SadTlaker installation of the Akiba Stable Diffusion integration package.
The first step, the installation of SadTlaker main file
(1) Open the SadTalker project address in the browser
https://github.com/OpenTalker/SadTalker
(2) Download the SadTalker compressed package
If the download is slow, or friends who cannot download, you can go to the sadtalker installation file that I have downloaded here .
https://pan.baidu.com/s/15MRdrNnKi7Q0l48jZO_wgg?pwd=mhbz
(3) Install SadTalker
After we download SadTalker, we will get a compressed package named: SadTalker-main.zip.
-
step 1 Unzip SadTalker-main.zip
-
Step 2 Rename to: SadTalker (Note: This must be changed here, otherwise it will not be recognized)
-
step 3 Copy the SadTalker folder to the sd-webui-aki-v4.2\extensions directory
\sd-webui-aki-v4.2\extensions\SadTalker
Directory after installation:
-
Step 4 Restart Stable Diffusion
After restarting, you can see that the SadTalker label has appeared on the function bar
As shown in the picture:
The second step, the installation of FFmpeg
(1) What is ffmpeg?
FFmpeg is an open source cross-platform multimedia processing tool that can be used to record and convert audio and video content. It contains a set of powerful command-line programs that can perform various audio and video processing tasks, such as format conversion, editing, merging, decoding, encoding, screenshots, etc.
(2), download ffmpeg
To download ffmpeg, you can enter the download address of ffmpeg official website :
https://www.gyan.dev/ffmpeg/builds/ffmpeg-git-full.7z
If the download is slow, or friends who cannot download, you can go to the ffmpeg installation file that I have downloaded here .
https://pan.baidu.com/s/196m5bSoUR8DYA03VjnxeeQ?pwd=fxb7
But no matter where you download the ffmpeg file, you need to configure environment variables for it to work properly.
(3), unzip ffmpeg and configure environment variables
I decompress it directly to this directory and rename it to ffmpeg:
C:\Program Files\ffmpeg
Then you need to configure the system environment variables:
- step 1 My computer, right click menu, properties -> settings
- step 2 Open the advanced system settings window
- step 3 Open the environment variable window
- step 4 Double-click the Path column to open the edit environment variable window
At the end, add the ffmpeg/bin directory just after decompression, and then click OK to save.
C:\Program Files\ffmpeg\bin
The third step is the installation of Sadtalker model files
(1) Download the Sadtalker model file
The Sadtalker model file contains main checkpoints and gfpgan , which can be downloaded from the download link provided by the Sadtalker official website.
main checkpoints download address:
https://drive.google.com/file/d/1gwWh45pF7aelNP_P78uDJL8Sycep-K7j/view
gfpgan download address:
https://drive.google.com/file/d/19AIBsmfcHW6BRJmeqSFlG5fL445Xmsyi/edit
If the download speed is relatively slow, you can also go to the address I have downloaded to download.
The gfpgan download address I prepared:
https://pan.baidu.com/s/1vaqYw-vpreNaNfGUE7wJ3Q?pwd=4efd
The Sadtalker checkpoints download address I prepared:
https://pan.baidu.com/s/1_SXnKa7v8wh1qM2iJOhGwg?pwd=hhat
(2), install checkpoints and gfpgan
Unzip the downloaded checkpoints.zip file to the \sd-webui-aki-v4.2\extensions\SadTalker directory
Note : If the checkpoints compressed package is downloaded from the official website, it needs to be renamed to: checkpoints after decompression
\sd-webui-aki-v4.2\extensions\SadTalker\checkpoints
As shown in the picture:
Unzip the downloaded gfpgan.zip file to the \sd-webui-aki-v4.2\extensions\SadTalker directory
\sd-webui-aki-v4.2\extensions\SadTalker\gfpgan
As shown in the picture:
At this point, Sadtalker installation is complete.
In the next article, we will introduce the simple use of the Sadtalker tool and make a talking digital human video, so stay tuned.