" At present, Stable Diffusion has achieved relatively stable results in the control of human body posture, but it has not yet solved well in the control of human face and hand posture, and hand and face collapse often occur. "
01
—
After Detailer solves the problem of face collapse
After Detailer is an extension of sd, similar to Detection Detailer, except that it uses ultralytics instead of mmdet.
First we start the SD, then expand the interface, choose to install this extension from the URL https://github.com/Bing-su/adetailer.git, and then restart the UI
Then we use Guofeng 3 to generate pictures as shown in the figure
The facial image is not perfect, there is a little bit of face collapse, and then we will open ADetailer,
Select the model face_yolov8n.pt, then use the prompt word detailed face, the generated image is as follows, the face has been significantly improved, but the problem of hand collapse is still not solved, it does not matter, then look down, we try different methods to solve this problem
02
—
Broken hand problem solved
In the first method, we use the embedding model. There are many models on station C, such as
We download the model and put the model in the embedding directory, then add negative_hand-neg to the negative prompt, and then generate the image, which is significantly improved compared to the problem of hand collapse above.
In the second method, we use the LyCORIS model to solve the problem. LyCORIS is similar to LORA. They are both fine-tuning models. There are also models on station C. We download the model as shown in the figure and put it in the LyCORIS folder.
Then add <lyco:GoodHands-beta2:1.0> to the prompt word to generate the following picture, and the hand collapse problem has also been solved very well
The third method, we use controlnet for gesture control
Drag the picture of Bengshou to controlNET unit0, and then click 
to preview it, as shown in the figure below
Then click Edit Preview
It should be noted here that if you click edit to report an error, you need to install openpose editor, click on different parts, such as the left hand and right hand to edit, and send it to ControlNet after editing
Wen Sheng figure again, get the following effect
Looks like an improvement, but needs further fine-tuning
The above three methods to solve the collapse of the hand can be used, or multiple methods can be used at the same time, as long as the problem can be solved efficiently.
Friends who are troubled by the collapse of hands and faces in SD pictures, come and try it together