When using Stable Difussion for AI painting, using VAE can produce many interesting effects. Its filter function can adjust the color saturation of the image according to the needs, so that the image can produce different visual effects.
As shown below:
But if you don't use VAE, your image may become gray.
Article Directory
VAE use
It can be seen that the filter effects of different VAEs are significantly different. And the fine-tuning function of VAE can fine-tune some content in the image without affecting the main elements. However, users can download VAE models from Station C, but the number of models is small.
Another way is to download modules via the model of the one-click launcher.
It is worth mentioning that if you use the chilloutmix model, you hardly need to load VAE, because the color of the model itself is already very bright. Instead it may be necessary to use other VAEs to desaturate the colors.
The picture on the right uses VAE, but the picture on the left does not. The difference is quite obvious.
The use of VAE
download link:
stabilityai/sd-vae-ft-mse-original
stabilityai/sd-vae-ft-ema-original
naclbit/trinart_characters_19.2m_stable_diffusion_v1
If you use the one-key launcher to download VAE, the system will automatically put it into the corresponding folder. models\VAEIf you download it manually, you need to put it in a folder under your SD directory . Refresh the VAE drop-down menu in the webui to see the newly added VAE.
It is recommended to try the 84000 VAE, which is the most commonly used and effective one.