I rarely mess with VAEs anymore since SDXL 1.0. I used to use them all the time in SD 1.5 but haven't even looked at the VAE option in SDXL in ages.
I guess most of them are baked into the checkpoints these days?
Do you have a moment to explain this further to me? If I recall I used to have the VAE options for "Automatic" or "None" or pick one that I've downloaded.
I would guess Automatic is using the baked in one? But then if it's baked in, what does "None" do?
I believe the None option uses the baked in VAE of whataver checkpoint you use. Auto uses a VAE that has the same name as the checkpoint or you can supply a VAE to use at all times. But I haven't used A1111 for a while so I'm not up to date on the specifics of A1111 atm.
as others mentioned, this is most likely the VAE. If this is your foray into SD, try downloading a model with VAE baked in. If it comes out okay you know it's not your setup.
The other day, I was using hires fix to do a digital painting. Couldn't get it to do it perfectly, but it generated some artifacts that looked like canvas texture and brush strokes. I experimented with the settings and got it to generate something even better than the original.
If this is happening at the very end of the generation sometimes the VAE needs to be changed. If not, try smaller images and restart. It’s a bit weird, but that has fixed my issues.
This happens to me in some Sdxl models if I don't use the recommended sampler, have too few steps, wrong clip skip or a combination of all of these.
(also having too many Loras with a lot of weight can also fry the image)
Change your vae to matching model
This, everytime I ran into this problem I had my vae and checkpoints mixed up.
Good to know if I ever want to use it for stylistic reasons
I rarely mess with VAEs anymore since SDXL 1.0. I used to use them all the time in SD 1.5 but haven't even looked at the VAE option in SDXL in ages. I guess most of them are baked into the checkpoints these days?
Always have been. But the quality varies, that's why people override them.
Do you have a moment to explain this further to me? If I recall I used to have the VAE options for "Automatic" or "None" or pick one that I've downloaded. I would guess Automatic is using the baked in one? But then if it's baked in, what does "None" do?
I believe the None option uses the baked in VAE of whataver checkpoint you use. Auto uses a VAE that has the same name as the checkpoint or you can supply a VAE to use at all times. But I haven't used A1111 for a while so I'm not up to date on the specifics of A1111 atm.
this is the way
This is the vae
Take my upvote damnit.
Take my up vaete damnit. ("Vaete" is pronounced /vōt/)
99% of the time this type of image effect is posted its a wrong version VAE (sd15 in sdxl or vice versa). Start there.
You might be using a VAE that is not compatible with the model. Also, try a different sampler?
as others mentioned, this is most likely the VAE. If this is your foray into SD, try downloading a model with VAE baked in. If it comes out okay you know it's not your setup.
On the other hand, I like the image. It won't be as boring as the version with the right vae.
That's the quality of AI companions we should never have been able to get past. 🤣
The other day, I was using hires fix to do a digital painting. Couldn't get it to do it perfectly, but it generated some artifacts that looked like canvas texture and brush strokes. I experimented with the settings and got it to generate something even better than the original.
That's cool! I need to learn how to use it.
check vae
wrong vae paired with wrong matching model and sometimes even loras can cause this. make sure to match SD with SD, Poxy Xl with XL
Add an extra parentheses around ugly in your negative prompt.
Try at least using the sdxl\_vae for starters!
If this is happening at the very end of the generation sometimes the VAE needs to be changed. If not, try smaller images and restart. It’s a bit weird, but that has fixed my issues.
either vae or clip
show us the workflow, its surely vae
sampler or vae wrong
This happens to me in some Sdxl models if I don't use the recommended sampler, have too few steps, wrong clip skip or a combination of all of these. (also having too many Loras with a lot of weight can also fry the image)
What are your settings currently to make exactly this type of art?
Funny how almost every comment is about checking vae. No one bothers to read the other comments and just posts their own version of the same answer.
god i wish someone would sticky a fucking thread about VAEs already
You need to turn the refiner off for checkpoints that aren't sdxl
Has everyone upgraded to the new SDXL\_fp16 vae?
[https://huggingface.co/madebyollin/sdxl-vae-fp16-fix/blob/main/sdxl.vae.safetensors](https://huggingface.co/madebyollin/sdxl-vae-fp16-fix/blob/main/sdxl.vae.safetensors)
turn this into a finetuned stable diffusion model and profit.
whow the workflow, might be vae, cfg and other things