GhostOS
TMF Expert
- Joined
- Mar 5, 2023
- Messages
- 400
- Points
- 28
Has anyone tried putting something decent looking together with Stable Diffusion + ControlNet?
I did some testing recently, specifically with LineArt control, and it turned out quite well. They were pretty simple drawings so it wasn’t that mind-blowing, however, I tried some tickle artwork as well with more people and more complicated composition and the results are pretty good actually.
Bear in mind that this is just a quick test I’ve put together on my shitty laptop. This could be done much better by slicing the original picture and doing the smaller parts separately in higher resolutions to really get all the details right, and then merging it together in Photoshop and maybe manually fixing the rest.
View attachment 753990
Also, apologies to Augustine for borrowing his artwork for this, hope you don't mind 🙂
That is impressive, though it being Stable Diffusion it still struggles with feet (it can't do feet at all, really, unless you'd add a customly trained model I think) and extreme poses. I've used SD before (the Protogen model) through a demo space on Huggingface, but as a "smart filter" instead; putting through a rough painting in IMG2IMG with a low denoising strenght value. Still had to spend several hours of compositing, blending and overpainting in Photoshop though, but it did cut the work time down significantly. Never had much luck with Controlnet or using custom models, my computer is a pretty cheapo second hand Dell laptop with no graphics card to speak of, so local install is out of the question and I'm stuck with online demos for experimenting with. 😛