Just over-expand the mask and let stable diffusion decide what it's going to keep and what it's going to replace.
Just over-expand the mask and let stable diffusion decide what it's going to keep and what it's going to replace.