Using generative fill on a simple sketch for image creation

[EuanWilliamson]

By using a combination of a partial density selection fill and then generative fill, some interesting images can be created.

 

Credit: @Rob de Winter 

https://youtu.be/bUylfeEZ7aI

[davescm]

I wonder if this would be better in the Photohop Beta forum, Euan?

Dave

[EuanWilliamson]

Could be, however I'm sure GF will be out of beta soon 🙂

[Trevor.Dennis]

That's really clever Euan.  I tried it and got the result below, but I don't understand how the Quick Mask > Fill > Color bit works.  It's something totally new to me, but even without Generative Fill, the 'Fill > Color' part is an interesting process, and I'd like to know how it works?

[EDIT]  BTW, the first time I tried it didn't work.  I then realised that after using Fill > Color you have to come out of Quick Mask before hitting Gen Fill.

[EuanWilliamson]

Well, as I understand it:

Although we are using Fill > color we are just setting it to ( in this case ) a 70% density fill of gray

When we come back out of Quick mask that translates to a partially transparent mask due to that 70% density

Generative fill which works upon an image selection uses that 70% density to guide where it infills

with the suggested key words.

So, in the same way it looks at a "normal image" that it is generating into while using a selection, I think our key words imply to it that our sketched image fits to the keywords.

This YT vid has some explanation: https://youtu.be/ZUJSIzCW5L4

[Trevor.Dennis]

But where does the color com into it?  What is the relevance of the simple sketch?  I remember John @Semaphoric showing us how to make displacement maps using colour instead of monochrome maps, which seems to be relevant to the above process. 

[Rob de Winter]

Thanks for sharing (and the credits @EuanWilliamson )! 

@Trevor.Dennis : it works like this:

1. When you go to Quick Mask Mode and fill with 70% Brightness, a selection will be created with 70% Opacity. 
2. 70% Opacity means that this selection is 30% translucent, so Generative Fill picks up this 30% from the underlying layer (the colored layer). 
3. The lower you set the Brightness (the Fill percentage), the more translucent the selection becomes and the more the Gen Fill layer will look like the underlying layer.
4. I have found that the best setting is around 70%. 

I hope this clears it up a bit, but it is rather abstract, haha. Photoshop Gen Fill is still in beta, so probably this will be integrated much more user friendly in the future. But, for now it's a great way to get started 😄 

[Trevor.Dennis]

Thanks Bob.  It needs a few experiments to get to grip with it, and I started that process using the exact same Gen Fill prompt (Sunset behind a field of barely with tree in the foreground) on the sketch on the left, and blank white background on the right.  The Color > Fill version does resemble the sketch, and the tree is in the right place.  Right now, I am wondering why Greenshot turned the full white square gray when copying it?

[EuanWilliamson]

@Trevor.Dennis 

What he said 😉

@Rob de Winter