Generative Fill for Object Removal

Vaughn: Let's begin our investigation of
how AI is built into photoshop using some

of the generative fill options.

So we're gonna look at how Firefly is
integrated, this is Adobe's version of AI

that creates images, and how it might work
to both add things to your images, and to

remove them.

So let's start with the easy stuff, which
is considered, um, to remove something

from your image, okay.

So this is a fairly complex image, two
subjects, wildflowers, I'm gonna use the

generative fill option in order to remove
a subject, okay?

Now this should still be non-destructive,
it's going to add a layer mask, let's see

what this looks like.

So if you were just opening up your file,
you're gonna think about making a change

in terms of the generative fill function,
you still want to think about grabbing a

part of your image.

So let's start by thinking about removing
the person who's being photographed.

Easiest way, I think would be to use a
lasso tool.

You could use any of your selection
tools, you could do select subject,

etcetera, but I find it works best if what
you're doing is trying to remove someone

using AI, to give an outline that's a
little bit bigger than the subject itself.

If you did select subject or select
object, that could work, but we need to

help Adobe know what's happening in the
background.

It's going to look at the whole picture
plane, but giving just a little bit of

edge around your subject, I have found
results in better AI generative results.

So as soon as you have a, um, subject
outlined, you're contextual taskbar jumps

up, right, and we're not actually adding
anything, so when I click on generative

fill, rather than adding a text prompt,
which we'll do in another video, I'm

simply going to jump over to generate.

Now, as it's working, it's investigating
Firefly as the engine that's operating

behind Adobe, this is the AI part of the
program, and you can see pretty quickly

it has quote unquote removed that person,
right, now it's really important to kind

of zoom in, and see what's happened, if
you are not satisfied with the results,

keep in mind, every time you run
generate or generate fill, you actually

get three results.

You can see this is one of three down
here, or you can look over in your

generative layer, which is in the
properties, and you see variations.

So you can click through the variations
in both spots, and decide which one

looks best.

Now you should see some differences,
particularly often how it integrates into

a background or something else that's
happening.

So you want to pick the one that looks
the best, and not the most

repetitive, right.

Because sometimes, things can get
repeated in a way that maybe gives it

away, I actually kind of like this one,
because it doesn't exactly repeat the

background, and I think that looks pretty
good.

Now if you didn't like it, you could
regenerate, you can keep generating when

you're using this AI function, keep in
mind when you have variations, you're

actually increasing your file size because
these are adding up into your file.

So if I don't like some of these, it's a
great idea to go ahead and delete them,

because, of course, I don't want too high
of a file unnecessarily.

Now let's look in your layers panel.

Notice when I turn the visibility off,
hey, our person's still there.

This is non-destructive, and look what
happened, it has a layer mask, okay.

So this little star, kind of, icon inside
the layers panel thumbnail, shows me

it's a generative layer, this shows me a
layer mask, I can always delete it, or I

can redo it.

Now we could do the same thing, I'm gonna
move this contextual taskbar, perhaps for

the other person.

So I'm gonna go back to the background,
let's try selecting a subject using our

object selection tool, now we go over a
lot of ways to grab things to make

selections, um, generally if you're going
to do select subject, a person, using

the cloud is a little bit better, but
let's just see how it does here.

Now it's not done an amazing selection,
so I know right away I need to give it a

little bit more of a boarder.

Expand the selection, give it some
information, some breathing room.

I'm gonna go ahead and modify it with
this button right here, oh sorry, this one

right here, and let's expand.

Let's give it, I'm gonna say 20 extra
pixels, okay.

Now remember the pink, that's just a
preview, so no big deal, let's click on

generative fill, I'm not gonna put
anything in there, I'm gonna let it

automatically figure out how to fill that
content, and hit generate.

These little quick tips can be great to
read too, again the program's always

changing, things are always improving, and
you'll find some images are better

than others.

Okay, let's look at our variations.

I particularly like to watch out for
things that look too blurry, too, that

often feels like a dead giveaway.

But these all actually look pretty good,
actually kind of feel like maybe I like

this one, okay?

Notice it gives it a name, so great
options for quote unquote removing

people in a non-destructive way, using
generative fill.

Now, you're gonna encounter more and more
complex images, or you might try the same

thing on something, let's try the same
thing.

I'm gonna decide that I want to move,
remove, that is, this gentleman.

Now, I kind of missed using my lasso
tool, grabbing all of that, I'll just grab

it a little bit more, and I'm gonna think
of course about, you know, what's

happening when things are separated, that
first image was pretty simple, the people

were intact, nothing was blocking the way,
I'm gonna do generative fill, generate,

and let's see what happens.

Now it's up to you to also think about
lighting, shadow, reflection, it will do

its best, woah this is weird, so in this
case it actually added something, odd,

it added something, so only number one
really worked.

Now you can also report your variations.

Good, poor, etcetera, I think in this one,
you know, maybe I'm satisfied with this,

it's not too bad, I'll turn it on and
off, it's missing some information

here, so I have to do some work
by hand to kind of fix this up, right.

But something that's a little bit more
complex, you're gonna find that maybe

it's gonna struggle, right.

You can't fully rely on AI to do
absolutely everything for you.

Let's, um, I did a poor selection there,
let's make a pretty big, broad selection.

And maybe we even include the shadow.

Let's see what happens if I do that.

Okay, um, fairly complicated, but let's
see what it does.

Generate.

Okay, now that worked pretty well.,
actually, I think including that

information, um, of the rock notice it's
changed the lake right there, but the sky

looks pretty good, the rock looks pretty
good.

Now let's try and do it without including
that shadow, and let's just see how it

can do.

So, quick lasso, giving myself some space,
generative fill, generate.

Okay, now that's odd.

Now, the more you generate, the more
results you're gonna get, and you might

find they're really strange.

Yeah, I don't like any of these, these are
all, oops, there are all pretty poor.

Um, it was definitely not what I was
wanting, so I might rate them, give it

some information.

Um, you can also, again, look at your
variations over here, you can see

thumbnails that are big or small, but
depending on the way you make your

selection, will really change the
outcomes.

So for selecting the shadow, and the rock,
giving it maybe a little bit wider reach,

in terms of the outline, seems to work
pretty well for this one, whereas just

grabbing the person makes it think that
it wants you to fill that area with

some other person, rather than the
landscape.

So, keep that in mind, you're gonna
have to do some experimenting, to

figure out how to use generative fill as
a removal tool.