Generative Fill activated when I'm just trying to expand the crop of an image.

Sometimes you just want to expand the crop without Generative Fill. Photoshop just assumes it's generative fill every time, no matter how many times I select cancel. When I do hit cancel it goes back to the original crop.