As a general rule, keep any additions below 2k x 2k pixels for best image quality. Smaller is better. Firefly isn't set up to work with larger pixel dimensions. If you try to fill areas larger than that, the quality goes down very sharply.
Use the tools for how they are designed. If you want to remove something, use the Remove tool in preference to Generative Fill. In Ps 2025, the Remove it can use genAI if it needs to (check the options in the Control bar), but won't if it doesn't, and it's very effective. If you need to replace something in the image with something else, first remove it, then use Generative Fill with the appropriate prompt to add back what you need.
If you want to add to the edges of an image, you can use Generative Expand, which is an option of the Crop tool, but again keep any genAI to increments below 2048 px in any dimension.
You can use Generative Fill, which appears automatically in the Properties panel whenever you make a selection, to extend the boundaries of an image larger than 2048 px on that edge. First extend the canvas, then marquee select sections and fill them.