Hello @thepuckadelic,
Thank you for your message.
The model does not understand the concept of a word being negated by the word in front of it. So using "not [X]", "no [X]", "exclude [X]", "minimise [X]", "with no [X]", and "without [X]" does not work. As you observed, it ignores the negation word and adds to the image or video the thing you are trying to avoid. You basically need to find "positive" words and phrases telling the model what you want to see rather than telling it what you do not want to see. Such as "flat land" rather than "no mountains" or "desolate" rather than "no people". If I am not sure how to describe something I want to exclude in a positive way, I will ask Google Gemini or ChatGPT for ideas. Just be aware that when they give prompts, they are usually too wordy and conversational, so you have to edit them, but they are good for ideas.
The other possibility is let it generate with the hats and then take the image to generative fill to remove it.
Thanks,
droopy