Firefly Image Generation to replace existing assets

Hello Adobe creatives! 

Has anyone used ADobe Firefly or Photoshop's Generative AI features to replace a specific component in a photo? 

My use case is I have a photo of award medals in a layout that were taken some time ago, but the medal design has since changed. I now have the updated design file and would like to use AI to update the medals in the existing photo using the new design as a reference. 

Is this possible with either Firefly or Photoshop (e.g. via Generative Fill or another AI workflow)? And if so, what's the best approach to ensure realism and consistency across the set? 

I've tried this already so far in Adobe Firefly Boards, and it's just spitting back out the same image I'm referencing, and have tried about 5 different models so far. Not sure if it's my prompt, or I'm using the wrong model... or maybe it isn't possible yet. Reference of my image and source image of the updated medal attached for reference. 

Thanks in advanced!