Adobe Firefly Custom Model

Hi, Can custom models be used to generate outputs with transparent backgrounds?
I was training my custom model with pngs having transparent background. But my custom model captioning of the images is wrong. My captioning is correct if I upload a jpeg as this png to jpeg conversion adds a solid background.