Auto Masking a Person doesnt select the same person when syncing to other photos of the same scene

When syncing a People/Person Mask from one photo to another, the correct person isn't recognized on the synchronized photos if there is more than one person in the photo. Since the mask is already generated using AI, this should really be possible.

Especially fun when the people are wearing really different outfits. f.e. I wanted to paste a mask of the grooms suit onto other pictures within a very similar stack of pictures and on all the synchronized photos it selected the white wedding dress of the bride.