Recognising faces

A five-year-old looks quite different from the same child as a baby, and if one is tagging her with the same name throughout, as is natural, I am wondering if one is in fact giving the facial recognition module contradictory information making it more difficult for it to identify this individual, because, as far as this module is concerned, one is effectively labelling two different people (the baby and the toddler) with the same name.