I found the issue has been reported on Uservoice. I'd recommend upvoting it to have the product team prioritize it. In the meantime, one of the comments there said that if you copy it and paste it into Illustrator, then copy it and paste it back into XD that it resets it.
Thanks Myra. I don't use Illustrator.