Thanks for reaching out and sorry to hear that you're having trouble in using psd data in XD. Could you please share a few more details like:
The version of XD
The MAC or WIN version which you are working on.
Is this happening on a specific psd file or all the files?
Also Is it possible to share a video of the workflow as well as the psd file so it will be useful to reproduce the issue. Tried to reproduce the issue from our end on latest XD version-126.96.36.199., but couldn't able to reproduce it, so please share the above mentioned details.