Concern about e-signature

As a Realtor, I find that more and more transactions are happening with no party ever meeting. All of the contract documents are e-signed on various platforms, including Adobe. I understand that in the e-signing process, I can view an audit report that shows the various signers to a document, but how do I know that the correct person signed? 

Suppose I send a contract to Joan Sing, whose email is iLoveCoffee@gmail.com. The contract comes back with her e-signature and an audit report, but there is no way to verify that Joan Sign is a real person, that iLoveCoffee is her real email, or that someone else (like a friend) logged in as a favor to her and signed. 

If I understand the process correctly, there is no way to verify that the person who signed is the person who was supposed to sign. 

Thanks for your thoughts