AE Keylight issue

I keep losing a clean key behind glasses when the subject turns his head.  In general this key has been a pain to execute.  Would REALLY APPRECIATE any suggestions or help with this from the green screen experts.  Attached is a side by side of the issues.

THANK YOU FOR YOUR HELP!Green screen problem.png