Eliminating external hammering sound and fixing resulting audio

HI,

So I have been struggling with this problem and cannot fix it 100% to my satisfaction. I record videos in a home studio but cannot control all external noises which can crop up unexpectedly. I have several videos with an intermittent hammering sound that needs to go. I've been able to delete the sounds satisfactorily in Audition by capturing it and setting noise reduction to 60 and dB to -20. However I am left with what I would describe as slight distortion (may not be the correct technical term) of my voice. It's not really bad but I'd like to clean it up and don't know how even after playing wround with different effects etc. 
I have attached two files. One 'audio good' and the other, 'audio bad' and are both from the same track. The 'audio bad' has the hammering edited out in Audtion but now has the "distortion".
I'd really appreciate if someone could take a listen