Struggling to get rid of voice in BG in Au

Hei!

I am not completely familiar with audition, I tried to do this in Premiere but it didnt sound as good as I would hope.

I have this audio where a guy is talking, but I want to cut some of the unnescessary words he says during the audio without changing the background noise ( there is a light buzz). It would have been smart to get rid of the background noise first however the first part of the video is already out and right now I am trying to keep it consistent. Any thoughts you guys?

I tried to do it in Audition with Noise reduction and REstauration, and I just selected the guy's voice that i wanted to get rid of but it just leaves the audio with a weird sound after that...